x DNA is passed on to all children of a couple. As you mention, any female descendants receive an x Chromosome from their father and their mother while male descendants only receive their x Chromosome from their mother.
So if you have a matching x Chromosome segment for two male testers it means that they both received that segment from their respective mother's x Chromosome ancestors.
My Mother, my mother's parents, her father's mother and both of her mother's parents, etc, etc.
If you go to
https://www.wikitree.com/treewidget/Pennie-22/89 the top tree shows who contributed to your x Chromosome.