I don't think that the mother would necessarily have to have been a Page for your ancestor to be given the name Mann. I find that many of my ancestors from that period gave their childen the names of prominent citizens either local or national. I have a woman in my tree named Jane Livermore Thornton. Livermore was the name of a prominent local man, no relation to the family at all.
I know this doesn't answer your question, but it is something to consider.