Apparently, he was never married to Louisa Letha N "Lettie" Mathis/Mathews but the death certificates of at least some of her children list him as their father. He may well have been the father of all of them. Census records show her as head of household from 1850-1880 with the last name as Mathis or Matthews.