I went to FamilySearch, found this record for Find A Grave:
Which leads to this memorial on Find A Grave:
Which shows he was a Civil War veteran. Lists his wife and children. And it lists a child of William Henry Olmstead. So that matches too.
Now, none of this has been shown with real sources. This is just information that other people have uploaded. Hopefully it's accurate. But it's a starting point to do more research and to see if the connections line up.
And I encourage you and your wife to join WikiTree and start recording your family tree here. It helps to be able to collaborate with other people, and build on top of research that's been done.
Hope this helps.