In 1855 in Barre, census image he reported he was born in Monroe county, New York.
"New York State Census, 1855," database with images, FamilySearch (https://familysearch.org/ark:/61903/1:1:K63N-8TC : 7 September 2016), David Spencer, E.D. 1, Barre, Orleans, New York, United States; citing p. , line #28, family #341, county clerk offices, New York; FHL microfilm 592,746.
IN 1850 in Clarkson, Monroe county
"United States Census, 1850," database with images, FamilySearch (https://familysearch.org/ark:/61903/1:1:MCBM-1BV : 12 April 2016), David Spencer, Clarkson, Monroe, New York, United States; citing family 314, NARA microfilm publication M432 (Washington, D.C.: National Archives and Records Administration, n.d.).
Careful...there are a lot of David Spencer. Different one married to Roxey. He moved to Kalamazoo, Michigan.
This may be a different David
"United States Census, 1880," database with images, FamilySearch (https://familysearch.org/ark:/61903/1:1:MW39-3HM : 14 August 2017), David S Spencer, Summerfield, Monroe, Michigan, United States; citing enumeration district ED 187, sheet 580A, NARA microfilm publication T9 (Washington D.C.: National Archives and Records Administration, n.d.), roll 0596; FHL microfilm 1,254,596.
Here is his daughters marriage
"Michigan Marriages, 1868-1925," database with images, FamilySearch (https://familysearch.org/ark:/61903/1:1:NQ3Z-KZX : 4 December 2014), David Spencer in entry for Edward Oneil and Jennie Spencer Sannby, 13 May 1896; citing Charlevoix, Charlevoix, Michigan, v 1 p 372 rn 112, Department of Vital Records, Lansing; FHL microfilm 2,342,503.