It would be difficult to identify the correct Charles Robbins without more information. Do you have the names of any of his sibings, spouse, children? Dates/location of marriage, death? Any of these might help as Charles Robbins would not be an uncommon name. Possibility below:
U S Census, 1880 Trinity, Randolph, NC
Citing this Record "United States Census, 1880," index and images, FamilySearch (https://familysearch.org/pal:/MM9.1.1/MCXJ-T9F
self Madison Robbins M 47 NC
wife Jane Robbins F 37 NC
dau Roxana Robbins F 14 NC
son Madison Robbins M 10 NC
son Charlis Robbins M 4 NC