Do you have any dates, approximate dates of his b, m, d?
Names of any parents, siblings, spouse of children? Any of these clues might help find your ancestor.
You can also try the free search tool at https://familysearch.org/ to try to get started.
I found census data from Williamsburg with Lafayette, Wesley, Sam etc but didn't see Charles - might be the wrong timeframe?
link below
https://familysearch.org/search/records/results#count=20&query=%2Bsurname%3Alovell~%20%2Bresidence_place%3A%22williamsburg%20SC%22~%20%2Bresidence_year%3A1800-1880~
