A Joel W Vaughn, b May 1858 in NC is found in the GA census data for 1900, 1910, 1920 married to Sally Barton. Don't know if that is your ancestor.
https://familysearch.org/search/records/index#count=20&query=%2Bgivenname%3A%22joel%20w%22~%20%2Bsurname%3Avaughn~%20%2Bbirth_place%3ANC~%20%2Bbirth_year%3A1857-1859~%20%2Bresidence_place%3AGA%20%2Bresidence_year%3A1880-1930~
United States Census, 1900," Jael W Vaughan, Militia Districts 1260, 1272, Fairplay, Crombie, Douglas, Georgia Image 12
https://familysearch.org/pal:/MM9.3.1/TH-266-11033-88944-41?cc=1325221
Self Jael W Vaughan M/42 May 1858 NC
Wife Salley Vaughan F/34 Mar 1866 /GA
Daughter Belle Vaughan F/16 Sept 1883 GA
Daughter Ada Vaughan F/14 Apr 1886 GA
Son James Vaughan M10 Apr 1890 GA
Daughter Lillie Vaughan F/ 6 Mar 1894 GA
Son William Vaughan M/ 3 Apr 1897 GA
Mother-in-law Sarah Bartun/F/61 Dec 1838 GA
https://familysearch.org/pal:/MM9.1.1/MLK6-7F1
SELF Joel W Vaughan M/51y
DAU Abby Vaughan F/23y
SON William Vaughan M/12y
DAU Nora Vaughan F/9y
DAU Ruby Vaughan F/6y
https://familysearch.org/pal:/MM9.1.1/MJD2-6FH
SELF J W Vaughan M/61y North Carolina
SON W D Vaughan M/21y Georgia
DAU Belle Vaughan F/35y Georgia
DAU Nora Vaughan F/18y Georgia
DAU Ruby Vaughan F/16y Georgia