I found a couple of Census records on familysearch.org. Your great-grandparents might have been:
Great grandmother: Curley or Carlie born c. 1854 in Georgia and Abe or Abram Evans born c. 1847 in Georgia.
Grandmother: Mattie Roberta Griggs born c. 1886 and James "Jim" Evans born c. 1886
Great grandparents household in 1880 at Carrol GA https://familysearch.org/ark:/61903/1:1:M8L6-N2P
This looks like great grandparent's household in 1910 in Carrol, GA https://familysearch.org/ark:/61903/1:1:MLVY-F4H includes their children: Anna Evans, Felix Evans, Rosa Evans, Janie Evans and also grandchildren: Ruby and Ralph.
This may be your grandfather in 1900 Census https://familysearch.org/ark:/61903/1:1:M3J2-PTC He is living at Unionville, Proctors, Monroe, Georgia, born June 1885, age 15, a farm laborer who could not read or write (see original photo). Not sure whether this is your grandfather or not. His brother's names are: Arch, Dan, and Lum.
Grandparent's household in 1910: Jim age 24 and Roberta age 24. Children are: Henry G Evans, Tommie L Evans https://familysearch.org/ark:/61903/1:1:ML2F-9R9
This looks like two of your grandparents' children's death certificates, James Bush and Claude Smith.
James Bush Evans born 1911 in Jasper, GA https://familysearch.org/ark:/61903/1:1:FGCS-P4N
Claude Smith Evans https://familysearch.org/ark:/61903/1:1:FP72-RYH
The 1920 Census, seems your grandfather was widowed, and lists the family members. https://familysearch.org/ark:/61903/1:1:MJ86-WBF Children are: Ferman Evans, Oma Evans, Rosa P Evans, Rush Evans, Opha P Evans, Ila Mae Evans, Gladdis Evans
Looking at the 1930 Census, your grandfather (James L. Evans) is living with his mother, "Curley" Evans. Also in the household is Janie Evans, Jim's sister. The children: Leomah Evans, John L Evans, Opal L Evans, Illa M Evans, Gladys Evans, Cilla Evans, Clifford Evans. https://familysearch.org/ark:/61903/1:1:3SD9-K3Z
Hope this helps. You would know better than I whether these Census records apply to your family or not. No connection to Virginia yet, but ... the search continues!