hi anonymous, if you want to explore your ancestry I suggest that you order certificates for the births marriages and deaths from the General Registry Office using the references you can get by searching the BMD indexes (free searchable indexes are available online at http://www.freebmd.org.uk/cgi/search.pl).
Using the family information you provided I found them in the 1881 census (below) with George's brother and father living with them, which then allowed me to find George with both parents in the 1861 and 1871 censuses (see following comments for other censuses)
George and Annie in the 1881 census are shown living in croydon...
KEMP, George Head Married M 26 1855 Gardener Marham, Norfolk
KEMP, Annie Wife Married F 30 1851 Market Lavington, Wiltshire
KEMP, Annie L Daughter Single F 5 1876 Scholar Wallington, Surrey
KEMP, William G E Son Single M 3 1878 Carshalton, Surrey
KEMP, James Father Widower M 62 1819 Labourer Marham, Norfolk
KEMP, James Brother Single M 36 1845 Bricklayer (Out Of Employ) Marham, Norfolk
Piece: 826 Folio: 98 Page: 20 Registration District: Croydon
Civil Parish: Wallington Address: 4, Wrights Row, Wallington County: Surrey
George's birth = Q4 1854, RegDistrict: Downham, Vol: 4b, Page: 348, KEMP George
George's death = Q3 1950, RegDistrict: Surrey Mid.E., Vol: 5g, Page: 171, AaD: 95, KEMP George
More info discovered is in following comments...