hi anonymous, if you want to explore your ancestry I suggest that you order certificates for the births marriages and deaths from the General Registry Office using the references you can get by searching the BMD indexes (free searchable indexes are available online at http://www.freebmd.org.uk/cgi/search.pl).
Using the family information you provided I found them in the 1881 census (below) with George's brother and father living with them, which then allowed me to find George with both parents in the 1861 and 1871 censuses (see following comments for other censuses)
George and Annie in the 1881 census are shown living in croydon...
KEMP, George Head Married M 26 1855 Gardener Marham, Norfolk
KEMP, Annie Wife Married F 30 1851 Market Lavington, Wiltshire
KEMP, Annie L Daughter Single F 5 1876 Scholar Wallington, Surrey
KEMP, William G E Son Single M 3 1878 Carshalton, Surrey
KEMP, James Father Widower M 62 1819 Labourer Marham, Norfolk
KEMP, James Brother Single M 36 1845 Bricklayer (Out Of Employ) Marham, Norfolk
Piece: 826 Folio: 98 Page: 20 Registration District: Croydon
Civil Parish: Wallington Address: 4, Wrights Row, Wallington County: Surrey
George's birth = Q4 1854, RegDistrict: Downham, Vol: 4b, Page: 348, KEMP George
George's death = Q3 1950, RegDistrict: Surrey Mid.E., Vol: 5g, Page: 171, AaD: 95, KEMP George
More info discovered is in following comments...
KEMP, James Head Married M 42 1819 Agricultural Labourer Marham, Norfolk
KEMP, Martha Wife Married F 45 1816 Pentney, Norfolk
KEMP, William Son Unmarried M 18 1843 Bricklayers Labourer Masham, Norfolk
KEMP, James Son M 15 1846 Agricultural Labourer Marham, Norfolk
KEMP, Robert Son M 11 1850 Scholar Marham, Norfolk
KEMP, Benjamin Son M 9 1852 Scholar Marham, Norfolk
KEMP, George Son M 6 1855 Scholar Marham, Norfolk
Piece: 452 Folio: 17 Page: 22 Registration District: Croydon
Civil Parish: Beddington Address: Wallington Road, Beddington County: Surrey
George and his parents in 1871 census (who the granddaughter belongs to I'm not sure)...
KEMP, James Head M 52 1819 Norfolk
KEMP, Martha Wife F 55 1816 Norfolk
KEMP, James Son M 25 1846 Norfolk
KEMP, Robert Son M 21 1850 Norfolk
KEMP, Benjamin Son M 18 1853 Norfolk
KEMP, George Son M 16 1855 Norfolk
MORRIS, Elizabeth J Granddaughter F 6 1865 Middlesex
Piece: 796 Folio: 36 Page: 63 Registration District: Epsom
Civil Parish: Carshalton Address: Culvers, Carshalton County: Surrey