The 1841 census has him living in Falmer, Sussex, at age 8. The 1851 census has a John Brown of the correct age living with the Carter family in Falmer as an errand boy. No John appears in the Brown household in the 1851 census. The 1901 census has a John Brown of the correct age and having been born in Falmer living on his own means at 25 Albert Street in Clerkenwell, London, with a wife Elizabeth J born about 1840 in Bodmin, Corwall, son Harry born about 1863 in Islington, London.
No other John Browns living in the very small hamlet of Falmer born around that date could be found, so I am assuming it is the same person in all the sources.
This information was provided by Jane (Stoneham) Payne, a direct descendant of the father Edward, available through a paid Ancestry.UK account. These sources are used on the Ancentry account but are otherwise unavailable to display further here:
Have you taken a DNA test? If so, login to add it. If not, see our friends at Ancestry DNA.