There was a James Harvey born 17 Sep 1820 at Dudley, Worcester, England. His father was Thomas Harvey and his mother was Hannah.
Did Elizabeth Harvey have a nickname like Betsey? Do you have her maiden name?
Joseph Harvey, son of James and Elizabeth Harvey, was christened 31 Mar 1850 at Smethwick, Stafford, England.
Charles Harvey was christened 18 May 1856 North Harborne, Stafford, England. Parents are James Harvey and Betsey Harvey.