Henry was born in Mansfield, Connecticut. His middle name, Ebenezer Hunt, is the name of his maternal grandfather.
He also appears to have married Elizabeth's sister Mary Jeffers Kingsbury. A biography of Elizabeth's father Harvey Kingsbury (see his page for more) says "Two daughters were born to them, Elizabeth Wright and Mary Jeffers, both of whom married the late Hon. Henry E. H. Gilbert."
In 1870, Henry and Mary were living in Coventry. Henry is listed as a farmer with a $10,000 "value in personal estate." 
The Hon. Henry E. H. Gilbert is buried in the Center Cemetery in Coventry.
Have you taken a DNA test? If so, login to add it. If not, see our friends at Ancestry DNA.
Henry is 25 degrees from Peter Falk, 21 degrees from John Ryan, 22 degrees from Aristotelis Savalas, 16 degrees from Raymond Burr, 25 degrees from John Thaw, 22 degrees from Margaret Rutherford, 27 degrees from Jean Poiret, 20 degrees from Basil Rathbone, 33 degrees from Piet Römer and 19 degrees from Terri Swift on our single family tree. Login to find your connection.