Hi Caroline! Welcome to WikiTree!
What do you mean born 1851 in New York, but Immigrated from Germany? Did his parents take him to Germany after his birth and then he returned to the U.S.? Do you have any additional information about him such as where in New York, his wife's name, his parents' names? Anything will help narrow the search. As you already know, Smiths are tough to research.