My ancestor, Christian Mueller, who was captured at Trenton, NJ was supposedly moved along with 1,000+ others to Carlisle, PA and held there until after the war. It is true that many, if not most, stayed in the US. Mine stayed in PA and went on to have about 10 children. If you look up Carlisle online, there is a picture of one building still standing from that era.