The New York, U.S.,Town Clerks' Register of Men Who Served in the Civil War, ca. 1861-1865, has him:
Farden, James - born in 1841 - Corporal in Co. C, 106th Infantry - enlisted July 24, 1862, and mustered on August 24, 1862, as a Private - white - resident of Oswegatchie - single - discharged for disability on May 16, 1865
https://www.ancestry.com/imageviewer/collections/1964/images/31513_216242-00396?usePUB=true&_phsrc=qcN41675&_phstart=successSource&usePUBJs=true&pId=39888
Sounds like he must have been wounded.
He is listed in the 1860 Census of Oswegatchie, New York in the family of a Bridget Farden (age 50 and born in Ireland):
https://www.familysearch.org/ark:/61903/1:1:MC45-1XL
Bridget is also listed in the 1870 U.S. Census in Lisbon, New York in the household of her son Michael (still born in Ireland, but ca. 1820):
https://www.familysearch.org/ark:/61903/1:1:M8KJ-NS4