I found a Joshua F Justice (1839-1900) in FAG. This is the inscription on his headstone:
CORP'L J. F. JUSTICE, CO. H, 2ND N.C. MT'D INF. 1839 1900
FAG # 164855150.
His spouse is Ellen Frances Justice (1848-1870).
Ancestry has an 1850 Census, but shows a Joshua Justice born in Virginia, not North Carolina, but the birth year would be correct - 1839.
The Census shows Edmund P as the father and Sally as the mother. One sibling, Raleigh.
Sorry, that is all I can find.