The older Ann Jordan is probably John's mother.
I found Julia on the 1850, 1860, and 1870 census sheets; ages given as 33, 48, and 52, respectively. Age discrepancies of +/- 5 years are common in census records, so I figure all three of those are the same person. She probably was John's sister -- a woman who for some reason was unable to marry or live on her own.
Julia A. Jordan, born in Cape Elizabeth, died unmarried in Cape Elizabeth on 4 January 1908, age 91 years, 6 months, and 0? (single digit number; looks like () -- i.e., two parentheses attached to each other) days (death certificate, from Ancestry, and Find-A-Grave page with gravestone image). Her mother's maiden name was Ann McKenney, which supports the idea that the older Ann Jordan was the mother of John and Julia.