No, the connection doesn't have to be to you. The connection needs to be to someone (anybody, not just you) who is already connected to the tree.
If your Fairweathers are an isolated family, they will stay Unconnected-to-the-main-tree until they connect to a person who is. Just because they lived in the same area is not enough.