Not necessarily!
Your Family Activity Feed can show many different groups of people. I believe it shows your Watchlist by default, which is the list of profiles you manage or are on the Trusted List for. You may not be related to all of them, for example, if you created profiles for people outside your family!
But along the top of that page there are other categories. You can see a summary of what they all do at Help:Activity Feeds.
