I can relate to that...
Because my downvotes have mostly come in batches, I've pretty well figured out which of my posts generate downvotes -- and I have a pretty good idea who some of the downvoters are. Most of my downvotes have occurred when I posted an opinion about a couple of topics that certain other WikiTreers have strong contrary opinions about.