They don't want to leave you alone because they want to know what you're up to when you're left alone. When they don't know who their enemy might be or where they may come from that scares the shit out of them. Imagine if a large group of freedom fighters targeting commies but were dressed up like Antifa? Gotta give them credit. Their tactics of remaining anonymous and quickly moving from one target to another really throws a wrench into their system.