I honestly don't worry about it. Roads are a shared space and priority is given, rather than taken. If a group of cyclists are out doing a time trial or whatever, it's obviously important to them. Same with a tractor on harvest duty, the annual march to the cenotaph, etc. Just treat it all like a fallen tree or icy roads and leave an extra 5 minutes for unforseen circumstances.
We tend to see things only from our own point of view. Like the young guy who woke the whole street up one morning abusing the bin men who had the temerity to get in his way. Instead of having a tantrum, he could have gone the other way. I guess he'd be the first to complain if his bin didn't get emptied though.