IMO there are two issues that directly impact the way the fans/clubs/officials see the refs.
We all want the right calls to be made and made consistently, this sint happening in any sport and adding VAR or a bunker hasnt made it better, in fact it has highlighted the major issues with the rules of most games. They are never clear and most of them rely on some kind of opinion or discretion.
Then you have the fact that punshment for players charging refs during a game has always been non-existent, even when there is a directive against it, fans, officials see their starts get away with it so it escalates.
Solution- get the rules right, so they are clear and easy to understand and officiate, make it easier forthe refs to get it right - reducing angst and anger towards them. Then if/when someone abuses, threatens a referee punish them HARD!