I have talked to a lot of refs and they all say that there decisions on the park should not overall influence the result of the game .
Correct. If a player makes a decision to commit a red card offense, then it's the player who influences the outcome of the game, not the ref.