I think a good way for it to be implemented would be for the 4th official to be monitoring it and have the ability to overrule the referee or to interfere with play for serious decisions. Also the referee can only consult the var once play has stopped such as a goal with the 4th official being able to stop play.
This I think will keep the game flowing and will stop managers deliberately stopping play to affect the game.