No. The referee waved them on. They can't just run on when they feel like. Either the referee waves them on, or the players wave them on. Therefore, no, it is not justified and he knows it. He'd be out running his mouth about it if he knew he didn't make a mistake and I wouldn't be surprised if Abramovich came out and did something about this.