Grant reckons Friend should have given his team two penalties in tonight's 1-1 draw.
The Israeli was dismissed at the interval after remonstrating with Friend on a night of drama at Fratton Park.
Grant pinpointed what he thought was a first-half foul in the box on Aruna Dindane, and an infringement on Frederic Piquionne after the break.
There was also a dispute over Ricardo Rocha's red card after Friend dismissed him for a professional foul on Darren Bent.
But he was lifted by the never-say-die attitude of his players as Dindane scored a leveller deep into stoppage time.
Grant said: 'I need to fight a lot of problems, but I can't fight all of the war.
'But the players are an example for us not to give up.
'They keep fighting and they keep playing good football.
'But I can't keep fighting the referee.
'There were two clear penalties and they were not given.
'It has cost us. Someone has to do something about it.'
» Never miss a Portsmouth FC story... Get them sent straight to your e-mail inbox.... click here to subscribe.