Lampard made the comment at his post-match press conference after he was asked whether he had instructed his team to shoot from long range against De Gea who is struggling for form at the moment.
De Gea allowed Olivier Giroud's shot to trickle over the line in the dying seconds of the first half and moments after the interval Mason Mount's shot evaded his weak attempted save.
The Times described his performance as a "horror show".
Solskjaer conceded De Gea should have saved Mount's goal but stood by the player, who recently surpassed Peter Schmeichel's United appearance record for an overseas player, excluding Irish footballers.