Liverpool have earned plaudits for their attractive style of play, with Sadio Mane, Roberto Firmino and Mohamed Salah adding pace on the counter-attack.
Yet, despite five wins from five this season and a much improved defence, Klopp wants more from his team in terms of physicality.
Speaking ahead of Liverpool's game with Southampton on Saturday, the German technician said:
"We really want to be the ugliest team to play against.
"That is the plan, and to do it with good football players. The best news I have had in the last two weeks is how we have changed or reinvented again our defensive skills.
"We didn't need them too much in the first few games - it was not that we didn't have to defend but they were different games.
"Against Tottenham and Paris I loved how we did it. We still played good football and that was a really big step in the season so far."