The side are currently rooted to the bottom of the table with just two points after losing 3-1 at the King Power stadium on Saturday.
However, Wagner is confident that his team will start picking up points in due course.
"In general, of course, points and wins helps to create confidence but there is not much between us and the other teams, the gap is not big," he said.
"I have no doubt that we will collect our points if we carry on playing as we are.
"I am confident that we can close the gap between us and the other teams in terms of performances because I know and I see the potential we have."
Former Norwich player James Maddison caught the eye for leicester, scoring a fine free-kick.
Manager Claude Puel said of the 21-year-old star: "We didn't know what he would be able to give as he has to learn the Premier League as he played in the Championship last season but he has improved with us and been given game time and he has a good attitude and good mentality and good quality and I hope he continues this way."