Puel's position has felt under constant scrutiny amid the sense his tenure could come to an end at any moment.
He said: "All the time there is speculation about difficulty around this club. I can speak a lot about this.
"To finish seventh during the first half of the season with all the problems we've had, it's a very good performance.
"If people think our place is sixth, or higher, this is not the truth, it's not possible.
"If seventh or eighth is bad then this is crazy."
Puel believes Leicester's Premier League title win of 2015/16 increased expectations beyond their limits.
He said: "The speculation continues. I think it's a shame because for the club to improve we need stability. One time it was exceptional and Leicester win the title. If people think that's normality then it's not the truth.
"There's a difference in the possibilities for Leicester in what people dream of and what they are expecting.
"Other teams have more money, more possibilities but no speculation and they can work with calm and no problems."