Five wins from their last seven games have turned Latics from relegation probables into near-certain survivors heading into the final two games of the campaign.
"It's obviously frustrating to still be near the bottom of the table when we know we can play as well as we did against Newcastle," Caldwell told the Wigan Evening Post.
"It was the same last season and we managed to get out of it in the nick of time.
"For whatever reason we didn't get off to a particularly good start, and then we had that eight-game sequence before Christmas when nothing went right for us.
"Fair play to everyone at the club, though.
"We have all dug in and produced some absolutely big results against some top teams."