The Swans dominated proceedings at the Molineux to skip away to a two-goal lead by the 35th minute and had further chances to kill the game off but eventually crumbled to concede two late goals by Wolves to be held to a 2-2 draw.
Allen, who scored his sides second goal, feels it is important to bounce back positively and hope that the dropped two points does not cost the team later in the season.
"We have to make sure that our feeling of dropping two points doesn't cost us in the long term," he told the South Wales Evening Post.
"We are confident that it won't.
"To come away from home in our debut Premier League season and be disappointed that we haven't picked up three points shows how well we have played and also what we're hoping to achieve this season."