The Eagles manager was banished to the stands for the 2-0 loss at Old Trafford as well as the home meeting with the Swans on the weekend which also ended 2-0 against the south Londoners.
Holloway's touchline ban is now over and he admits he needs to keep things in check in the future so he is not disconnected from his players for any more games this season.
"Thank God for that ban being over, it makes such a difference for me, you feel so detached and away from it," Holloway said.
"I know I am 50, but how bad was that (ban) for me? To sit there and feel so detached? You could argue I deserve it and my wife would say I do.
"The worst thing was reading back what the referee and the linesman wrote as I said it, and it is not very good.
"I will challenge anyone to be in my game as long as I have and to be my size - I am 5ft 7ins. You have to be competitive.
"I would say I was over-competitive and I get over-zealous, but you have to be calm. I have a lot to learn.
"You would like to think getting older you can mellow down a little, but I am in a competitive business where results are the only thing that counts at the end of the day."