The former Olympique Marseille captain is due to make his home debut today against West Ham and said: "Newcastle is a very big team. I played here against Newcastle with Marseille, and it was very good.
"I have very good memories of that game - I played against Alan Shearer, who is a very big name here at Newcastle, and it was a good night for Marseille.
"But now it is important for me to do well for Newcastle. I am very pleased to be here with my family.
"I remember the feeling of playing here against Newcastle, but it will be better playing for Newcastle with all those fans on my side."
Much has changed at Newcastle since that night - manager Sir Bobby Robson and much of the side which took the field for the Magpies have long gone - but Beye is confident the club can return to those heady days.
He said: "Teams change over the years and we have some very good players here.
"The club showed confidence in me by bringing me here, and I want to prove to the club and the manager that they were right to bring me here.
"I was at a great club in Marseille, but the opportunity to go abroad and play in the Premier League was something I really wanted to do.
"At Marseille, I had an important role and I was captain - I want to play an important role here at Newcastle too."