"When I went out onto the pitch before kick-off it was amazing," he told nufc.co.uk. "The reception the fans gave me was incredible and it made me feel so welcome.
"I said to my dad and agent when I came off the pitch that I couldn't believe how much they applauded me.
"Hopefully that is a sign of things to come and I can have a good relationship with the Newcastle fans."
And Beye is looking forward to having those fans on his side after recalling the memory of when he played at St James' Park in the UEFA Cup semi-final in 2004.
"I remember how much pressure the fans put on us on that night," he added.
"It was a great atmosphere and I can't wait to play for Newcastle at St.James' Park, that will be a special moment."