The 21-year-old Englishman was released by Palace last summer and joined the Glenn Hoddle Academy after failing to find a club.
"Last year, I had a bit of a nightmare year to be honest," he said.
"I was playing in the Conference and the Conference South and it wasn't what I was looking for.
"There were some days, some weeks when I thought 'what am I doing, I might as well call it a day'.
"I've always wanted to be a footballer. I wasn't so much thinking about what I was going to do afterwards, I was thinking more about just giving up."
However, in November he joined Hoddle's academy in Jerez, Spain, set up by the former England footballer in 2008 to help former Premier League and Football League players return to professional football after being released by their clubs.
"The academy offers a good opportunity for boys who have come out of the game to get back in and, as you can see, for me it's worked out," said Dayton.
"That will be a dream, to be honest, playing in front of 50,000-plus people really would be a great opportunity for me," he said.
"Playing at Ibrox is the next level. So far, my biggest crowd was 24,000 at the Riverside - we played Middlesbrough in the Carling Cup.
"I didn't know a lot of the SPL to be honest, but I know it's a tough, competitive league."