Lampard has placed talk of the Chelsea job to the side but admitted he will speak with Derby owner Morris whatever the outcome of Monday's Championship play-off final.
Lampard, who is preparing his team to face Aston Villa at Wembley, said: "I find it difficult. They have a manager in (Maurizio) Sarri who is trying to get them to win that final.
"If I say it's because we're in the final and being talked about, we've have a good year, then I get linked because of 13 years at Chelsea, I understand it - but I don't want to think about it.
"We have a really difficult game. My focus is on us on Monday. I want to get this over the line for us.
"When I started out in management people said the dream must be to be Chelsea manager. It is an easy link. My dream is to do as well as I can day-in, day-out to try to be successful. I can't call that one. Those things happen or they don't."