For the Euros qualifying win over Kazakhstan, Batshuayi opened the scoring for the 2-0 triumph.
But Martinez believes the striker could achieve more if he was playing regularly at club level.
He explained: "Michy's not playing at Chelsea enough. I find it annoying.
"He continues to score with us, but I hope he will have more playing time. If this is not the case, we will have to find a solution. We need him, but he has to play."