Potter previously considered signing the winger while manager of Brighton and a clause in the loan deal could allow the Blues to bring him back to Stamford Bridge.
BILD says Potter's previous interest in signing Hudson-Odoi has led him to consider the possibility of ending the loan arrangement early.
Chelsea can force through a premature return to west London under the terms of the deal. Potter may have plans to hand the wide man an important first-team role with wingers and wing-backs both common in his various systems.
With Bayer, Hudson-Odoi has provided an assist in three league appearances and played twice in the Champions League.