The 23-year-old Lithuanian made 28 appearances for the Clydesdale Bank Scottish Premier League club, scoring just two goals.
Hearts sport director Anatoly Korobochka told Hearts News Today: "There was just too much competition in Kestutis' position. We would like to wish him all the best for his future career."