The Veli Pasha Complex, built by Ali Tepedelenli Pasha's son, Veli Pasha, was originally consisted of a mosque, a kitchen, and a medrese (Islamic school). According to one view, it was erected on the site of an earlier structure, the Mosque of Bali Kethuda. While the mosque underwent restoration in the late 1970s, it remains closed to the public. However, consolidation work was undertaken on the medrese in 1983. From that point on, the building had various uses, mainly by the municipality of the city.