Documents contain textual information, which is of the utmost importance for all the organizations. Document management systems have been used to store vast amounts of unstructured textual data described with minimal metadata, a method that has several limitations. In order to convert hidden knowledge into machine-readable data with rich connections, this paper presents work in progress on the development of the first end-to-end guided approach to construct a Knowledge Graph from Greek government documents from the Greek open government portal. The resulted Knowledge graph consists a proof-of-concept graph, that illustrates the beneficial semantic relationships between the textual data.