Semantics of geographic categories are essential for spatialdata transfer and data exchange. Different geographic data sources often adopt different natural language terms to describe the same underlying geographic category, and organize these categories with differentcategorization schemes. As geographic entities and categories are tiedintrinsically to space, it is difficult to define a standardized set of geographic categories that are valid across different cultures and languages.In this work, instead of developing a universal ontology for geographiccategories, we propose an OSM tag-based semantic representation framework for geographic categories that breaks the semantics of geographiccategories into elementary components and describe each semantic component separately using OSM tags. Based on this representation framework, we built a knowledge graph that links thousands of categories fromcommonly-used geographic data sources (e.g., Wikimapia, Foursquare).This knowledge graph could serve as a foundational information infrastructure that interlinks different data schemas and facilitates the harmonization of heterogeneous crowd-sourced geographic data sources andimprove semantic interoperability.