The theory of conceptual spaces, a geometrical form of knowledge representation introduced by Gärdenfors, is examined in the context of the general creative systems framework introduced by Wiggins. The representation of musical rhythm and timbre on the conceptual level is then discussed, together with software allowing human users to explore such spaces. We report observations relevant for future work towards creative systems operating in conceptual spaces.