The noncommutative differential geometry of the algebra Mn (C) of complex n×n matrices is investigated. The role of the algebra of differential forms is played by the graded differential algebra C(sl(n,C),Mn (C))=Mn (C)⊗Λsl(n,C)*,sl(n,C) acting by inner derivations on Mn (C). A canonical symplectic structure is exhibited for Mn (C) for which the Poisson bracket is, to within a factor i, the commutator. Also, a canonical Riemannian structure is described for Mn (C). Finally, the analog of the Maxwell potential is constructed and it is pointed out that there is a potential with a vanishing curvature that is not a pure gauge.