Since several years Lyapunov Characteristic Exponents are of interest in the study of dynamical systems in order to characterize quantitatively their stochasticity properties, related essentially to the exponential divergence of nearby orbits. One has thus the problem of the explicit computation of such exponents, which has been solved only for the maximal of them. Here we give a method for computing all of them, based on the computation of the exponents of order greater than one, which are related to the increase of volumes. To this end a theorem is given relating the exponents of order one to those of greater order. The numerical method and some applications will be given in a forthcoming paper.