A new type of ordinary differential equation is introduced and discussed, namely, the time-dependent order ordinary differential equations. These equations can be solved via fractional calculus and are mapped into Volterra integral equations of second kind with singular integrable kernel. The solutions of the time-dependent order differential equations smoothly deforms solutions of the classical integer order ordinary differential equations into one-another, and can generate or remove singularities. An interesting symmetry of the solution in relation to the Riemann zeta function and Harmonic numbers was also proved.