ABSTRACT A determination of the dynamical evolution of the asteroid belt is difficult because the asteroid belt has evolved since the time of asteroid formation through mechanisms that include: (1) catastrophic collisions, (2) rotational disruption, (3) chaotic orbital evolution, and (4) orbital evolution driven by Yarkovsky radiation forces. The time-scales of these loss mechanisms are uncertain and there is a need for more observational constraints. In the inner main belt (IMB), the mean size of the non-family asteroids increases with increasing inclination. Here, we use that observation to show that all IMB asteroids originate from either the known families or from ghost families, that is, old families with dispersed orbital elements. We estimate that the average age of the asteroids in the ghost families is a factor of 1/3 less than the Yarkovsky orbital evolution time-scale. However, this orbital evolution time-scale is a long-term average that must allow for the collisional evolution of the asteroids and for stochastic changes in their spin directions. By applying these constraints on the orbital evolution time-scales to the evolution of the size-frequency distribution of the Vesta asteroid family, we estimate that the age of this family is greater than 1.3 Gyr and could be comparable with the age of the Solar system. By estimating the number of ghost families, we calculate that the number of asteroids that are the root sources of the meteorites and the near-Earth asteroids that originate from the IMB is about 20.