It's not more activity and less food which keeps many people fitting into a size small, they're actually just "running hotter" in terms of their metabolism.
Researchers say that some people wind up gaining more weight despite having a workout routine because they eat less healthy foods, thinking the exercise offsets the poor diet.