Well, we're all moving through space-time...towards the future and at the same pace. Future becomes present, present becomes past. We're all doing this even while we're asleep and motionless, because we're riding on the same spacecraft called "Earth"...which is rotating around its axis at a speed of about 1,000 miles per hour! On top of that, Earth is also moving around the Sun at about 67,000 miles per hour! It doesn't make sense, right? Do you feel the earth moving at those ridiculous speeds? Welcome to the world of science! Nothing in here is common sense.
Anyway, back to your question on relative ageing and if it's considered time traveling. Answer: Yes. Even a glimpse of a star that's thousands of lightyears away, through a telescope, would be considered looking into the past...i.e., what you're seeing are images that's traveled several years to reach your eyes; that star you're looking at may have already burnt out its hydrogen and turned into a white dwarf, but what you're seeing is a red giant.
All this goes without saying: I could be wrong.