Absolutely. Time is merely an artificial measurement of how long it takes to get from point A to point B. And that requires 'distance' and to have 'distance', space is required.

And you're right that physical objects move in space so you could never arrive in the same 'place' if you travel back in time.