It has happened. People have arrived, gone home - on occasion they return here, but a majority who return home stay in their worlds.

But as long as you are here, time back in your world stays still - if you do return home, you'll start off right at the moment you left off.