It's a speed saver. If everything was active, instead of just nearby stuff, everything would slow down because there'd be so much collision detection and animation and the like for basically everything. Besides, it allows for things like if you mess up a puzzle, you can run away, come back, and try again.