AutoCad 2D :: Viewport And Select Few Objects - Viewlocked

First I click in my viewport and select a few objects (lines/blocks etc) then whenever I type Pan or hold down my center mouse button to Pan. The Command line says the Viewport is viewlocked switching to paper space.

Now by switching to paper space everything I selected has now unselected. This basically leaves me the option to select what I see on the screen at one time and can't pan along and select anything else which is unbelievably frustrating on large drawings.