Maybe it would be possible to aktivate mobility for the Aerial-view in the 3D view modification dialog.

I would suggest to use a kombination like ctrl + keyboard arrows to move the Point you see around.

Cheers,
Brill