In my experience, it is better to use the Aerial 3D view than the visitor, specially if "Aerial View centered on selection" is enabled. Look for it in options, after pressing Ctrl+M. It offers to you faster and wider points of view than the visitor, always you have selected an object to use as an 'axis'.

If you entirely need to use the visitor, I'd recommend to group all the doors in a folder and make it visible/ invisible in the Objects Panel when you need it.

Hope to have been helpful.

Nice day.