I think that behind the debate of centering the scene or not, (which has a partial solution by adding objects on the edge), there is a bigger drawback that is the zoom limit.
As you build an environment around your house, it becomes impossible to zoom in and turn around your kitchen for exemple.
That is actually the biggest issue in my opinion.

... don't hope any change to the Aerial view mode in the coming versions