I think I understand the behavior change you want. But I think the center of the rotation around which the user turns in the aerial view mode should be elevated and not lowered, to achieve this goal.
I'm going to try it, but this may introduce a strange behavior for existing homes during the first moves, and I wonder how the height of this center should be updated if the home box height changes.