I guess you must be under macOS, because closing the default window will quit the program under other operating systems.
Anyway, you just took the wrong habit: opening the home you want will close automatically the default home window if you didn't edit anything in it yet. And this works under all operating systems since day 1.