As outside objects and in other rooms, as well as their shadows could be viewed through windows or opened doors, it might become very complicated to select the right objects.
Maybe you could try first to turn off lights that have very little influence. This should increase rendering speed.