You must use SweetHome3D 7.2 or later, and Pan 3D view plugin 4.1.
From menu File>Preferences check the option "Select and edit in 3D view", then from menu View 3D>Pan 3D view settings select the drag mode that you like (I guess you want "smart").