When importing a new model, mark it as Doors/Windows and you can insert in a wall.

In the attached files, you can find several transparent boxes. Combine your preferred colour with normal boxes (or low walls) to construct your own windows. Export, import and mark as Door/Window.

H