How large is your SH3D file?
Can you check in About dialog how much memory is used by the Sweet Home 3D before and after you render a video (the numbers cited after "64 bit")?