Wouldn't it slowdown your trashcan to a crawl?

Not really, but there's always the possibility to make levels unviewable if they become hard to handle. Besides, since version 5.5, big terrains are only partly visible in the preview window anyway.