I cannot figure out where the performance loss of java3d 1.6 is coming from and so I had to switch back to java3d 1.5.2.
... very disappointing, but hey, that's life...