Is it known?

I noticed a delay under Java 1.5 / Mac OS X with some server configuration, but never under Windows.
Maybe there is some HTTP 404 errors or some HTTP redirections that delays the download of some resources. Please check error_log on your server.