Am I getting it right: the automatic update detection will include beta releases as well?

Yes, but it depends on the deployment solution you use. In many cases, Java Web Start updates automatically the jar files required for the program when they are more recent. In that case, you won't see the updates information since the program will be already updated to latest version once launched!