If you selected a color for the sky in the 3D view pane or if the current mode is Aerial view, a sky image computed according to the hour of the day is used for the rendering of the sky. If you chose a texture for the sky, that texture will always be used in Virtual visit mode whatever the selected hour.