Update2:

Some interesting readings, still digesting it myself as I am new to some aspects and rusty on others...

http://www.realitypixels.com/turk/quicktimevr/fisheye.html

http://paulbourke.net/stereographics/stereopanoramic/ outlines vertical slice

And finally

http://paulbourke.net/stereographics/povcameras/ detailing L,R cameras implemented for POV