Check out this extremely interesting project at Stanford called Dual Photography. Basically they simulate a view from an angle where they have no camera but only a light source. It's more complex than that of course. The pictures are impressive but the video... I mean it was pretty neat up until the end... at which point my mouth was just wide open.
...
(Actually I think I swore a bit - it really surprised me)