Non-Planar Inside-Out Dense Light-Field Dataset and Reconstruction Pipeline

Light-field imaging provides full spatio-angular information of the real world by capturing the light rays in various directions. This allows image processing algorithms to result in immersive user experiences such as VR. To evaluate, and develop reconstruction algorithms, a precise and dense light-field dataset of the real world that can be used as ground truth is desirable. In this paper, a non-planar capture is done and a view rendering pipeline is implemented. The acquired dataset includes two scenes that are captured by an accurate industrial robot with an attached color camera such that the camera is looking outward. The arm moves on a cylindrical path for a field of view of 125 degrees with angular step size of 0.01 degrees. Both scenes and their corresponding geometric calibration parameters will be available with the publication of the paper. The images are pre-processed in different steps. The disparity between two adjacent views with resolution of 5168×3448 is less than 1.6 pixels; the parallax between the foreground and the background objects is less than 0.6 pixels. Furthermore, the pre-processed data is used for a view rendering experiment to demonstrate an exemplary use case. In addition, the rendered results are evaluated visually and objectively.