High Resolution Light Field Recovery with Fourier Disparity Layer Completion, Demosaicing, and Super-Resolution
Citation:
M. Le Pendu and A. Smolic, "High Resolution Light Field Recovery with Fourier Disparity Layer Completion, Demosaicing, and Super-Resolution," 2020 IEEE International Conference on Computational Photography (ICCP), St. Louis, MO, USA, 2020, pp. 1-12Download Item:
Abstract:
In this paper, we present a novel approach for recovering high resolution light fields from input data with many types of degradation and challenges typically found in lenslet based plenoptic cameras. Those include the low spatial resolution, but also the irregular spatio-angular sampling and color sampling, the depth-dependent blur, and even axial chromatic aberrations. Our approach, based on the recent Fourier Disparity Layer representation of the light field, allows the construction of high resolution layers directly from the low resolution input views. High resolution light field views are then simply reconstructed by shifting and summing the layers. We show that when the spatial sampling is regular, the layer construction can be decomposed into linear optimization problems formulated in the Fourier domain for small groups of frequency components. We additionally propose a new preconditioning approach ensuring spatial consistency, and a color regularization term to simultaneously perform color demosaicing. For the general case of light field completion from an irregular sampling, we define a simple iterative version of the algorithm. Both approaches are then combined for an efficient super-resolution of the irregularly sampled data of plenoptic cameras. Finally, the Fourier Disparity Layer model naturally extends to take into account a depth-dependent blur and axial chromatic aberrations without requiring an estimation of depth or disparity maps.
Sponsor
Grant Number
Science Foundation Ireland (SFI)
15/RP/2776
Author's Homepage:
http://people.tcd.ie/smolica
Author: Smolic, Aljosa
Sponsor:
Science Foundation Ireland (SFI)Type of material:
Conference PaperCollections
Availability:
Full text availableKeywords:
Light Fields, Fourier Disparity Layers, Super-Resolution, Demosaicing, Completion, Demultiplexing, Plenoptic CameraSubject (TCD):
Creative Technologies , Computer Education/Literacy , Data Analysis , Information technology in education , Multimedia & CreativityDOI:
10.1109/ICCP48838.2020.9105172Metadata
Show full item recordLicences: