• English
  • Deutsch
  • Log In
    Password Login
    Research Outputs
    Fundings & Projects
    Researchers
    Institutes
    Statistics
Repository logo
Fraunhofer-Gesellschaft
  1. Home
  2. Fraunhofer-Gesellschaft
  3. Konferenzschrift
  4. Light-Field View Synthesis Using a Convolutional Block Attention Module
 
  • Details
  • Full
Options
2021
Conference Paper
Title

Light-Field View Synthesis Using a Convolutional Block Attention Module

Abstract
Consumer light-field (LF) cameras suffer from a low or limited resolution because of the angular-spatial tradeoff. To alleviate this drawback, we propose a novel learning-based approach utilizing attention mechanism to synthesize novel views of a light-field image using a sparse set of input views (i.e., 4 corner views) from a camera array. In the proposed method, we divide the process into three stages, stereo-feature extraction, disparity estimation, and final image refinement. We use three sequential convolutional neural networks for each stage. A residual convolutional block attention module (CBAM) is employed for final adaptive image refinement. Attention modules are helpful in learning and focusing more on the important features of the image and are thus sequentially applied in the channel and spatial dimensions. Experimental results show the robustness of the proposed method. Our proposed network outperforms the state-of-the-art learning-based light-field view synthesis methods on two challenging real-world datasets by 0.5 dB on average. Furthermore, we provide an ablation study to substantiate our findings.
Author(s)
Gul, Muhammad Shahzeb Khan  
Fraunhofer-Institut für Integrierte Schaltungen IIS  
Mukati, M. Umair
DTU Fotonik
Baetz, Michel
Fraunhofer-Institut für Integrierte Schaltungen IIS  
Forchhammer, Soren
DTU Fotonik
Keinert, Joachim  
Fraunhofer-Institut für Integrierte Schaltungen IIS  
Mainwork
IEEE International Conference on Image Processing, ICIP 2021  
Project(s)
RealVision  
Funder
European Commission EC  
Conference
International Conference on Image Processing (ICIP) 2021  
Open Access
DOI
10.1109/ICIP42928.2021.9506586
File(s)
N-640194.pdf (2.59 MB)
Rights
Under Copyright
Language
English
Fraunhofer-Institut für Integrierte Schaltungen IIS  
  • Cookie settings
  • Imprint
  • Privacy policy
  • Api
  • Contact
© 2024