Deep learning methods for high-resolution microscale light field image reconstruction: a survey

• Published in: Frontiers in Bioengineering and Biotechnology
• Main Authors: Bingzhi Lin, Yuan Tian, Yue Zhang, Zhijing Zhu, Depeng Wang
• Format: Article
• Language: English
• Published: Frontiers Media S.A. 2024-11-01
• Subjects: deep learning; light field microscopy; light field imaging; high resolution; volumetric reconstruction
• Online Access: https://www.frontiersin.org/articles/10.3389/fbioe.2024.1500270/full

Deep learning is progressively emerging as a vital tool for image reconstruction in light field microscopy. The present review provides a comprehensive examination of the latest advancements in light field image reconstruction techniques based on deep learning algorithms. First, the review briefly introduced the concept of light field and deep learning techniques. Following that, the application of deep learning in light field image reconstruction was discussed. Subsequently, we classified deep learning-based light field microscopy reconstruction algorithms into three types based on the contribution of deep learning, including fully deep learning-based method, deep learning enhanced raw light field image with numerical inversion volumetric reconstruction, and numerical inversion volumetric reconstruction with deep learning enhanced resolution, and comprehensively analyzed the features of each approach. Finally, we discussed several challenges, including deep neural approaches for increasing the accuracy of light field microscopy to predict temporal information, methods for obtaining light field training data, strategies for data enhancement using existing data, and the interpretability of deep neural networks.