CloudFCN: Accurate and Robust Cloud Detection for Satellite Imagery with Deep Learning

• Main Authors: Alistair Francis, Panagiotis Sidiropoulos, Jan-Peter Muller
• Format: Article
• Language: English
• Published: MDPI AG 2019-10-01
• Series: Remote Sensing
• Subjects: clouds; deep learning; machine learning; computer vision; multispectral; optical
• Online Access: https://www.mdpi.com/2072-4292/11/19/2312

Cloud masking is of central importance to the Earth Observation community. This paper deals with the problem of detecting clouds in visible and multispectral imagery from high-resolution satellite cameras. Recently, Machine Learning has offered promising solutions to the problem of cloud masking, allowing for more flexibility than traditional thresholding techniques, which are restricted to instruments with the requisite spectral bands. However, few studies use multi-scale features (as in, a combination of pixel-level and spatial) whilst also offering compelling experimental evidence for real-world performance. Therefore, we introduce CloudFCN, based on a Fully Convolutional Network architecture, known as U-net, which has become a standard Deep Learning approach to image segmentation. It fuses the shallowest and deepest layers of the network, thus routing low-level visible content to its deepest layers. We offer an extensive range of experiments on this, including data from two high-resolution sensors—Carbonite-2 and Landsat 8—and several complementary tests. Owing to a variety of performance-enhancing design choices and training techniques, it exhibits state-of-the-art performance where comparable to other methods, high speed, and robustness to many different terrains and sensor types.