SAR TO OPTICAL IMAGE SYNTHESIS FOR CLOUD REMOVAL WITH GENERATIVE ADVERSARIAL NETWORKS

• Main Authors: J. D. Bermudez, P. N. Happ, D. A. B. Oliveira, R. Q. Feitosa
• Format: Article
• Language: English
• Published: Copernicus Publications 2018-09-01
• Series: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
• Online Access: https://www.isprs-ann-photogramm-remote-sens-spatial-inf-sci.net/IV-1/5/2018/isprs-annals-IV-1-5-2018.pdf

Optical imagery is often affected by the presence of clouds. Aiming to reduce their effects, different reconstruction techniques have been proposed in the last years. A common alternative is to extract data from active sensors, like Synthetic Aperture Radar (SAR), because they are almost independent on the atmospheric conditions and solar illumination. On the other hand, SAR images are more complex to interpret than optical images requiring particular handling. Recently, Conditional Generative Adversarial Networks (cGANs) have been widely used in different image generation tasks presenting state-of-the-art results. One application of cGANs is learning a nonlinear mapping function from two images of different domains. In this work, we combine the fact that SAR images are hardly affected by clouds with the ability of cGANS for image translation in order to map optical images from SAR ones so as to recover regions that are covered by clouds. Experimental results indicate that the proposed solution achieves better classification accuracy than SAR based classification.