Exploiting GAN-Based SAR to Optical Image Transcoding for Improved Classification via Deep Learning

Konferenz: EUSAR 2018 - 12th European Conference on Synthetic Aperture Radar
04.06.2018 - 07.06.2018 in Aachen, Germany

Tagungsband: EUSAR 2018

Seiten: 6Sprache: EnglischTyp: PDF

Persönliche VDE-Mitglieder erhalten auf diesen Artikel 10% Rabatt

Ley, Andreas; Dhondt, Olivier; Valade, Sebastien; Haensch, Ronny; Hellwich, Olaf (Dep. Computer Vision & Remote Sensing, Technische Universität Berlin, Germany)

Learning the proxy task of transcoding SAR images into optical images forces an employed conditional generative adversarial network (GAN) to distinguish between different land surfaces. Such a network can then be used to build a classifier with significantly fewer free parameters that generalizes well even when trained on a very small amount of labeled data. We train such a GAN on aligned Sentinel-1 and Sentinel-2 image pairs. We then show that a pre-trained classifier using these features learned from transcoding outperforms classifiers that are trained from scratch when only a very limited amount of labeled pixels are available for training.