A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification

As a crucial task in surveillance and security, person re-identification (re-ID) aims to identify the targeted pedestrians across multiple images captured by non-overlapping cameras. However, existing person re-ID solutions have two main challenges: the lack of pedestrian identification labels in th...

Full description

Bibliographic Details
Main Authors: Yuanyuan Li, Sixin Chen, Guanqiu Qi, Zhiqin Zhu, Matthew Haner, Ruihua Cai
Format: Article
Language:English
Published: MDPI AG 2021-03-01
Series:Journal of Imaging
Subjects:
Online Access:https://www.mdpi.com/2313-433X/7/4/62
id doaj-ba716d373f634fb7991e456f24268a54
record_format Article
spelling doaj-ba716d373f634fb7991e456f24268a542021-03-26T00:07:31ZengMDPI AGJournal of Imaging2313-433X2021-03-017626210.3390/jimaging7040062A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-IdentificationYuanyuan Li0Sixin Chen1Guanqiu Qi2Zhiqin Zhu3Matthew Haner4Ruihua Cai5College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaCollege of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaComputer Information Systems Department, State University of New York at Buffalo State, Buffalo, NY 14222, USACollege of Automation, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaDepartment of Mathematics & Computer and Information Science, Mansfield University of Pennsylvania, Mansfield, PA 16933, USAComputer Engineering Department, San Jose State University, San Jose, CA 95192, USAAs a crucial task in surveillance and security, person re-identification (re-ID) aims to identify the targeted pedestrians across multiple images captured by non-overlapping cameras. However, existing person re-ID solutions have two main challenges: the lack of pedestrian identification labels in the captured images, and domain shift issue between different domains. A generative adversarial networks (GAN)-based self-training framework with progressive augmentation (SPA) is proposed to obtain the robust features of the unlabeled data from the target domain, according to the preknowledge of the labeled data from the source domain. Specifically, the proposed framework consists of two stages: the style transfer stage (STrans), and self-training stage (STrain). First, the targeted data is complemented by a camera style transfer algorithm in the STrans stage, in which CycleGAN and Siamese Network are integrated to preserve the unsupervised self-similarity (the similarity of the same image between before and after transformation) and domain dissimilarity (the dissimilarity between a transferred source image and the targeted image).  Second, clustering and classification are alternately applied to enhance the model performance progressively in the STrain stage, in which both global and local features of the target-domain images are obtained. Compared with the state-of-the-art methods, the proposed method achieves the competitive accuracy on two existing datasets.https://www.mdpi.com/2313-433X/7/4/62person re-IDdomain shiftstyle transferself-training
collection DOAJ
language English
format Article
sources DOAJ
author Yuanyuan Li
Sixin Chen
Guanqiu Qi
Zhiqin Zhu
Matthew Haner
Ruihua Cai
spellingShingle Yuanyuan Li
Sixin Chen
Guanqiu Qi
Zhiqin Zhu
Matthew Haner
Ruihua Cai
A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
Journal of Imaging
person re-ID
domain shift
style transfer
self-training
author_facet Yuanyuan Li
Sixin Chen
Guanqiu Qi
Zhiqin Zhu
Matthew Haner
Ruihua Cai
author_sort Yuanyuan Li
title A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
title_short A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
title_full A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
title_fullStr A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
title_full_unstemmed A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
title_sort gan-based self-training framework for unsupervised domain adaptive person re-identification
publisher MDPI AG
series Journal of Imaging
issn 2313-433X
publishDate 2021-03-01
description As a crucial task in surveillance and security, person re-identification (re-ID) aims to identify the targeted pedestrians across multiple images captured by non-overlapping cameras. However, existing person re-ID solutions have two main challenges: the lack of pedestrian identification labels in the captured images, and domain shift issue between different domains. A generative adversarial networks (GAN)-based self-training framework with progressive augmentation (SPA) is proposed to obtain the robust features of the unlabeled data from the target domain, according to the preknowledge of the labeled data from the source domain. Specifically, the proposed framework consists of two stages: the style transfer stage (STrans), and self-training stage (STrain). First, the targeted data is complemented by a camera style transfer algorithm in the STrans stage, in which CycleGAN and Siamese Network are integrated to preserve the unsupervised self-similarity (the similarity of the same image between before and after transformation) and domain dissimilarity (the dissimilarity between a transferred source image and the targeted image).  Second, clustering and classification are alternately applied to enhance the model performance progressively in the STrain stage, in which both global and local features of the target-domain images are obtained. Compared with the state-of-the-art methods, the proposed method achieves the competitive accuracy on two existing datasets.
topic person re-ID
domain shift
style transfer
self-training
url https://www.mdpi.com/2313-433X/7/4/62
work_keys_str_mv AT yuanyuanli aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT sixinchen aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT guanqiuqi aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT zhiqinzhu aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT matthewhaner aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT ruihuacai aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT yuanyuanli ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT sixinchen ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT guanqiuqi ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT zhiqinzhu ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT matthewhaner ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT ruihuacai ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
_version_ 1724203028400046080