A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
As a crucial task in surveillance and security, person re-identification (re-ID) aims to identify the targeted pedestrians across multiple images captured by non-overlapping cameras. However, existing person re-ID solutions have two main challenges: the lack of pedestrian identification labels in th...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-03-01
|
Series: | Journal of Imaging |
Subjects: | |
Online Access: | https://www.mdpi.com/2313-433X/7/4/62 |
id |
doaj-ba716d373f634fb7991e456f24268a54 |
---|---|
record_format |
Article |
spelling |
doaj-ba716d373f634fb7991e456f24268a542021-03-26T00:07:31ZengMDPI AGJournal of Imaging2313-433X2021-03-017626210.3390/jimaging7040062A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-IdentificationYuanyuan Li0Sixin Chen1Guanqiu Qi2Zhiqin Zhu3Matthew Haner4Ruihua Cai5College of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaCollege of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaComputer Information Systems Department, State University of New York at Buffalo State, Buffalo, NY 14222, USACollege of Automation, Chongqing University of Posts and Telecommunications, Chongqing 400065, ChinaDepartment of Mathematics & Computer and Information Science, Mansfield University of Pennsylvania, Mansfield, PA 16933, USAComputer Engineering Department, San Jose State University, San Jose, CA 95192, USAAs a crucial task in surveillance and security, person re-identification (re-ID) aims to identify the targeted pedestrians across multiple images captured by non-overlapping cameras. However, existing person re-ID solutions have two main challenges: the lack of pedestrian identification labels in the captured images, and domain shift issue between different domains. A generative adversarial networks (GAN)-based self-training framework with progressive augmentation (SPA) is proposed to obtain the robust features of the unlabeled data from the target domain, according to the preknowledge of the labeled data from the source domain. Specifically, the proposed framework consists of two stages: the style transfer stage (STrans), and self-training stage (STrain). First, the targeted data is complemented by a camera style transfer algorithm in the STrans stage, in which CycleGAN and Siamese Network are integrated to preserve the unsupervised self-similarity (the similarity of the same image between before and after transformation) and domain dissimilarity (the dissimilarity between a transferred source image and the targeted image). Second, clustering and classification are alternately applied to enhance the model performance progressively in the STrain stage, in which both global and local features of the target-domain images are obtained. Compared with the state-of-the-art methods, the proposed method achieves the competitive accuracy on two existing datasets.https://www.mdpi.com/2313-433X/7/4/62person re-IDdomain shiftstyle transferself-training |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Yuanyuan Li Sixin Chen Guanqiu Qi Zhiqin Zhu Matthew Haner Ruihua Cai |
spellingShingle |
Yuanyuan Li Sixin Chen Guanqiu Qi Zhiqin Zhu Matthew Haner Ruihua Cai A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification Journal of Imaging person re-ID domain shift style transfer self-training |
author_facet |
Yuanyuan Li Sixin Chen Guanqiu Qi Zhiqin Zhu Matthew Haner Ruihua Cai |
author_sort |
Yuanyuan Li |
title |
A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification |
title_short |
A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification |
title_full |
A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification |
title_fullStr |
A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification |
title_full_unstemmed |
A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification |
title_sort |
gan-based self-training framework for unsupervised domain adaptive person re-identification |
publisher |
MDPI AG |
series |
Journal of Imaging |
issn |
2313-433X |
publishDate |
2021-03-01 |
description |
As a crucial task in surveillance and security, person re-identification (re-ID) aims to identify the targeted pedestrians across multiple images captured by non-overlapping cameras. However, existing person re-ID solutions have two main challenges: the lack of pedestrian identification labels in the captured images, and domain shift issue between different domains. A generative adversarial networks (GAN)-based self-training framework with progressive augmentation (SPA) is proposed to obtain the robust features of the unlabeled data from the target domain, according to the preknowledge of the labeled data from the source domain. Specifically, the proposed framework consists of two stages: the style transfer stage (STrans), and self-training stage (STrain). First, the targeted data is complemented by a camera style transfer algorithm in the STrans stage, in which CycleGAN and Siamese Network are integrated to preserve the unsupervised self-similarity (the similarity of the same image between before and after transformation) and domain dissimilarity (the dissimilarity between a transferred source image and the targeted image). Second, clustering and classification are alternately applied to enhance the model performance progressively in the STrain stage, in which both global and local features of the target-domain images are obtained. Compared with the state-of-the-art methods, the proposed method achieves the competitive accuracy on two existing datasets. |
topic |
person re-ID domain shift style transfer self-training |
url |
https://www.mdpi.com/2313-433X/7/4/62 |
work_keys_str_mv |
AT yuanyuanli aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification AT sixinchen aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification AT guanqiuqi aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification AT zhiqinzhu aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification AT matthewhaner aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification AT ruihuacai aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification AT yuanyuanli ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification AT sixinchen ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification AT guanqiuqi ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification AT zhiqinzhu ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification AT matthewhaner ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification AT ruihuacai ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification |
_version_ |
1724203028400046080 |