Trajectory Smoothing Constraint and Hard Negative Mining for Distractor-Aware Regression Tracking

Recently, convolutional regression networks have drawn great attention in the tracking community. Convolutional regression trackers formulate the regression network as one convolutional layer and take advantages of end-to-end learning. However, existing convolutional regression trackers regress the...

Full description

Bibliographic Details
Main Authors: Weichun Liu, Xiaoan Tang, Xiaoyuan Ren
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8732986/
id doaj-4dabc4c1bec241bcb0645b8905663336
record_format Article
spelling doaj-4dabc4c1bec241bcb0645b89056633362021-03-29T23:22:57ZengIEEEIEEE Access2169-35362019-01-017846588466710.1109/ACCESS.2019.29215628732986Trajectory Smoothing Constraint and Hard Negative Mining for Distractor-Aware Regression TrackingWeichun Liu0https://orcid.org/0000-0001-6264-1020Xiaoan Tang1Xiaoyuan Ren2https://orcid.org/0000-0002-1012-8863College of Electronic Science, National University of Defense Technology, Changsha, ChinaCollege of Electronic Science, National University of Defense Technology, Changsha, ChinaCollege of Electronic Science, National University of Defense Technology, Changsha, ChinaRecently, convolutional regression networks have drawn great attention in the tracking community. Convolutional regression trackers formulate the regression network as one convolutional layer and take advantages of end-to-end learning. However, existing convolutional regression trackers regress the input feature to Gaussian-like soft labels, which still assign a large label to semantic backgrounds in online model fine-tuning. As a result, in the presence of background distractors, convolutional regression trackers tend to drift toward regions, which exhibit a similar appearance compared to the object of interest. In this paper, we propose to achieve distractor-aware regression tracking with trajectory smoothing constraint and hard negative mining. The trajectory smoothing constraint measures motion distance and motion direction between the adjacent frames to discard distractors that fail to meet trajectory smoothness. On this basis, distractors are fed into convolutional regression networks as hard negative samples, which boosts the discriminability of convolutional regression trackers against background distractors. The experimental results on the OTB100 and VOT2016 benchmarks show that the proposed algorithm performs favorably in terms of both accuracy and robustness when compared with state-of-the-art trackers.https://ieeexplore.ieee.org/document/8732986/Trajectory smoothing constrainthard negative miningdistractor-awareconvolutional regression trackers
collection DOAJ
language English
format Article
sources DOAJ
author Weichun Liu
Xiaoan Tang
Xiaoyuan Ren
spellingShingle Weichun Liu
Xiaoan Tang
Xiaoyuan Ren
Trajectory Smoothing Constraint and Hard Negative Mining for Distractor-Aware Regression Tracking
IEEE Access
Trajectory smoothing constraint
hard negative mining
distractor-aware
convolutional regression trackers
author_facet Weichun Liu
Xiaoan Tang
Xiaoyuan Ren
author_sort Weichun Liu
title Trajectory Smoothing Constraint and Hard Negative Mining for Distractor-Aware Regression Tracking
title_short Trajectory Smoothing Constraint and Hard Negative Mining for Distractor-Aware Regression Tracking
title_full Trajectory Smoothing Constraint and Hard Negative Mining for Distractor-Aware Regression Tracking
title_fullStr Trajectory Smoothing Constraint and Hard Negative Mining for Distractor-Aware Regression Tracking
title_full_unstemmed Trajectory Smoothing Constraint and Hard Negative Mining for Distractor-Aware Regression Tracking
title_sort trajectory smoothing constraint and hard negative mining for distractor-aware regression tracking
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2019-01-01
description Recently, convolutional regression networks have drawn great attention in the tracking community. Convolutional regression trackers formulate the regression network as one convolutional layer and take advantages of end-to-end learning. However, existing convolutional regression trackers regress the input feature to Gaussian-like soft labels, which still assign a large label to semantic backgrounds in online model fine-tuning. As a result, in the presence of background distractors, convolutional regression trackers tend to drift toward regions, which exhibit a similar appearance compared to the object of interest. In this paper, we propose to achieve distractor-aware regression tracking with trajectory smoothing constraint and hard negative mining. The trajectory smoothing constraint measures motion distance and motion direction between the adjacent frames to discard distractors that fail to meet trajectory smoothness. On this basis, distractors are fed into convolutional regression networks as hard negative samples, which boosts the discriminability of convolutional regression trackers against background distractors. The experimental results on the OTB100 and VOT2016 benchmarks show that the proposed algorithm performs favorably in terms of both accuracy and robustness when compared with state-of-the-art trackers.
topic Trajectory smoothing constraint
hard negative mining
distractor-aware
convolutional regression trackers
url https://ieeexplore.ieee.org/document/8732986/
work_keys_str_mv AT weichunliu trajectorysmoothingconstraintandhardnegativeminingfordistractorawareregressiontracking
AT xiaoantang trajectorysmoothingconstraintandhardnegativeminingfordistractorawareregressiontracking
AT xiaoyuanren trajectorysmoothingconstraintandhardnegativeminingfordistractorawareregressiontracking
_version_ 1724189637053775872