Combining instance selection and self-training to improve data stream quantification

• Main Authors: André G. Maletzke, Denis M. dos Reis, Gustavo E. A. P. A. Batista
• Format: Article
• Language: English
• Published: SpringerOpen 2018-10-01
• Series: Journal of the Brazilian Computer Society
• Subjects: Data stream; Quantification; Concept drift
• Online Access: http://link.springer.com/article/10.1186/s13173-018-0076-0
• ISSN: 0104-6500; 1678-4804

Abstract In the last years, learning from data streams has attracted the attention of researchers and practitioners due to its large number of applications. These applications have motivated the research community to propose a significant amount of methods to solve problems in diverse tasks, more prominently in classification, clustering, and anomaly detection. However, a relevant task known as quantification has remained mostly unexplored. The quantification goal is to provide an estimate of the class prevalence in an unlabeled set. Recently, we proposed the SQSI algorithm to quantify data streams with concept drifts. SQSI uses a statistical test to identify concept drifts and retrain the classifiers. However, the retraining involves requiring the labels for all newly arrived instances. In this paper, we extend SQSI algorithm by exploring instance selection techniques allied to semi-supervised learning. The idea is to request the classes of a smaller subset of recent examples. Our experiments demonstrate that SQSI’s extension significantly reduces the dependency on actual labels while maintaining or improving the quantification accuracy.