Teacher improves learning by selecting a training subset

Copyright 2018 by the author(s). We call a learner super-teachable if a teacher can trim down an iid training set while making the learner learn even better. We provide sharp super-teaching guarantees on two learners: the maximum likelihood estimator for the mean of a Gaussian, and the large margin...

Full description

Bibliographic Details
Main Authors: Ma, Y (Author), Nowak, R (Author), Rigollet, P (Author), Zhang, X (Author), Zhu, X (Author)
Format: Article
Language:English
Published: 2021-11-01T18:39:14Z.
Subjects:
Online Access:Get fulltext
Description
Summary:Copyright 2018 by the author(s). We call a learner super-teachable if a teacher can trim down an iid training set while making the learner learn even better. We provide sharp super-teaching guarantees on two learners: the maximum likelihood estimator for the mean of a Gaussian, and the large margin classifier in 1D. For general learners, we provide a mixed-integer nonlinear programming-based algorithm to find a super teaching set. Empirical experiments show that our algorithm is able to find good super-teaching sets for both regression and classification problems.