Multiclass learning with simplex coding

In this paper we discuss a novel framework for multiclass learning, defined by a suitable coding/decoding strategy, namely the simplex coding, that allows us to generalize to multiple classes a relaxation approach commonly used in binary classification. In this framework, we develop a relaxation err...

Full description

Bibliographic Details
Main Authors: Mroueh, Youssef (Contributor), Poggio, Tomaso A. (Contributor), Rosasco, Lorenzo Andrea (Contributor), Slotine, Jean-Jacques E. (Contributor)
Other Authors: Massachusetts Institute of Technology. Center for Biological & Computational Learning (Contributor), Massachusetts Institute of Technology. Department of Brain and Cognitive Sciences (Contributor), Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science (Contributor), Massachusetts Institute of Technology. Department of Mechanical Engineering (Contributor), McGovern Institute for Brain Research at MIT (Contributor)
Format: Article
Language:English
Published: Neural Information Processing Systems Foundation, 2014-12-16T15:43:57Z.
Subjects:
Online Access:Get fulltext
Description
Summary:In this paper we discuss a novel framework for multiclass learning, defined by a suitable coding/decoding strategy, namely the simplex coding, that allows us to generalize to multiple classes a relaxation approach commonly used in binary classification. In this framework, we develop a relaxation error analysis that avoids constraints on the considered hypotheses class. Moreover, using this setting we derive the first provably consistent regularized method with training/tuning complexity that is independent to the number of classes. We introduce tools from convex analysis that can be used beyond the scope of this paper.