Learning from Few Positives: a Provably Accurate Metric Learning Algorithm to deal with Imbalanced Data

Rémi Viola (1, 2, 3) , Rémi Emonet (1) , Amaury Habrard (1) , Guillaume Metzler (1) , Marc Sebban (1)

1 LHC - Laboratoire Hubert Curien
2 DGFiP - Direction Générale des Finances Publiques
3 Ministère de l'économie et des finances

Learning from imbalanced data, where the positive examples are very scarce, remains a challenging task from both a theoretical and algorithmic perspective. In this paper, we address this problem using a metric learning strategy. Unlike the state-of-the-art methods, our algorithm MLFP, for Metric Learning from Few Positives, learns a new representation that is used only when a test query is compared to a minority training example. From a geometric perspective, it artificially brings positive examples closer to the query without changing the distances to the negative (majority class) data. This strategy allows us to expand the decision boundaries around the positives, yielding a better F-Measure, a criterion which is suited to deal with imbalanced scenarios. Beyond the algorithmic contribution provided by MLFP, our paper presents generalization guarantees on the false positive and false negative rates. Extensive experiments conducted on several imbalanced datasets show the effectiveness of our method.

Mots clés: Metric Learning; Imbalanced Classification; F-measure; Generalization Guarantees

Domaines: Intelligence artificielle [cs.AI]; Apprentissage [cs.LG]

Rémi Viola, Rémi Emonet, Amaury Habrard, Guillaume Metzler, Marc Sebban. Learning from Few Positives: a Provably Accurate Metric Learning Algorithm to deal with Imbalanced Data. IJCAI 2020, the 29th International Joint Conference on Artificial Intelligence, Jul 2020, Yokohama, Japan. ⟨hal-02611586⟩