PEFSL: A deployment Pipeline for Embedded Few-Shot Learning on a FPGA SoC

Lucas Grativol Ribeiro (1, 2, 3, 4) , Lubin Gauthier (2, 1) , Mathieu Leonardon (1, 2) , Jérémy Morlier (1, 2) , Antoine Lavrard-Meyer (5) , Guillaume Muller (6, 7, 8) , Fresse, Virginie (4, 9) , Matthieu Arzel (1, 3)

1 IMT Atlantique - MEE - Département Mathematical and Electrical Engineering
2 Lab_STICC_BRAIn - Equipe Better Representations for Artificial Intelligence
3 Lab-STICC_2AI - Equipe Algorithm Architecture Interactions
4 LHC - Laboratoire Hubert Curien
5 IMT Atlantique - IMT Atlantique
6 Mines Saint-Étienne MSE - École des Mines de Saint-Étienne
7 FAYOL-ENSMSE - Institut Henri Fayol
8 FAYOL-ENSMSE - Département Informatique et systèmes intelligents
9 TSE - Ecole d'ingénieurs Télécom Saint-Etienne

This paper tackles the challenges of implementing few-shot learning on embedded systems, specifically FPGA SoCs, a vital approach for adapting to diverse classification tasks, especially when the costs of data acquisition or labeling prove to be prohibitively high. Our contributions encompass the development of an end-to-end open-source pipeline for a few-shot learning platform for object classification on a FPGA SoCs. The pipeline is built on top of the Tensil open-source framework, facilitating the design, training, evaluation, and deployment of DNN backbones tailored for few-shot learning. Additionally, we showcase our work’s potential by building and deploying a low-power, low-latency demonstrator trained on the MiniImageNet dataset with a dataflow architecture. The proposed system has a latency of 30 ms while consuming 6.2 W on the PYNQ-Z1 board.

Mots clés: Few-Shot Learning; Hardware Acceleration; FPGA

Domaines: Apprentissage [cs.LG]; Architectures Matérielles [cs.AR]

Lucas Grativol Ribeiro, Lubin Gauthier, Mathieu Leonardon, Jérémy Morlier, Antoine Lavrard-Meyer, et al.. PEFSL: A deployment Pipeline for Embedded Few-Shot Learning on a FPGA SoC. ISCAS 2024 : IEEE International Symposium on Circuits and Systems, May 2024, Singapore, Singapore. ⟨hal-04559365⟩