Implementation of a Bio-Inspired Neural Architecture for Autonomous Vehicles on a Multi-FPGA Platform - ETIS, équipe de recherche CELL Access content directly
Journal Articles Sensors Year : 2023

Implementation of a Bio-Inspired Neural Architecture for Autonomous Vehicles on a Multi-FPGA Platform

Implémentation d'une architecture neurale bio-inspirée pour véhicules autonomes sur plate-forme multi-FPGA

Abstract

Autonomous vehicles require efficient self-localisation mechanisms and cameras are the most common sensors due to their low cost and rich input. However, the computational intensity of visual localisation varies depending on the environment and requires real-time processing and energy-efficient decision-making. FPGAs provide a solution for prototyping and estimating such energy savings. We propose a distributed solution for implementing a large bio-inspired visual localisation model. The workflow includes (1) an image processing IP that provides pixel information for each visual landmark detected in each captured image, (2) an implementation of N-LOC, a bio-inspired neural architecture, on an FPGA board and (3) a distributed version of N-LOC with evaluation on a single FPGA and a design for use on a multi-FPGA platform. Comparisons with a pure software solution demonstrate that our hardware-based IP implementation yields up to 9× lower latency and 7× higher throughput (frames/second) while maintaining energy efficiency. Our system has a power footprint as low as 2.741 W for the whole system, which is up to 5.5–6× less than what Nvidia Jetson TX2 consumes on average. Our proposed solution offers a promising approach for implementing energy-efficient visual localisation models on FPGA platforms.
Fichier principal
Vignette du fichier
sensors-23-04631.pdf (2.75 Mo) Télécharger le fichier
Origin Publication funded by an institution

Dates and versions

hal-04140476 , version 1 (22-01-2024)

Licence

Copyright

Identifiers

Cite

Tarek Elouaret, Sylvain Colomer, Frédéric de Melo, Nicolas Cuperlier, Olivier Romain, et al.. Implementation of a Bio-Inspired Neural Architecture for Autonomous Vehicles on a Multi-FPGA Platform. Sensors, 2023, 23 (10), pp.4631. ⟨10.3390/s23104631⟩. ⟨hal-04140476⟩
48 View
15 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More