BEVal: A Cross-dataset Evaluation Study of BEV Segmentation Models for Autonomous Driving - INRIA - Institut National de Recherche en Informatique et en Automatique
Conference Papers Year : 2024

BEVal: A Cross-dataset Evaluation Study of BEV Segmentation Models for Autonomous Driving

Abstract

Current research in semantic bird's-eye view segmentation for autonomous driving focuses solely on optimizing neural network models using a single dataset, typically nuScenes. This practice leads to the development of highly specialized models that may fail when faced with different environments or sensor setups, a problem known as domain shift. In this paper, we conduct a comprehensive cross-dataset evaluation of state-of-the-art BEV segmentation models to assess their performance across different training and testing datasets and setups, as well as different semantic categories. We investigate the influence of different sensors, such as cameras and LiDAR, on the models' ability to generalize to diverse conditions and scenarios. Additionally, we conduct multi-dataset training experiments that improve models' BEV segmentation performance compared to single-dataset training. Our work addresses the gap in evaluating BEV segmentation models under cross-dataset validation. And our findings underscore the importance of enhancing model generalizability and adaptability to ensure more robust and reliable BEV segmentation approaches for autonomous driving applications. The code for this paper available at https://github.com/manueldiaz96/beval .
Fichier principal
Vignette du fichier
root.pdf (4.79 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04677808 , version 1 (28-08-2024)
hal-04677808 , version 2 (30-08-2024)
hal-04677808 , version 3 (12-09-2024)

Licence

Identifiers

Cite

Manuel Alejandro Diaz-Zapata, Wenqian Liu, Robin Baruffa, Christian Laugier. BEVal: A Cross-dataset Evaluation Study of BEV Segmentation Models for Autonomous Driving. ICARCV 2024 - 18th International Conference on Control, Automation, Robotics and Vision - ICARCV 2024, Dec 2024, Dubai, United Arab Emirates. pp.1-3. ⟨hal-04677808v3⟩
245 View
34 Download

Altmetric

Share

More