Accéder directement au contenu Accéder directement à la navigation
Communication dans un congrès

MEDIAPI-SKEL -A 2D-Skeleton Video Database of French Sign Language With Aligned French Subtitles

Abstract : This paper presents MEDIAPI-SKEL, a 2D-skeleton database of French Sign Language videos aligned with French subtitles. The corpus contains 27 hours of video of body, face and hand keypoints, aligned to subtitles with a vocabulary size of 17k tokens. In contrast to existing sign language corpora such as videos produced under laboratory conditions or translations of TV programs into sign language, this database is constructed using original sign language content largely produced by deaf journalists at the media company Média-Pi. Moreover, the videos are accurately synchronized with French subtitles. We propose three challenges appropriate for this corpus that are related to processing units of signs in context: automatic alignment of text and video, semantic segmentation of sign language, and production of video-text embeddings for cross-modal retrieval. These challenges deviate from the classic task of identifying a limited number of lexical signs in a video stream.
Liste complète des métadonnées

Littérature citée [28 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-02952340
Contributeur : Hannah Bull <>
Soumis le : mardi 29 septembre 2020 - 12:25:48
Dernière modification le : mercredi 14 octobre 2020 - 04:21:51

Fichier

2020.lrec-1.743.pdf
Fichiers éditeurs autorisés sur une archive ouverte

Identifiants

  • HAL Id : hal-02952340, version 1

Collections

Citation

Hannah Bull, Annelies Braffort, Michèle Gouiffès. MEDIAPI-SKEL -A 2D-Skeleton Video Database of French Sign Language With Aligned French Subtitles. 12th Conference on Language Resources and Evaluation (LREC 2020), Jun 2020, Marseille, France. pp.6063-6068. ⟨hal-02952340⟩

Partager

Métriques

Consultations de la notice

20

Téléchargements de fichiers

27