Using Silence MR Image to Synthesise Dynamic MRI Vocal Tract Data of CV - Department of Natural Language Processing & Knowledge Discovery Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Using Silence MR Image to Synthesise Dynamic MRI Vocal Tract Data of CV

Résumé

In this work we present an algorithm for synthesising pseudo rtMRI data of the vocal tract. rtMRI data on the midsagittal plane were used to synthesise target consonant-vowel (CV) using only a silence frame of the target speaker. For this purpose, several single speaker models were created. The input of the algorithm is a silence frame of both train and target speaker and the rtMRI data of the target CV. An image transformation is computed from each CV frame to the next one, creating a set of transformations that describe the dynamics of the CV production. Another image transformation is computed from the silence frame of train speaker to the silence frame of the target speaker and is used to adapt the set of transformations computed previously to the target speaker. The adapted set of transformations is applied to the silence of the target speaker to synthesise his/her CV pseudo rtMRI data. Synthesised images from multiple single speaker models are frame aligned and then averaged to create the final version of synthesised images. Synthesised images are compared with the original ones using image cross-correlation. Results show good agreement between the synthesised and the original images.
Fichier principal
Vignette du fichier
IoannisInterSpeech2020.pdf (418.16 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03090808 , version 1 (30-12-2020)

Identifiants

  • HAL Id : hal-03090808 , version 1

Citer

Ioannis K Douros, Ajinkya Kulkarni, Chrysanthi Dourou, Yu Xie, Jacques Felblinger, et al.. Using Silence MR Image to Synthesise Dynamic MRI Vocal Tract Data of CV. INTERSPEECH 2020, Oct 2020, Shangaï / Virtual, China. ⟨hal-03090808⟩
167 Consultations
212 Téléchargements

Partager

Gmail Facebook X LinkedIn More