A Discriminative Training Procedure for Continuous Translation Models

Quoc Khanh Do (1) , Alexandre Allauzen (1) , François Yvon (1)

1 LIMSI - Laboratoire d'Informatique pour la Mécanique et les Sciences de l'Ingénieur

Continuous-space translation models have recently emerged as extremely powerful ways to boost the performance of existing translation systems. A simple, yet effective way to integrate such models in inference is to use them in an $\nb$-best rescoring step. In this paper, we focus on this scenario and show that the performance gains in rescoring can be greatly increased when the neural network is trained jointly with all the other model parameters, using an appropriate objective function. Our approach is validated on two domains, where it outperforms strong baselines.

Mots clés: Neural network; Continuous space model; Translation model; Discriminative training

Domaines: Informatique [cs]; Informatique et langage [cs.CL]

Quoc Khanh Do, Alexandre Allauzen, François Yvon. A Discriminative Training Procedure for Continuous Translation Models. Conference on Empirical Methods in Natural Language Processing, The Association for Computational Linguistics, Sep 2015, Lisbon, Portugal. pp.1046 - 1052. ⟨hal-01635000⟩