Matches in ScholarlyData for { <https://w3id.org/scholarlydata/inproceedings/lrec2008/papers/900> ?p ?o. }
Showing items 1 to 12 of
12
with 100 items per page.
- 900 creator djamel-mostefa.
- 900 creator olivier-hamon.
- 900 type InProceedings.
- 900 label "An Experimental Methodology for an End-to-End Evaluation in Speech-to-Speech Translation".
- 900 sameAs 900.
- 900 abstract "This paper describes the evaluation methodology used to evaluate the TC-STAR speech-to-speech translation (SST) system and the results from the third year of the project. It follows the results presented in Hamon (2007), dealing with the first end-to-end evaluation of the project. In this paper, we try to experiment with the methodology and the protocol during a second end-to-end evaluation, by comparing outputs from the TC-STAR system with interpreters from the European parliament. For this purpose, we test different criteria of evaluation and type of questions within a comprehension test. The results show that interpreters do not translate all the information (as opposed to the automatic system), but the quality of SST is still far from that of human translation. The experimental comprehension test used provides new information to study the quality of automatic systems, but without settling the issue of which protocol is the best. This depends on what the evaluator wants to know about the SST: either to have a subjective end-user evaluation or a more objective one.".
- 900 hasAuthorList authorList.
- 900 hasTopic Linguistics.
- 900 isPartOf proceedings.
- 900 keyword "Evaluation methodologies".
- 900 keyword "Machine Translation, SpeechToSpeech Translation".
- 900 title "An Experimental Methodology for an End-to-End Evaluation in Speech-to-Speech Translation".