Matches in ScholarlyData for { <https://w3id.org/scholarlydata/inproceedings/lrec2008/papers/399> ?p ?o. }
Showing items 1 to 15 of
15
with 100 items per page.
- 399 creator craig-schlenoff.
- 399 creator gregory-sanders.
- 399 creator sebastien-bronsart.
- 399 creator sherri-condon.
- 399 type InProceedings.
- 399 label "Odds of Successful Transfer of Low-Level Concepts: a Key Metric for Bidirectional Speech-to-Speech Machine Translation in DARPA s TRANSTAC Program".
- 399 sameAs 399.
- 399 abstract "The Spoken Language Communication and Translation System for Tactical Use (TRANSTAC) program is a Defense Advanced Research Agency (DARPA) program to create bidirectional speech-to-speech machine translation (MT) that will allow U.S. Soldiers and Marines, speaking only English, to communicate, in tactical situations, with civilian populations who speak only other languages (for example, Iraqi Arabic). A key metric for the program is the odds of successfully transferring low-level concepts, defined as the source-language content words. The National Institute of Standards and Technology (NIST) has now carried out two large-scale evaluations of TRANSTAC systems, using that metric. In this paper we discuss the merits of that metric. It has proven to be quite informative. We describe exactly how we defined this metric and how we obtained values for it from panels of bilingual judges allowing others to do what we have done. We compare results on this metric to results on Likert-type judgments of semantic adequacy, from the same panels of bilingual judges, as well as to a suite of typical automated MT metrics (BLEU, TER, METEOR).".
- 399 hasAuthorList authorList.
- 399 hasTopic Linguistics.
- 399 isPartOf proceedings.
- 399 keyword "Evaluation methodologies".
- 399 keyword "Machine Translation, SpeechToSpeech Translation".
- 399 keyword "Multilinguality".
- 399 title "Odds of Successful Transfer of Low-Level Concepts: a Key Metric for Bidirectional Speech-to-Speech Machine Translation in DARPA s TRANSTAC Program".