Matches in ScholarlyData for { <https://w3id.org/scholarlydata/inproceedings/lrec2008/papers/751> ?p ?o. }
Showing items 1 to 16 of
16
with 100 items per page.
- 751 creator haejoong-lee.
- 751 creator lauren-friedman.
- 751 creator meghan-lammie-glenn.
- 751 creator shawn-medero.
- 751 creator stephanie-strassel.
- 751 type InProceedings.
- 751 label "Management of Large Annotation Projects Involving Multiple Human Judges: a Case Study of GALE Machine Translation Post-editing".
- 751 sameAs 751.
- 751 abstract "Managing large groups of human judges to perform any annotation task is a challenge. Linguistic Data Consortium coordinated the creation of manual machine translation post-editing results for the DARPA Global Autonomous Language Exploration Program. Machine translation is one of three core technology components for GALE, which includes an annual MT evaluation administered by National Institute of Standards and Technology. Among the training and test data LDC creates for the GALE program are gold standard translations for system evaluation. The GALE machine translation system evaluation metric is edit distance, measured by HTER (human translation edit rate), which calculates the minimum number of changes required for highly-trained human editors to correct MT output so that it has the same meaning as the reference translation. LDC has been responsible for overseeing the post-editing process for GALE. We describe some of the accomplishments and challenges of completing the post-editing effort, including developing a new web-based annotation workflow system, and recruiting and training human judges for the task. In addition, we suggest that the workflow system developed for post-editing could be ported efficiently to other annotation efforts.".
- 751 hasAuthorList authorList.
- 751 hasTopic Linguistics.
- 751 isPartOf proceedings.
- 751 keyword "Corpus (creation, annotation, etc.)".
- 751 keyword "Machine Translation, SpeechToSpeech Translation".
- 751 keyword "Other".
- 751 title "Management of Large Annotation Projects Involving Multiple Human Judges: a Case Study of GALE Machine Translation Post-editing".