Matches in ScholarlyData for { <https://w3id.org/scholarlydata/inproceedings/lrec2008/papers/279> ?p ?o. }
Showing items 1 to 14 of
14
with 100 items per page.
- 279 creator harry-bunt.
- 279 creator jeroen-geertzen.
- 279 creator volha-petukhova.
- 279 type InProceedings.
- 279 label "Evaluating Dialogue Act Tagging with Naive and Expert Annotators".
- 279 sameAs 279.
- 279 abstract "In this paper the dialogue act annotation of naive and expert annotators, both annotating the same data, are compared in order to characterise the insights annotations made by different kind of annotators may provide for evaluating dialogue act tagsets. It is argued that the agreement among naive annotators provides insight in the clarity of the tagset, whereas agreement among expert annotators provides an indication of how reliably the tagset can be applied when errors are ruled out that are due to deficiencies in understanding the concepts of the tagset, to a lack of experience in using the annotation tool, or to little experience in annotation more generally. An indication of the differences between the two groups in terms of inter-annotator agreement and tagging accuracy on task-oriented dialogue in different domains, annotated with the DIT++ dialogue act tagset is presented, and the annotations of both groups are assessed against a gold standard. Additionally, the effect of the reduction of the tagset s granularity on the performances of both groups is looked into. In general, it is concluded that the annotations of both groups provide complementary insights in reliability, clarity, and more fundamental conceptual issues.".
- 279 hasAuthorList authorList.
- 279 hasTopic Linguistics.
- 279 isPartOf proceedings.
- 279 keyword "Corpus (creation, annotation, etc.)".
- 279 keyword "Dialogue & Natural Interactivity".
- 279 keyword "Evaluation methodologies".
- 279 title "Evaluating Dialogue Act Tagging with Naive and Expert Annotators".