Matches in ScholarlyData for { <https://w3id.org/scholarlydata/inproceedings/eswc2015/paper/phDSymposium/3> ?p ?o. }
Showing items 1 to 7 of
7
with 100 items per page.
- 3 creator anca-dumitrache.
- 3 type InProceedings.
- 3 label "3".
- 3 sameAs 3.
- 3 abstract "This paper proposes an approach to gathering annotated semantic data, which rejects the notion that human interpretation can have a single ground truth, and is instead based on the observation that disagreement between annotators can signal ambiguity in the input text, as well as how the annotation task has been designed. The purpose of this research is to investigate whether disagreement-aware crowdsourcing is a scalable approach to gather semantic annotation across various tasks and domains. We propose a methodology for answering this question that involves, for each task and domain: defining the crowdsourcing setup, experimental data collection, and evaluating both the setup and the results. We present initial results for the task of medical relation extraction, and propose an evaluation plan for crowdsourcing semantic annotation for several tasks and domains.".
- 3 hasAuthorList authorList.
- 3 title "Crowdsourcing Disagreement for Collecting Semantic Annotation".