Publication detail

Interaction Patterns in Computer-assisted Semantic Annotation of Text - An Empirical Evaluation

DYTRYCH, J. SMRŽ, P.

Original Title

Interaction Patterns in Computer-assisted Semantic Annotation of Text - An Empirical Evaluation

Type

conference paper

Language

English

Original Abstract

This paper examines user interface options and interaction patterns evinced in tools for computer-assisted semantic enrichment of text. It focuses on advanced annotation tasks such as hierarchical annotation of complex relations and linking entities with highly ambiguous names and explores how decisions on particular aspects of annotation interfaces influence the speed and the quality of computer-assisted human annotation processes. Reported experiments compare the 4A annotation system, designed and implemented by our team, to RDFaCE and GATE tools that all provide advanced annotation functionality. Results show that users are able to reach better consistency of event annotations in less time when using the 4A editor. A set of experiments is then conducted that employ 4A's high flexibility and customizability to find an optimal amount of displayed information and its presentation form to reach best results in linking entities with highly ambiguous names. The last set of experiments then proves that 4A's particular way of implementing the concept of semantic filtering speeds up event annotation processes and brings higher consistency when compared to alternative approaches.

Keywords

Computer-assisted Tagging, Semantic Annotation, Event Extraction

Authors

DYTRYCH, J.; SMRŽ, P.

Released

22. 6. 2016

Publisher

SciTePress - Science and Technology Publications

Location

Setúbal

ISBN

978-989-758-172-4

Book

Proceedings of the 8th International Conference on Agents and Artificial Intelligence

Edition

Volume 2: ICAART

Pages from

74

Pages to

84

Pages count

11

URL

http://www.scitepress.org/DigitalLibrary/PublicationsDetail.aspx?ID=5F3T%2fEA+bgg%3d&t=1

BibTex

@inproceedings{BUT134450,
  author="Jaroslav {Dytrych} and Pavel {Smrž}",
  title="Interaction Patterns in Computer-assisted Semantic Annotation of Text - An Empirical Evaluation",
  booktitle="Proceedings of the 8th International Conference on Agents and Artificial Intelligence",
  year="2016",
  series="Volume 2: ICAART",
  pages="74--84",
  publisher="SciTePress - Science and Technology Publications",
  address="Setúbal",
  doi="10.5220/0005695900740084",
  isbn="978-989-758-172-4",
  url="http://www.scitepress.org/DigitalLibrary/PublicationsDetail.aspx?ID=5F3T%2fEA+bgg%3d&t=1"
}