Publication result detail

WTF-LOD - A New Resource for Large-Scale NER Evaluation

OTRUSINA, L.; SMRŽ, P.

Original Title

WTF-LOD - A New Resource for Large-Scale NER Evaluation

English Title

WTF-LOD - A New Resource for Large-Scale NER Evaluation

Type

Paper in proceedings (conference paper)

Original Abstract

This paper introduces the Web TextFull linkage to Linked Open Data (WTF-LOD) dataset intended for large-scale evaluation of named entity recognition (NER) systems. First, we present the process of collecting data from the largest publically-available textual corpora, including Wikipedia dumps, monthly runs of the CommonCrawl, and ClueWeb09/12. We discuss similarities and differences of related initiatives such as WikiLinks and WikiReverse. Our work primarily focuses on links from "textfull" documents (links surrounded by a text that provides a useful context for entity linking), de-duplication of the data and advanced cleaning procedures. Presented statistics demonstrate that the collected data forms one of the largest available resource of its kind. They also prove suitability of the result for complex NER evaluation campaigns, including an analysis of the most ambiguous name mentions appearing in the data.

English abstract

This paper introduces the Web TextFull linkage to Linked Open Data (WTF-LOD) dataset intended for large-scale evaluation of named entity recognition (NER) systems. First, we present the process of collecting data from the largest publically-available textual corpora, including Wikipedia dumps, monthly runs of the CommonCrawl, and ClueWeb09/12. We discuss similarities and differences of related initiatives such as WikiLinks and WikiReverse. Our work primarily focuses on links from "textfull" documents (links surrounded by a text that provides a useful context for entity linking), de-duplication of the data and advanced cleaning procedures. Presented statistics demonstrate that the collected data forms one of the largest available resource of its kind. They also prove suitability of the result for complex NER evaluation campaigns, including an analysis of the most ambiguous name mentions appearing in the data.

Keywords

named entity evaluation, linked open data, CommonCrawl, ClueWeb, Wikipedia

Key words in English

named entity evaluation, linked open data, CommonCrawl, ClueWeb, Wikipedia

Authors

OTRUSINA, L.; SMRŽ, P.

RIV year

2017

Released

25.05.2016

Publisher

European Language Resources Association

Location

Portorož

ISBN

978-2-9517408-9-1

Book

Proceedings of the Tenth conference on International Language Resources and Evaluation (LREC'16)

Pages from

3299

Pages to

3302

Pages count

4

BibTex

@inproceedings{BUT130955,
  author="Lubomír {Otrusina} and Pavel {Smrž}",
  title="WTF-LOD - A New Resource for Large-Scale NER Evaluation",
  booktitle="Proceedings of the Tenth conference on International Language Resources and Evaluation (LREC'16)",
  year="2016",
  pages="3299--3302",
  publisher="European Language Resources Association",
  address="Portorož",
  isbn="978-2-9517408-9-1"
}