Result Details

WTF-LOD - A New Resource for Large-Scale NER Evaluation

OTRUSINA, L.; SMRŽ, P. WTF-LOD - A New Resource for Large-Scale NER Evaluation. In Proceedings of the Tenth conference on International Language Resources and Evaluation (LREC'16). Portorož: European Language Resources Association, 2016. p. 3299-3302. ISBN: 978-2-9517408-9-1.
Type
conference paper
Language
English
Authors
Otrusina Lubomír, Ing., DCGM (FIT)
Smrž Pavel, doc. RNDr., Ph.D., DCGM (FIT)
Abstract

This paper introduces the Web TextFull linkage to Linked Open Data (WTF-LOD) dataset intended for large-scale evaluation of named entity recognition (NER) systems. First, we present the process of collecting data from the largest publically-available textual corpora, including Wikipedia dumps, monthly runs of the CommonCrawl, and ClueWeb09/12. We discuss similarities and differences of related initiatives such as WikiLinks and WikiReverse. Our work primarily focuses on links from "textfull" documents (links surrounded by a text that provides a useful context for entity linking), de-duplication of the data and advanced cleaning procedures. Presented statistics demonstrate that the collected data forms one of the largest available resource of its kind. They also prove suitability of the result for complex NER evaluation campaigns, including an analysis of the most ambiguous name mentions appearing in the data.

Keywords

named entity evaluation, linked open data, CommonCrawl, ClueWeb, Wikipedia

Published
2016
Pages
3299–3302
Proceedings
Proceedings of the Tenth conference on International Language Resources and Evaluation (LREC'16)
Conference
Language Resources and Evaluation Conference 2016
ISBN
978-2-9517408-9-1
Publisher
European Language Resources Association
Place
Portorož
UT WoS
000526952503084
EID Scopus
2-s2.0-85037060832
BibTeX 
@inproceedings{BUT130955,
  author="Lubomír {Otrusina} and Pavel {Smrž}",
  title="WTF-LOD - A New Resource for Large-Scale NER Evaluation",
  booktitle="Proceedings of the Tenth conference on International Language Resources and Evaluation (LREC'16)",
  year="2016",
  pages="3299--3302",
  publisher="European Language Resources Association",
  address="Portorož",
  isbn="978-2-9517408-9-1"
}
Projects
IT4Innovations excellence in science, MŠMT, Národní program udržitelnosti II, LQ1602, start: 2016-01-01, end: 2020-12-31, completed
Social Semantic Emotion Analysis for Innovative Multilingual Big Data Analytics Markets, EU, Horizon 2020, start: 2015-04-01, end: 2017-03-31, completed
Research groups
Knowledge Technology Research Group (RG KNOT)
Departments
Department of Computer Graphics and Multimedia (DCGM)
Back to top