DBpediaDQ: User-driven quality evaluation of DBpedia

  • screenshot

With the myriad of data sets and use cases available in the LOD cloud, data quality is one of the important concepts to be considered. The DBpedia Data Quality Curation project is aimed at evaluating the quality of the resources present in DBpedia.

Homepage

As we all know, DBpedia is an important dataset in Linked Data as it is not only connected to and from numerous other datasets, but it also is relied upon for useful information. However, quality problems are inherent in DBpedia be it in terms of incorrectly extracted values or datatype problems since it contains information extracted from crowd-sourced content.

However, not all the data quality problems are automatically detectable. Thus, we aim at crowd-sourcing the quality assessment of the dataset. In order to perform this assessment, we developed a tool whereby a user can evaluate a random resource by analyzing each triple individually and store the results. Here is the link to the tool: http://nl.dbpedia.org:8080/TripleCheckMate/.

If you have any questions or comments, please do not hesitate to contact us at dbpedia-data-quality@googlegroups.com.

Results

  • Results : http://goo.gl/lIKK7
  • Total no. of users : 58
  • Total no. of distinct resources evaluated : 521
  • Total no. of resources evaluated : 792
  • Total no. of distinct resources without problems : 86
  • Total no. of distinct resources with problems : 435
  • Total no. of distinct incorrect triples : 2928
  • Total no. of distinct incorrect triples in the dbprop namespace : 1745
  • Total no. of inter-evaluations : 268
  • No. of resources with evaluators having different opinions : 89
  • Resource-based inter-rater agreement (Cohen’s Kappa) : 0.34
  • Triple-based inter-rater agreement (Cohen’s Kappa) : 0.38
  • No. of triples evaluated for correctness : 700
  • No. of triples evaluated to be correct : 567
  • No. of triples evaluated incorrectly : 133
  • % of triples correctly evaluated : 81
  • Average no. of problems per resource : 5.69
  • Average no. of problems per resource in the dbprop namespace : 3.45
  • Average no. of triples per resource : 47.19
  • % of triples affected : 11.93
  • % of triples affected in the dbprop namespace : 7.11

Manuscript

Publications

by (Editors: ) [BibTex of ]

News

LDK Conference meets DBpedia in Zaragoza, Spain ( 2021-07-09T10:37:27+02:00 by Julia Holze)

2021-07-09T10:37:27+02:00 by Julia Holze

We are happy to announce that we will organize a DBpedia Tutorial on September 1, 2021 in Zaragoza, Spain. This DBpedia tutorial will be part of the Language, Data and Knowledge conference 2021. Read more about "LDK Conference meets DBpedia in Zaragoza, Spain"

DBpedia Tutorial @ Knowledge Graph Conference 2021 ( 2021-04-09T13:20:50+02:00 by Julia Holze)

2021-04-09T13:20:50+02:00 by Julia Holze

On May 4, 2021 we will organize a tutorial at the Knowledge Graph Conference (KGC) 2021. Read more about "DBpedia Tutorial @ Knowledge Graph Conference 2021"

DBpedia @ Google Summer of Code program 2021 ( 2021-03-15T09:41:22+01:00 by Julia Holze)

2021-03-15T09:41:22+01:00 by Julia Holze

DBpedia, one of InfAI’s community projects, will participate in the Google Summer of Code (GSoC) program for the 10th time. The GsoC program has the goal to bring students from all over the globe into open source software development. Read more about "DBpedia @ Google Summer of Code program 2021"

DBpedia’s New Website ( 2021-01-28T12:42:40+01:00 by Julia Holze)

2021-01-28T12:42:40+01:00 by Julia Holze

We are proud to announce the completion of the new DBpedia website. Read more about "DBpedia’s New Website"

DBpedia Day @ SEMANTiCS 2019 ( 2019-08-01T10:35:05+02:00 Sandra Bartsch)

2019-08-01T10:35:05+02:00 Sandra Bartsch

 We are happy to announce that SEMANTiCS 2019 will host the 14th DBpedia Community Meeting at the last day of the conference on September 12, 2019. Read more about "DBpedia Day @ SEMANTiCS 2019"