REX: Web-Scale Extension of RDF Knowledge Bases

REX is an RDF extraction framework for Web data that can learn XPath wrappers from unlabelled Web pages using knowledge from the Linked Open Data Cloud.

API Documentation Issues Source Code Wiki

Introduction

The Web RDF Extraction Framework, REX, addresses the problem of extracting RDF data from templated websites. To this end, REX provide a generic architecture that allows learning XPath wrappers from unlabelled Web pages using knowledge from the Linked Open Data Cloud. REX is to be regarded as a skeleton that is to be fleshed out for your purposes. Still, REX is also a running system as it provides running implementations for all of its interfaces.

In contrast to existing frameworks to RDF extraction using XPath wrappers, REX provides a consistency layer which ensure that the new knowledge extracted is logically consistent with the knowledge already available in the input knowledge base. This website gives an overview of the framework. All technical details can be found on the Github page's wiki. There you will also find:

  • The Java documentation for the coders out there.
  • A manual to help you run the framework before you customize it for your purposes.
  • A ticket system in case you find some bugs or have some feature request.

Architecture

The REX Architecture

To facilitate the implementation of extraction processes, the framework provides the four layer-architecture shown in Figure 1. The data for the extraction is first to be gathered from the Web (or any other source of your choice). To this end, interfaces are provided. Each of the modules in each of the layers is provided as an interface. Moreover, an initial implementation of each interface is provided (see Java Docs).

  • The extraction layer allows for gathering data from the Web and consists of two modules: The crawler gathers website content from the Web while the domain identifier helps detecting web site domains that contain information pertaining to a given property.
  • The storage layer provides interfaces for managing and storing structured data as well as unstructured data.
  • The induction layer contains all modules that allow to learn XPath expressions. The core module here is the XPath Learner.
  • The generation layer allows integration approaches for generating and validating RDF data. The default generator relies on AGDISTIS and ORE.

Evaluation

With REX, we also aimed to provide a baseline system for the extraction of RDF from templated websites. Thus, in addition to providing at least one implementation for all the interfaces, we also evaluated the basic REX. The data we used for the evaluation can be found here.

What next?

There are several things you can do.

  1. Run REX: Simply follow the steps in the manual.
  2. Extend REX: Please check out the installation instructured.
  3. Point out bugs: Please use the issue tracker.

Now you're on. Please extend REX and help improving the extraction of RDF from the Web.

Project Team

Former Members

Publications

by (Editors: ) [BibTex of ]

News

DBpedia @ SEMANTiCS 2017 ( 2017-09-04T15:25:14+02:00 by Sandra Bartsch)

2017-09-04T15:25:14+02:00 by Sandra Bartsch

We are happy to invite you to the 10th DBpedia Community Meeting which will be held in Amsterdam. During the SEMANTiCS 2017, Sep 11-14, the DBpedia Community will get together on the 14th of September for the DBpdia Day. Read more about "DBpedia @ SEMANTiCS 2017"

PRESS RELEASE: Amsterdam​ ​-​ ​this​ ​year’s​ ​hotspot​ ​​on Linked​ ​Data​ ​Strategies​ ​&​ ​Practices ( 2017-09-04T11:58:06+02:00 by Sandra Bartsch)

2017-09-04T11:58:06+02:00 by Sandra Bartsch

September 11-14, 2017 international experts from science and industry demonstrate the business value of smart data services at SEMANTiCS 2017 Experts from science and industry meet at Europe’s biggest Linked Data and Semantic Web event to present and discuss latest … Continue reading → Read more about "PRESS RELEASE: Amsterdam​ ​-​ ​this​ ​year’s​ ​hotspot​ ​​on Linked​ ​Data​ ​Strategies​ ​&​ ​Practices"

AKSW Colloquium, 01.09.2017, IDOL: Comprehensive & Complete LOD Insights ( 2017-08-28T17:24:03+02:00 Gustavo Publio)

2017-08-28T17:24:03+02:00 Gustavo Publio

At the AKSW Colloquium on Friday 1st of September, at 10:40 AM there will be a paper presentation by Gustavo Publio. Read more about "AKSW Colloquium, 01.09.2017, IDOL: Comprehensive & Complete LOD Insights"

AKSW at ISWC2017 ( 2017-07-30T05:57:57+02:00 Muhammad Saleem)

2017-07-30T05:57:57+02:00 Muhammad Saleem

We are very pleased to announce that AKSW will be presenting 2 papers at ISWC 2017, which will be held on 21-24 October in Vienna, Austria. The demo and workshops papers have to be announced. Read more about "AKSW at ISWC2017"

AKSW Colloquium, 07.07.2017, Two paper presentations concerning Link Discovery and Knowledge Base Reasoning ( 2017-07-06T21:24:36+02:00 by Daniel Obraczka)

2017-07-06T21:24:36+02:00 by Daniel Obraczka

At the AKSW Colloquium on Friday 7th of July, at 10:40 AM there will be two paper presentations concerning genetic algorithms to learn linkage rules, and differentiable learning of logical rules for knowledge base reasoning. Read more about "AKSW Colloquium, 07.07.2017, Two paper presentations concerning Link Discovery and Knowledge Base Reasoning"