@flowolf

Storage and Retrieval of Large RDF Graph Using Hadoop and MapReduce

, , , and . Cloud Computing, 5931, chapter 72, Springer Berlin Heidelberg, Berlin, Heidelberg, (2009)
DOI: 10.1007/978-3-642-10665-1\_72

Abstract

Handling huge amount of data scalably is a matter of concern for a long time. Same is true for semantic web data. Current semantic web frameworks lack this ability. In this paper, we describe a framework that we built using Hadoop to store and retrieve large number of RDF triples. We describe our schema to store RDF data in Hadoop Distribute File System. We also present our algorithms to answer a SPARQL query. We make use of Hadoop's MapReduce framework to actually answer the queries. Our results reveal that we can store huge amount of semantic web data in Hadoop clusters built mostly by cheap commodity class hardware and still can answer queries fast enough. We conclude that ours is a scalable framework, able to handle large amount of RDF data efficiently.

Links and resources

Tags

community

  • @flowolf
  • @muehlburger
  • @dblp
@flowolf's tags highlighted