Inproceedings,

WIRE: an open-source Web information retrieval environment

, and .
Workshop on Open Source Web Information Retrieval (OSWIR), page 27--30. Compiegne, France, (September 2005)

Abstract

In this paper, we describe the WIRE (Web Information Retrieval Environment) project and focus on some details of its crawler component. The WIRE crawler is a scalable, highly configurable, high performance, open-source Web crawler which we have used to study the characteristics of large Web collections.

Tags

Users

  • @chato

Comments and Reviews