The Harvest information discovery and access system

Abstract

It is increasingly difficult to make effective use of Internet information, given the rapid growth in data volume, user base, and data diversity. In this paper we introduce Harvest, a sys- tem that provides a scalable, customizable architecture for gathering, indexing, caching, replicat- ing, and accessing Internet information.