The SIFT information dissemination system
- 1 December 1999
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Database Systems
- Vol. 24 (4), 529-565
- https://doi.org/10.1145/331983.331992
Abstract
Information dissemination is a powerful mechanism for finding information in wide-area environments. An information dissemination server accepts long-term user queries, collects new documents from information sources, matches the documents against the queries, and continuously updates the users with relevant information. This paper is a retrospective of the Stanford Information Filtering Service (SIFT), a system that as of April 1996 was processing over 40,000 worldwide subscriptions and over 80,000 daily documents. The paper describes some of the indexing mechanisms that were developed for SIFT, as well as the evaluations that were conducted to select a scheme to implement. It also describes the implementation of SIFT, and experimental results for the actual system. Finally, it also discusses and experimentally evaluates techniques for distributing a service such as SIFT for added performance and availability.Keywords
This publication has 18 references indexed in Scilit:
- Index structures for selective dissemination of information under the Boolean modelACM Transactions on Database Systems, 1994
- The Information BusACM SIGOPS Operating Systems Review, 1993
- Using collaborative filtering to weave an information tapestryCommunications of the ACM, 1992
- Personalized information deliveryCommunications of the ACM, 1992
- Hierarchical quorum consensus: a new algorithm for managing replicated dataIEEE Transactions on Computers, 1991
- Exploiting logical structures in replicated databasesInformation Processing Letters, 1990
- Intelligent information-sharing systemsCommunications of the ACM, 1987
- A √N algorithm for mutual exclusion in decentralized systemsACM Transactions on Computer Systems, 1985
- An algorithm for suffix strippingProgram: electronic library and information systems, 1980
- A Majority consensus approach to concurrency control for multiple copy databasesACM Transactions on Database Systems, 1979