Its so fun to write oversimplified posts about such-and-such is dead. Not because its true. At best you can point out something is broken and alternatives are rising fast. But I wonder how the people behind the aging technology and...
Web spam pages use various techniques to achieve
higher-than-deserved rankings in a search engine’s
results. While human experts can identify
spam, it is too expensive to manually evaluate a
large number of pages. Instead, we propose techniques
to semi-automatically separate reputable,
good pages from spam. We first select a small set
of seed pages to be evaluated by an expert. Once
we manually identify the reputable seed pages, we
use the link structure of the web to discover other
pages that are likely to be good. In this paper
we discuss possible ways to implement the seed
selection and the discovery of good pages. We
present results of experiments run on the World
Wide Web indexed by AltaVista and evaluate the
performance of our techniques. Our results show
that we can effectively filter out spam from a significant
fraction of the web, based on a good seed
set of less than 200 sites.
B. Krause, A. Hotho, and G. Stumme. Proceedings of the IR research, 30th European conference on Advances in information retrieval, page 101--113. Berlin, Heidelberg, Springer-Verlag, (2008)
D. Donato, F. Bonchi, T. Chi, and Y. Maarek. Proceedings of the 19th international conference on World wide web, page 321--330. New York, NY, USA, ACM, (2010)
B. Yu, and M. Singh. Cooperative Information Agents IV - The Future of Information Agents in Cyberspace, volume 1860 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, (2000)
B. Yu, and M. Singh. Proceedings of the second international joint conference on Autonomous agents and multiagent systems, page 65--72. New York, NY, USA, ACM, (2003)
P. Jurczyk, and E. Agichtein. Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, page 919--922. New York, NY, USA, ACM, (2007)
M. Morris. Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, page 1657--1660. New York, NY, USA, ACM, (2008)