Web spam pages use various techniques to achieve
higher-than-deserved rankings in a search engine’s
results. While human experts can identify
spam, it is too expensive to manually evaluate a
large number of pages. Instead, we propose techniques
to semi-automatically separate reputable,
good pages from spam. We first select a small set
of seed pages to be evaluated by an expert. Once
we manually identify the reputable seed pages, we
use the link structure of the web to discover other
pages that are likely to be good. In this paper
we discuss possible ways to implement the seed
selection and the discovery of good pages. We
present results of experiments run on the World
Wide Web indexed by AltaVista and evaluate the
performance of our techniques. Our results show
that we can effectively filter out spam from a significant
fraction of the web, based on a good seed
set of less than 200 sites.
Its so fun to write oversimplified posts about such-and-such is dead. Not because its true. At best you can point out something is broken and alternatives are rising fast. But I wonder how the people behind the aging technology and...
D. Donato, F. Bonchi, T. Chi, and Y. Maarek. Proceedings of the 19th international conference on World wide web, page 321--330. New York, NY, USA, ACM, (2010)
K. McNally, M. O'Mahony, B. Smyth, M. Coyle, and P. Briggs. Proceedings of the 15th international conference on Intelligent user interfaces, page 179--188. New York, NY, USA, ACM, (2010)
B. Smyth, P. Briggs, M. Coyle, and M. O’Mahony. User Modeling, Adaptation, and Personalization, volume 5535 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, (2009)
B. Krause, A. Hotho, and G. Stumme. Proceedings of the IR research, 30th European conference on Advances in information retrieval, page 101--113. Berlin, Heidelberg, Springer-Verlag, (2008)
M. Morris. Proceedings of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, page 1657--1660. New York, NY, USA, ACM, (2008)
B. Krause, R. Jäschke, A. Hotho, and G. Stumme. HT '08: Proceedings of the Nineteenth ACM Conference on Hypertext and Hypermedia, page 157--166. New York, NY, USA, ACM, (2008)
B. Krause, A. Hotho, and G. Stumme. Advances in Information Retrieval, 30th European Conference on IR Research, ECIR 2008, 4956, page 101-113. Springer, (2008)
Y. Liu, B. Gao, T. Liu, Y. Zhang, Z. Ma, S. He, and H. Li. Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, page 451--458. New York, NY, USA, ACM, (2008)
B. Krause, A. Hotho, and G. Stumme. Proceedings of the IR research, 30th European conference on Advances in information retrieval, page 101--113. Berlin, Heidelberg, Springer-Verlag, (2008)
M. Noll, and C. Meinel. Proceedings of the 6th International Semantic Web Conference and 2nd Asian Semantic Web Conference (ISWC/ASWC2007), Busan, South Korea, volume 4825 of LNCS, page 365--378. Berlin, Heidelberg, Springer Verlag, (November 2007)
S. Bao, G. Xue, X. Wu, Y. Yu, B. Fei, and Z. Su. WWW '07: Proceedings of the 16th international conference on World Wide Web, New York, NY, USA, ACM Press, (2007)
P. Jurczyk, and E. Agichtein. Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, page 919--922. New York, NY, USA, ACM, (2007)
M. Morris, and E. Horvitz. Proceedings of the 20th annual ACM symposium on User interface software and technology, page 3--12. New York, NY, USA, ACM, (2007)
B. Yu, and M. Singh. Proceedings of the second international joint conference on Autonomous agents and multiagent systems, page 65--72. New York, NY, USA, ACM, (2003)
B. Yu, and M. Singh. Cooperative Information Agents IV - The Future of Information Agents in Cyberspace, volume 1860 of Lecture Notes in Computer Science, Springer, Berlin/Heidelberg, (2000)