Web spam pages use various techniques to achieve
higher-than-deserved rankings in a search engine’s
results. While human experts can identify
spam, it is too expensive to manually evaluate a
large number of pages. Instead, we propose techniques
to semi-automatically separate reputable,
good pages from spam. We first select a small set
of seed pages to be evaluated by an expert. Once
we manually identify the reputable seed pages, we
use the link structure of the web to discover other
pages that are likely to be good. In this paper
we discuss possible ways to implement the seed
selection and the discovery of good pages. We
present results of experiments run on the World
Wide Web indexed by AltaVista and evaluate the
performance of our techniques. Our results show
that we can effectively filter out spam from a significant
fraction of the web, based on a good seed
set of less than 200 sites.
P. Moreira, Y. Bizzoni, K. Nielbo, I. Lassen, and M. Thomsen. Proceedings of the The 5th Workshop on Narrative Understanding, page 25--35. Toronto, Canada, Association for Computational Linguistics, (July 2023)
L. Johannsen, S. Ramm, Y. Reckleben, and S. Doerfel. Informatik in der Land-, Forst- und Ernährungswirtschaft, volume 344 of Lecture Notes in Informatics, page 107-118. (2024)
D. Schlör, J. Pfister, and A. Hotho. 2023 the 7th International Conference on Medical and Health Informatics (ICMHI), page 136–141. New York, NY, USA, Association for Computing Machinery, (2023)
H. Fliegel, and R. DiEsposti. Proceedings of the 28th Annual Precise Time and Time Interval Systems and Applications Meeting, page 189--200. Reston, Virginia, (December 1996)
M. Schwab, R. Jäschke, and F. Fischer. Proceedings of the 6th International Conference on Natural Language and Speech Processing, page 99--109. Association for Computational Linguistics, (2023)
Z. Yang, D. Yang, C. Dyer, X. He, A. Smola, and E. Hovy. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, page 1480--1489. San Diego, California, Association for Computational Linguistics, (June 2016)
Y. Kim, K. Stratos, and D. Kim. Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), page 643--653. Vancouver, Canada, Association for Computational Linguistics, (July 2017)
A. Dulny, A. Hotho, and A. Krause. Machine Learning and Knowledge Discovery in Databases: Research Track, page 438--455. Cham, Springer Nature Switzerland, (2023)
D. Wangsadirdja, J. Pfister, K. Kobs, and A. Hotho. Proceedings of the The 17th International Workshop on Semantic Evaluation (SemEval-2023), page 1090--1095. Toronto, Canada, Association for Computational Linguistics, (July 2023)