Detecting splogs via temporal dynamics using self-similarity analysis
- 1 February 2008
- journal article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on the Web
- Vol. 2 (1), 1-35
- https://doi.org/10.1145/1326561.1326565
Abstract
This article addresses the problem of spam blog (splog) detection using temporal and structural regularity of content, post time and links. Splogs are undesirable blogs meant to attract search engine traffic, used solely for promoting affiliate sites. Blogs represent popular online media, and splogs not only degrade the quality of search engine results, but also waste network resources. The splog detection problem is made difficult due to the lack of stable content descriptors. We have developed a new technique for detecting splogs, based on the observation that a blog is a dynamic, growing sequence of entries (or posts) rather than a collection of individual pages. In our approach, splogs are recognized by their temporal characteristics and content. There are three key ideas in our splog detection framework. (a) We represent the blog temporal dynamics using self-similarity matrices defined on the histogram intersection similarity measure of the time, content, and link attributes of posts, to investigate the temporal changes of the post sequence. (b) We study the blog temporal characteristics using a visual representation derived from the self-similarity measures. The visual signature reveals correlation between attributes and posts, depending on the type of blogs (normal blogs and splogs). (c) We propose two types of novel temporal features to capture the splog temporal characteristics. In our splog detector, these novel features are combined with content based features. We extract a content based feature vector from blog home pages as well as from different parts of the blog. The dimensionality of the feature vector is reduced by Fisher linear discriminant analysis. We have tested an SVM-based splog detector using proposed features on real world datasets, with appreciable results (90% accuracy).Keywords
This publication has 11 references indexed in Scilit:
- Detecting Link Spam Using Temporal InformationIEEE International Conference on Data Mining (ICDM), 2006
- A reference collection for web spamACM SIGIR Forum, 2006
- Detecting spam web pages through content analysisPublished by Association for Computing Machinery (ACM) ,2006
- Detecting phrase-level duplication on the world wide webPublished by Association for Computing Machinery (ACM) ,2005
- Scaling link-based similarity searchPublished by Association for Computing Machinery (ACM) ,2005
- Spam, damn spam, and statisticsPublished by Association for Computing Machinery (ACM) ,2004
- Finding and evaluating community structure in networksPhysical Review E, 2004
- Telling humans and computers apart automaticallyCommunications of the ACM, 2004
- Color indexingInternational Journal of Computer Vision, 1991
- Recurrence Plots of Dynamical SystemsEurophysics Letters, 1987