On the Feasibility of Internet-Scale Author Identification
Open Access
- 1 May 2012
- conference paper
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 300-314
- https://doi.org/10.1109/sp.2012.46
Abstract
We study techniques for identifying an anonymous author via linguistic stylometry, i.e., comparing the writing style against a corpus of texts of known authorship. We experimentally demonstrate the effectiveness of our techniques with as many as 100,000 candidate authors. Given the increasing availability of writing samples online, our result has serious implications for anonymity and free speech - an anonymous blogger or whistleblower may be unmasked unless they take steps to obfuscate their writing style. While there is a huge body of literature on authorship recognition based on writing style, almost none of it has studied corpora of more than a few hundred authors. The problem becomes qualitatively different at a large scale, as we show, and techniques from prior work fail to scale, both in terms of accuracy and performance. We study a variety of classifiers, both "lazy" and "eager," and show how to handle the huge number of classes. We also develop novel techniques for confidence estimation of classifier outputs. Finally, we demonstrate stylometric authorship recognition on texts written in different contexts. In over 20% of cases, our classifiers can correctly identify an anonymous author given a corpus of texts from 100,000 authors; in about 35% of cases the correct author is one of the top 20 guesses. If we allow the classifier the option of not making a guess, via confidence estimation we are able to increase the precision of the top guess from 20% to over 80% with only a halving of recall.Keywords
This publication has 30 references indexed in Scilit:
- The effect of author set size and data size in authorship attributionLiterary and Linguistic Computing, 2010
- Authorship attribution in the wildLanguage Resources and Evaluation, 2010
- A survey of modern authorship attribution methodsJournal of the American Society for Information Science and Technology, 2008
- Computational methods in authorship attributionJournal of the American Society for Information Science and Technology, 2008
- WriteprintsACM Transactions on Information Systems, 2008
- Authorship AttributionFoundations and Trends® in Information Retrieval, 2007
- An Introduction to Biometric RecognitionIEEE Transactions on Circuits and Systems for Video Technology, 2004
- The myth of the double-blind review?ACM SIGKDD Explorations Newsletter, 2003
- Outside the cave of shadows: using syntactic annotation to enhance authorship attributionLiterary and Linguistic Computing, 1996
- Support-vector networksMachine Learning, 1995