A Model of Text for Experimentation in the Social Sciences
Top Cited Papers
- 2 July 2016
- journal article
- research article
- Published by Taylor & Francis Ltd in Journal of the American Statistical Association
- Vol. 111 (515), 988-1003
- https://doi.org/10.1080/01621459.2016.1141684
Abstract
Statistical models of text have become increasingly popular in statistics and computer science as a method of exploring large document collections. Social scientists often want to move beyond exploration, to measurement and experimentation, and make inference about social and political processes that drive discourse and content. In this article, we develop a model of text data that supports this type of substantive research. Our approach is to posit a hierarchical mixed membership model for analyzing topical content of documents, in which mixing weights are parameterized by observed covariates. In this model, topical prevalence and topical content are specified as a simple generalized linear model on an arbitrary number of document-level covariates, such as news source and time of release, enabling researchers to introduce elements of the experimental design that informed document collection into the model, within a generally applicable framework. We demonstrate the proposed methodology by analyzing a collection of news reports about China, where we allow the prevalence of topics to evolve over time and vary across newswire services. Our methods quantify the effect of news wire source on both the frequency and nature of topic coverage. Supplementary materials for this article are available online.Keywords
Funding Information
- National Institutes of Health (P2CHD047879)
This publication has 51 references indexed in Scilit:
- The Discrete Infinite Logistic Normal DistributionBayesian Analysis, 2012
- General purpose computer-assisted clustering and conceptualizationProceedings of the National Academy of Sciences of the United States of America, 2011
- Reconceptualizing the classification of PNAS articlesProceedings of the National Academy of Sciences of the United States of America, 2010
- Large-Scale Bayesian Logistic Regression for Text CategorizationTechnometrics, 2007
- Mining and Tracking Massive Text Data: Classification, Construction of Tracking Statistics, and Inference Under MisclassificationTechnometrics, 2007
- Bayesian auxiliary variable models for binary and multinomial regressionBayesian Analysis, 2006
- Association Mapping in Structured PopulationsAmerican Journal of Human Genetics, 2000
- The Collapsed Gibbs Sampler in Bayesian Computations with Applications to a Gene Regulation ProblemJournal of the American Statistical Association, 1994
- Model-Based Direct AdjustmentJournal of the American Statistical Association, 1987
- Inference in an Authorship ProblemJournal of the American Statistical Association, 1963