Estimation for Volunteer Panel Web Surveys Using Propensity Score Adjustment and Calibration Adjustment
- 1 February 2009
- journal article
- research article
- Published by SAGE Publications in Sociological Methods & Research
- Vol. 37 (3), 319-343
- https://doi.org/10.1177/0049124108329643
Abstract
A combination of propensity score and calibration adjustment is shown to reduce bias in volunteer panel Web surveys. In this combination, the design weights are adjusted by propensity scores to correct for selection bias due to nonrandomized sampling. These adjusted weights are then calibrated to control totals for the target population and correct for coverage bias. The final set of weights is comprised of multiple components, and the estimator of a total no longer takes a linear form. Therefore, approximate methods are needed to derive variance estimates. This study compares three variance estimation methods through simulation. The first method resembles what is used in commercial statistical software based on squared residuals. The second approach uses a variance estimator originally derived for the generalized regression estimator. The third method uses jackknife replication. Results indicate bias reduction is crucial for valid variance estimation and favor the replication method over the other approaches.Keywords
This publication has 7 references indexed in Scilit:
- Weighting Telephone Samples Using Propensity ScoresPublished by Wiley ,2007
- A Comparison Between Responses From a Propensity-Weighted Web Survey and an Identical RDD SurveySocial Science Computer Review, 2004
- Applied Logistic RegressionPublished by Wiley ,2000
- Generalized Raking Procedures in Survey SamplingJournal of the American Statistical Association, 1993
- Calibration Estimators in Survey SamplingJournal of the American Statistical Association, 1992
- Reducing Bias in Observational Studies Using Subclassification on the Propensity ScoreJournal of the American Statistical Association, 1984
- The central role of the propensity score in observational studies for causal effectsBiometrika, 1983