The importance of development standards for anchoring vignettes: an illustrative example from pediatric localized scleroderma quality of life
- 11 July 2020
- journal article
- research article
- Published by Springer Science and Business Media LLC in Quality of Life Research
- Vol. 29 (12), 3263-3272
- https://doi.org/10.1007/s11136-020-02575-6
Abstract
Purpose Anchoring vignettes (AVs) are a promising measurement technique to reduce bias in patient-reported outcome (PRO) measures by helping researchers understand differences in how individuals and groups interpret response options. However, little attention has been paid to ensure quality development of AVs, and their performance has not been well assessed in pediatric populations. In this study, we explore the application of a rigorous development process for AVs based upon current standards for PROs, as well as feasibility of AVs when administered to children and adolescents. Methods We developed AVs using a rigorous, patient-centered mixed methods process including three phases: (1) development, (2) a pilot study, and (3) a field test. Our proposed process included the generation of a conceptual framework based on the PRO, the Localized Scleroderma Quality of Life Instrument, and numerous vignette-specific considerations. We qualitatively explored readability and comprehension of the AVs (pilot study) and then analyzed ranking patterns within vignette sets (field test). Results Four sets of four vignettes were developed. Revisions were suggested at each phase of development. The pilot study demonstrated that children ≥ 10 years had no trouble indicating understanding of the AVs. In the field test, although appropriate rankings of vignettes were generally demonstrated by participants, the percentage of tied rankings was higher than expected in this pediatric group. Conclusions This work supports the need for rigorous developmental standards for AVs, as each stage of development suggested revisions. Additionally, AVs showed initial promise for use with pediatric populations; general feasibility and understanding were supported.Keywords
Funding Information
- Nancy Taylor Foundation for Chronic Diseases
- National Institute of Arthritis and Musculoskeletal and Skin Diseases (1K23AR059722)
- James N. Gilliam MD Chair in Dermatology
This publication has 33 references indexed in Scilit:
- ARE ANCHORING VIGNETTES RATINGS SENSITIVE TO VIGNETTE AGE AND SEX?Health Economics, 2011
- Using Anchoring Vignettes to Assess Group Differences in General Self-Rated HealthJournal of Health and Social Behavior, 2011
- Assessing empathy in young children: Construction and validation of an Empathy Questionnaire (EmQue)Personality and Individual Differences, 2010
- Applications of Response Shift Theory and Methods to Participation Measurement: A Brief History of a Young FieldArchives of Physical Medicine and Rehabilitation, 2010
- Improving Anchoring Vignettes: Designing Surveys to Correct Interpersonal IncomparabilityPublic Opinion Quarterly, 2010
- Impaired health-related quality of life in children and adolescents with chronic conditions: a comparative analysis of 10 disease clusters and 33 disease categories/severities utilizing the PedsQL™ 4.0 Generic Core ScalesHealth and Quality of Life Outcomes, 2007
- Comparing Incomparable Survey Responses: Evaluating and Selecting Anchoring VignettesPolitical Analysis, 2007
- Juvenile localized scleroderma: clinical and epidemiological features in 750 children. An international studyRheumatology, 2005
- Evidence That School-Age Children Can Self-Report on Their HealthAcademic Pediatrics, 2004
- Enhancing the Validity and Cross-Cultural Comparability of Measurement in Survey ResearchAmerican Political Science Review, 2004