Assessing local instrument reliability and validity: a field-based example from northern Uganda
- 22 January 2009
- journal article
- research article
- Published by Springer Science and Business Media LLC in Social psychiatry. Sozialpsychiatrie. Psychiatrie sociale
- Vol. 44 (8), 685-692
- https://doi.org/10.1007/s00127-008-0475-1
Abstract
This paper presents an approach for evaluating the reliability and validity of mental health measures in non-Western field settings. We describe this approach using the example of our development of the Acholi psychosocial assessment instrument (APAI), which is designed to assess depression-like (two tam, par and kumu), anxiety-like (ma lwor) and conduct problems (kwo maraco) among war-affected adolescents in northern Uganda. To examine the criterion validity of this measure in the absence of a traditional gold standard, we derived local syndrome terms from qualitative data and used self reports of these syndromes by indigenous people as a reference point for determining caseness. Reliability was examined using standard test–retest and inter-rater methods. Each of the subscale scores for the depression-like syndromes exhibited strong internal reliability ranging from α = 0.84–0.87. Internal reliability was good for anxiety (0.70), conduct problems (0.83), and the pro-social attitudes and behaviors (0.70) subscales. Combined inter-rater reliability and test–retest reliability were good for most subscales except for the conduct problem scale and prosocial scales. The pattern of significant mean differences in the corresponding APAI problem scale score between self-reported cases vs. noncases on local syndrome terms was confirmed in the data for all of the three depression-like syndromes, but not for the anxiety-like syndrome ma lwor or the conduct problem kwo maraco.Keywords
This publication has 31 references indexed in Scilit:
- Post‐partum depression in Kinshasa, Democratic Republic of Congo: Validation of a concept using a mixed‐methods cross‐cultural approachTropical Medicine & International Health, 2008
- Investigating Psychosocial Adjustment of Former Child Soldiers in Sierra Leone and UgandaJournal of Refugee Studies, 2004
- Trauma exposure and post-traumatic stress symptoms in urban African schoolsThe British Journal of Psychiatry, 2004
- Advances in empirically based assessment: Revised cross-informant syndromes and new DSM-oriented scales for the CBCL, YSR, and TRF: Comment on Lengua, Sadowski, Friedrich, and Fisher (2001).Journal of Consulting and Clinical Psychology, 2001
- Interparental agreement on internalizing, externalizing, and total behavior problems: A meta-analysis.Clinical Psychology: Science and Practice, 2000
- Parent Reports of Behavioral and Emotional Problems among Children in Kenya, Thailand, and the United StatesChild Development, 1993
- Parent Reports of Behavioral and Emotional Problems among Children in Kenya, Thailand, and the United StatesChild Development, 1993
- Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity.Psychological Bulletin, 1987
- Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity.Psychological Bulletin, 1987
- Construct validity in psychological tests.Psychological Bulletin, 1955