CONSIDERATIONS IN THE CHOICE OF INTEROBSERVER RELIABILITY ESTIMATES
- 1 March 1977
- journal article
- research article
- Published by Wiley in Journal of Applied Behavior Analysis
- Vol. 10 (1), 103-116
- https://doi.org/10.1901/jaba.1977.10-103
Abstract
Two types of interobserver reliability values may be needed in treatment studies in which observers constitute the primary data-acquisition system: trial reilability and the reliability of the composite unit or score which is subsequently analyzed, e.g., daily or weekly session totals. Two approaches to determining interobserver reliability are described: percentage agreement and “correlational” measures of reliability. The interpretation of these estimates, factors affecting their magnitude, and the advantages and limitations of each approach are presented.Keywords
This publication has 13 references indexed in Scilit:
- Some Restrictions in the Application of the Spearman-Brown Prophesy Formula to Observational DataEducational and Psychological Measurement, 1976
- THE EFFECT OF NONVERBAL TEACHER APPROVAL ON STUDENT ATTENTIVE BEHAVIOR1Journal of Applied Behavior Analysis, 1973
- A Long-Term Project in Psychology: Lives Through Time . Jack Block. In collaboration with Norma Haan. Bancroft, Berkeley, Calif., 1971. xxii, 314 pp., illus. $12.50.Science, 1972
- Measuring nominal scale agreement among many raters.Psychological Bulletin, 1971
- Bivariate Agreement Coefficients for Reliability of DataSociological Methodology, 1970
- EFFECTS OF GROUP CONTINGENT EVENTS UPON CLASSROOM NOISE1Journal of Applied Behavior Analysis, 1969
- Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.Psychological Bulletin, 1968
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960
- The reliability of projective techniques: Review of the literatureActa Psychologica, 1959
- Reliability of Content Analysis: The Case of Nominal Scale CodingPublic Opinion Quarterly, 1955