Tutorial on use of intraclass correlation coefficients for assessing intertest reliability and its application in functional near-infrared spectroscopy–based brain imaging
- 1 May 2015
- journal article
- Published by SPIE-Intl Soc Optical Eng in Journal of Biomedical Optics
- Vol. 20 (5), 050801
- https://doi.org/10.1117/1.jbo.20.5.050801
Abstract
Abstract. Test-retest reliability of neuroimaging measurements is an important concern in the investigation of cognitive functions in the human brain. To date, intraclass correlation coefficients (ICCs), originally used in inter-rater reliability studies in behavioral sciences, have become commonly used metrics in reliability studies on neuroimaging and functional near-infrared spectroscopy (fNIRS). However, as there are six popular forms of ICC, the adequateness of the comprehensive understanding of ICCs will affect how one may appropriately select, use, and interpret ICCs toward a reliability study. We first offer a brief review and tutorial on the statistical rationale of ICCs, including their underlying analysis of variance models and technical definitions, in the context of assessment on intertest reliability. Second, we provide general guidelines on the selection and interpretation of ICCs. Third, we illustrate the proposed approach by using an actual research study to assess intertest reliability of fNIRS-based, volumetric diffuse optical tomography of brain activities stimulated by a risk decision-making protocol. Last, special issues that may arise in reliability assessment using ICCs are discussed and solutions are suggested.Keywords
This publication has 35 references indexed in Scilit:
- Test-Retest Reliability of Graph Metrics in Functional Brain Networks: A Resting-State fNIRS StudyPLOS ONE, 2013
- Comparison of neural correlates of risk decision making between genders: An exploratory fNIRS study of the Balloon Analogue Risk Task (BART)NeuroImage, 2012
- Simulation of Near-Infrared Light Absorption Considering Individual Head and Prefrontal Cortex Anatomy: Implications for Optical NeuroimagingPLOS ONE, 2011
- Graph Theoretical Analysis of Functional Brain Networks: Test-Retest Evaluation on Short- and Long-Term Resting-State Functional MRI DataPLOS ONE, 2011
- Intra- and extra-cranial effects of transient blood pressure changes on brain near-infrared spectroscopy (NIRS) measurementsJournal of Neuroscience Methods, 2011
- Measuring fMRI reliability with the intra-class correlation coefficientNeuroImage, 2009
- Neural correlates of voluntary and involuntary risk taking in the human brain: An fMRI Study of the Balloon Analog Risk Task (BART)NeuroImage, 2008
- Quantifying Test-Retest Reliability Using the Intraclass Correlation Coefficient and the SEMJournal of Strength & Conditioning Research, 2005
- Optical tomography in medical imagingInverse Problems, 1999
- Statistical Methods For Assessing Measurement Error (Reliability) in Variables Relevant to Sports MedicineSports Medicine, 1998