Analyzing Ordinal Scales in Studies of Virtual Environments: Likert or Lump It!
- 1 August 2007
- journal article
- Published by MIT Press in PRESENCE: Virtual and Augmented Reality
- Vol. 16 (4), 439-446
- https://doi.org/10.1162/pres.16.4.439
Abstract
Likert scaled data, which are frequently collected in studies of interaction in virtual environments, demand specialized statistical tools for analysis. The routine use of statistical methods appropriate for continuous data in this context can lead to significant inferential flaws. Likert scaled data are ordinal rather than interval scaled and need to be analyzed using rank based statistical procedures that are widely available. Likert scores are “lumpy” in the sense that they cluster around a small number of fixed values. This lumpiness is made worse by the tendency for subjects to cluster towards either the middle or the extremes of the scale. We suggest an ad hoc method to deal with such data which can involve a further lumping of the results followed by the application of nonparametric statistics. Averaging Likert scores over several different survey questions, which is sometimes done in studies of interaction in virtual environments, results in a different sort of lumpiness. The lumped variables which are obtained in this manner can be quite murky and should be used with great caution, if at all, particularly if the number of questions over which such averaging is carried out is small.Keywords
This publication has 9 references indexed in Scilit:
- The Responses of People to Virtual Humans in an Immersive Virtual EnvironmentPRESENCE: Virtual and Augmented Reality, 2005
- Does Significance Matter?Significance, 2004
- The Likert Scale RevisitedMarket Research Society Journal, 1997
- The Influence of Positive and Negative Wording and Issue Involvement on Responses to Likert Scales in Marketing ResearchMarket Research Society Journal, 1996
- On the estimation of polychoric correlations and their asymptotic covariance matrixPsychometrika, 1994
- Improving Rating Scale Measures by Detecting and Correcting Bias Components in Some Response StylesJournal of Marketing Research, 1992
- Moderated regression analysis and Likert scales: Too coarse for comfort.Journal of Applied Psychology, 1992
- The Effects of Halo and Leniency on Cooperating Teacher Reports Using Likert-Type Rating ScalesThe Journal of Educational Research, 1986
- Preliminary Assessment of Format-Specific Central Tendency and Leniency Error in Summated Rating ScalesPerceptual and Motor Skills, 1982