Optical illusions from visual data analysis: Example of the New Zealand asthma mortality epidemic
- 1 October 1997
- journal article
- Published by Elsevier BV in Journal of Clinical Epidemiology
- Vol. 50 (10), 1079-1088
- https://doi.org/10.1016/s0895-4356(97)00158-3
Abstract
The abundance of health-related statistics routinely collected worldwide invites their misuse from haphazard associations between secular trends of these data. This misuse is often compounded by assessing these associations simply on the basis of a visual inspection of the data. The visual approach to data analysis, known to have several pitfalls, is particularly tempting in the context of asthma where it has often been used. For example, the epidemic of asthma deaths that occurred in New Zealand during the last two decades has been imputed to fenoterol, a medication for asthma, on the basis of a visual assessment of ecological data. The simultaneity of time trends in the asthma death rate and fenoterol market share in that country formed an important part of the statistical basis of the evidence. We verified whether the results of such visual analyses are corroborated by more objective quantitative statistical methods of analysis. We reanalyzed these same data, namely the time trend data of New Zealand asthma death rates, fenoterol market share, sales of β-agonists and inhaled corticosteroids, measured yearly for the 16-year span 1976–1991, using Poisson weighted loglinear regression. We found that the protective effect of inhaled corticosteroids (rate ratio 0.5 per canister per month; 95% confidence interval 0.4 to 0.7; p = 0.0001) was more closely associated with changes in asthma mortality than either fenoterol (RR 2.7 per canister per month; 95% CI: 0.9 to 7.5; p = 0.06) or all β-agonists combined (RR 1.6; 95% CI: 0.8 to 3.0; p =.19). We conclude from this quantitative analysis that these ecological asthma mortality data provide evidence of a stronger association with inhaled corticosteroids, little used in New Zealand at the onset of the epidemic but used abundantly at its termination, than with fenoterol. This conclusion is diametrically opposite to that found by the visual approach. The quantitative analysis demonstrates that the visual approach to the analysis of ecological data, although seemingly convincing, can be misleading by creating an optical illusion. This purely visual approach to data analysis may thus have serious implications when the resulting scientific information is used to make vital public health and policy decisions.Keywords
This publication has 28 references indexed in Scilit:
- THE CASE-TIME-CONTROL DESIGNEpidemiology, 1995
- Patterns of increasing beta-agonist use and the risk of fatal or near-fatal asthmaEuropean Respiratory Journal, 1994
- Risk of fatal and near-fatal asthma in relation to inhaled corticosteroid usePublished by American Medical Association (AMA) ,1992
- Asthma deaths in New Zealand.BMJ, 1992
- The Use of β-Agonists and the Risk of Death and near Death from AsthmaNew England Journal of Medicine, 1992
- Asthma mortality and inhaled beta agonist therapyAustralian and New Zealand Journal of Medicine, 1991
- Case-control study of prescribed fenoterol and death from asthma in New Zealand, 1977-81.Thorax, 1990
- PRESCRIBED FENOTEROL AND DEATH FROM ASTHMA IN NEW ZEALAND, 1981-83; CASE-CONTROL STUDYThe Lancet, 1989
- On the estimation of relative risk from vital statistical data.Journal of Epidemiology and Community Health, 1979
- RISE AND FALL OF ASTHMA MORTALITY IN ENGLAND AND WALES IN RELATION TO USE OF PRESSURISED AEROSOLSThe Lancet, 1969