Methods For Combining Experts' Probability Assessments
- 1 September 1995
- journal article
- review article
- Published by MIT Press in Neural Computation
- Vol. 7 (5), 867-888
- https://doi.org/10.1162/neco.1995.7.5.867
Abstract
This article reviews statistical techniques for combining multiple probability distributions. The framework is that of a decision maker who consults several experts regarding some events. The experts express their opinions in the form of probability distributions. The decision maker must aggregate the experts' distributions into a single distribution that can be used for decision making. Two classes of aggregation methods are reviewed. When using a supra Bayesian procedure, the decision maker treats the expert opinions as data that may be combined with its own prior distribution via Bayes' rule. When using a linear opinion pool, the decision maker forms a linear combination of the expert opinions. The major feature that makes the aggregation of expert opinions difficult is the high correlation or dependence that typically occurs among these opinions. A theme of this paper is the need for training procedures that result in experts with relatively independent opinions or for aggregation methods that implicitly or explicitly model the dependence among the experts. Analyses are presented that show that m dependent experts are worth the same as k independent experts where k ≤ m. In some cases, an exact value for k can be given; in other cases, lower and upper bounds can be placed on k.Keywords
This publication has 23 references indexed in Scilit:
- Modeling Expert Opinion Arising as a Partial Probabilistic SpecificationJournal of the American Statistical Association, 1995
- Further evidence against independence preservation in expert judgement synthesisAequationes mathematicae, 1987
- Tradeoffs between stereopsis and proximity luminance covariance as determinants of perceived 3D structureVision Research, 1986
- Linear constraints and the efficiency of combined forecastsJournal of Forecasting, 1986
- Limits for the Precision and Value of Information from Dependent SourcesOperations Research, 1985
- The Combination of Forecasts: a Bayesian ApproachJournal of the Operational Research Society, 1982
- Updating of Belief in the Light of Someone Else's OpinionJournal of the Royal Statistical Society. Series A (General), 1980
- Some Comments on the Combination of ForecastsJournal of the Operational Research Society, 1975
- Some Statistical Results in the Combination of ForecastsJournal of the Operational Research Society, 1973
- The Combination of ForecastsJournal of the Operational Research Society, 1969