The Best Two Independent Measurements Are Not the Two Best
- 1 January 1974
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Systems, Man, and Cybernetics
- Vol. SMC-4 (1), 116-117
- https://doi.org/10.1109/tsmc.1974.5408535
Abstract
Consider an item that belongs to one of two classes, θ = 0 or θ = 1, with equal probability. Suppose also that there are two measurement experiments E1 and E2 that can be performed, and suppose that the outcomes are independent (given θ). Let Eí denote an independent performance of experiment EI. Let Pe(E) denote the probability of error resulting from the performance of experiment E. Elashoff [1] gives an example of three experiments E1,E2,E3 such that Pe(E1) < Pe(E2) < Pe(E3), but Pe(E1,E3) < Pe(E1,E2). Toussaint [2] exhibits binary valued experiments satisfying Pe(E1) < Pe(E2) < Pe(E3), such that Pe(E2,E3) < Pe(E1,E3) < Pe(E1,E2). We shall give an example of binary valued experiments E1 and E2 such that Pe(E1) < Pe(E2), but Pe(E2,E2') < P,e(E1,E2) < P,e(E1,E1'). Thus if one observation is allowed, E1 is the best experiment. If two observations are allowed, then two independent copies of the ''worst'' experiment E2 are preferred. This is true despite the conditional independence of the observations.Keywords
This publication has 2 references indexed in Scilit:
- Note on optimal selection of independent binary-valued features for pattern recognition (Corresp.)IEEE Transactions on Information Theory, 1971
- On the choice of variables in classification problems with dichotomous variablesBiometrika, 1967