The role of uncertainty in attentional and choice exploration
- 19 August 2019
- journal article
- research article
- Published by Springer Science and Business Media LLC in Psychonomic Bulletin & Review
- Vol. 26 (6), 1911-1916
- https://doi.org/10.3758/s13423-019-01653-2
Abstract
The exploitation-exploration (EE) trade-off describes how, when making a decision, an organism must often choose between a safe alternative with a known pay-off, and one or more riskier alternatives with uncertain pay-offs. Recently, the concept of the EE trade-off has been extended to the examination of how organisms distribute limited attentional resources between several stimuli. This work suggests that when the rules governing the environment are certain, participants learn to “exploit” by attending preferentially to cues that provide the most information about upcoming events. However, when the rules are uncertain, people “explore” by increasing their attention to all cues that may provide information to help in predicting upcoming events. In the current study, we examine how uncertainty affects the EE trade-off in attention using a contextual two-armed bandit task, where participants explore with both their attention and their choice behavior. We find evidence for an influence of uncertainty on the EE trade-off in both choice and attention. These findings provide support for the idea of an EE trade-off in attention, and that uncertainty is a primary motivator for exploration in both choice and attentional allocation.Funding Information
- Australian Research Council Discovery Project (DP140103268)
- Australian Department of Education and Training (Research Training Program)
This publication has 17 references indexed in Scilit:
- Uncertainty and predictiveness determine attention to cues during human associative learningThe Quarterly Journal of Experimental Psychology, 2015
- The Nature of Belief-Directed Exploratory Choice in Human Decision-MakingFrontiers in Psychology, 2012
- Overt attention and predictiveness in human contingency learning.Journal of Experimental Psychology: Animal Behavior Processes, 2011
- Should I stay or should I go? How the human brain manages the trade-off between exploitation and explorationPhilosophical Transactions B, 2007
- Cortical substrates for exploratory decisions in humansNature, 2006
- Eyetracking and selective attention in category learningCognitive Psychology, 2005
- Learned Associability and Associative Change in Human Causal LearningThe Quarterly Journal of Experimental Psychology, 2003
- A re‐examination of probability matching and rational choiceJournal of Behavioral Decision Making, 2002
- Prospect Theory: An Analysis of Decision under RiskEconometrica, 1979
- RELATIVE AND ABSOLUTE STRENGTH OF RESPONSE AS A FUNCTION OF FREQUENCY OF REINFORCEMENT1,2Journal of the Experimental Analysis of Behavior, 1961