SYNCHRONIZING TO THE ENVIRONMENT: INFORMATION-THEORETIC CONSTRAINTS ON AGENT LEARNING
- 1 June 2001
- journal article
- Published by World Scientific Pub Co Pte Ltd in Advances in Complex Systems
- Vol. 04 (02n03), 251-264
- https://doi.org/10.1142/s021952590100019x
Abstract
Using an information-theoretic framework, we examine how an intelligent agent, given an accurate model of its environment, synchronizes to the environment — i.e., comes to know in which state the environment is. We show that the total uncertainty experienced by the agent during the process is closely related to the transient information, a new quantity that captures the manner in which the environment's entropy growth curve converges to its asymptotic form. We also discuss how an agent's estimates of its environment's structural properties are related to its estimate of the environment entropy rate. If structural properties are ignored, the missed regularities are converted to apparent randomness. Conversely, using representations that assume too much memory results in false predictability.Keywords
Other Versions
This publication has 11 references indexed in Scilit:
- EVOLUTION AND TIME HORIZONS IN AN AGENT-BASED STOCK MARKETMacroeconomic Dynamics, 2001
- Computational Mechanics: Pattern and Prediction, Structure and SimplicityJournal of Statistical Physics, 2001
- Prediction and entropy of nonlinear dynamical systems and symbolic sequences with LROPhysica D: Nonlinear Phenomena, 1997
- Entropy estimation of symbol sequencesChaos: An Interdisciplinary Journal of Nonlinear Science, 1996
- Toward a quantitative theory of self-generated complexityInternational Journal of Theoretical Physics, 1986
- Symbolic dynamics of noisy chaosPhysica D: Nonlinear Phenomena, 1983
- Rapid acquisition sequencesIEEE Transactions on Information Theory, 1968
- Optimal Ranging CodesIEEE Transactions on Space Electronics and Telemetry, 1964
- On the Identifiability Problem for Functions of Finite Markov ChainsThe Annals of Mathematical Statistics, 1957
- A Mathematical Theory of CommunicationBell System Technical Journal, 1948