Structural information in two-dimensional patterns: Entropy convergence and excess entropy
- 19 May 2003
- journal article
- research article
- Published by American Physical Society (APS) in Physical Review E
- Vol. 67 (5), 051104
- https://doi.org/10.1103/physreve.67.051104
Abstract
We develop information-theoretic measures of spatial structure and pattern in more than one dimension. As is well known, the entropy density of a two-dimensional configuration can be efficiently and accurately estimated via a converging sequence of conditional entropies. We show that the manner in which these conditional entropies converge to their asymptotic value serves as a measure of global correlation and structure for spatial systems in any dimension. We compare and contrast entropy convergence with mutual-information and structure-factor techniques for quantifying and detecting spatial structure.This publication has 44 references indexed in Scilit:
- Discovering planar disorder in close-packed structures from x-ray diffraction: Beyond the fault modelPhysical Review B, 2002
- Inhomogeneity and complexity measures for spatial patternsPhysica A: Statistical Mechanics and its Applications, 2002
- Predictability, Complexity, and LearningNeural Computation, 2001
- SYNCHRONIZING TO THE ENVIRONMENT: INFORMATION-THEORETIC CONSTRAINTS ON AGENT LEARNINGAdvances in Complex Systems, 2001
- Detecting self-similarity in surface microstructuresSurface Science, 2000
- Entropic measure of spatial disorder for systems of finite-sized objectsPhysica A: Statistical Mechanics and its Applications, 2000
- Information entropy of complex structuresPhysical Review E, 1997
- Local entropy characterization of correlated random microstructuresPhysica A: Statistical Mechanics and its Applications, 1997
- The calculi of emergence: computation, dynamics and inductionPhysica D: Nonlinear Phenomena, 1994
- Entropic analysis of random morphologiesPhysica A: Statistical Mechanics and its Applications, 1994