Harris recurrence of Metropolis-within-Gibbs and trans-dimensional Markov chains
Open Access
- 1 November 2006
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Applied Probability
- Vol. 16 (4), 2123-2139
- https://doi.org/10.1214/105051606000000510
Abstract
A ϕ-irreducible and aperiodic Markov chain with stationary probability distribution will converge to its stationary distribution from almost all starting points. The property of Harris recurrence allows us to replace “almost all” by “all,” which is potentially important when running Markov chain Monte Carlo algorithms. Full-dimensional Metropolis–Hastings algorithms are known to be Harris recurrent. In this paper, we consider conditions under which Metropolis-within-Gibbs and trans-dimensional Markov chains are or are not Harris recurrent. We present a simple but natural two-dimensional counter-example showing how Harris recurrence can fail, and also a variety of positive results which guarantee Harris recurrence. We also present some open problems. We close with a discussion of the practical implications for MCMC algorithms.Keywords
This publication has 18 references indexed in Scilit:
- General state space Markov chains and MCMC algorithmsProbability Surveys, 2004
- Efficient Construction of Reversible Jump Markov Chain Monte Carlo Proposal DistributionsJournal of the Royal Statistical Society Series B: Statistical Methodology, 2003
- Honest Exploration of Intractable Probability Distributions via Markov Chain Monte CarloStatistical Science, 2001
- Convergence Properties of Perturbed Markov ChainsJournal of Applied Probability, 1998
- A note on Metropolis-Hastings kernels for general state spacesThe Annals of Applied Probability, 1998
- Reversible jump Markov chain Monte Carlo computation and Bayesian model determinationBiometrika, 1995
- Minorization Conditions and Convergence Rates for Markov Chain Monte CarloJournal of the American Statistical Association, 1995
- Markov Chains for Exploring Posterior DistributionsThe Annals of Statistics, 1994
- Sampling-Based Approaches to Calculating Marginal DensitiesJournal of the American Statistical Association, 1990
- Monte Carlo sampling methods using Markov chains and their applicationsBiometrika, 1970