Ergodicity is the property of a stochastic process whereby its long-run time average, computed along a single sufficiently long trajectory, converges to its ensemble average across all possible states. It is a required condition for Markov chain Monte Carlo methods to converge to the target distribution, since it guarantees that a chain will eventually visit all reachable states in proportion to their stationary probability. Non-ergodic chains can become trapped in subsets of the state space and yield biased samples.

Provenance