Markov chain

noun1

1. •
   A discrete-time stochastic process containing a Markov property.

   • The probability density of the Bayseian posterior was estimated by Metropolis-coupled Markov chain Monte Carlo, with multiple incrementally heated chains. — 2004