Markov chain
a sequence of steps or events in which the probability of each transition depends only on the immediately preceding step and not on any earlier step. For example, when a person considers a behavior change such as losing weight he or she experiences certain stages: The individual could move from not thinking about losing weight (precontemplation) to considering a weight loss plan (contemplation), through to sustaining a reasonable weight (maintenance), and conceivably back to not wanting to think about weight loss. This process could be described as a Markov chain. Also called Markov process. Compare random walk. [Andrei Markov (1856–1922), Russian mathematician]