Ehrenfest model

The Ehrenfest model (or dog-flea model[1]) of diffusion was proposed by Tatiana and Paul Ehrenfest to explain the second law of thermodynamics. The model considers N particles in two containers. Particles independently change container at a rate λ. If X(t) = i is defined to be the number of particles in one container at time t, then it is a birth-death process with transition rates

• ${\displaystyle q_{i,i-1}=i\,\lambda }$ for i = 1, 2, ..., N
• ${\displaystyle q_{i,i+1}=(N-i\,)\lambda }$ for i = 0, 1, ..., N – 1

and equilibrium distribution ${\displaystyle \pi _{i}=2^{-N}{\tbinom {N}{i}}}$.

Mark Kac proved in 1947 that if the initial system state is not equilibrium, then the entropy, given by

${\displaystyle H(t)=-\sum _{i}P(X(t)=i)\log \left({\frac {P(X(t)=i)}{\pi _{i}}}\right),}$

is monotonically increasing (H-theorem). This is a consequence of the convergence to the equilibrium distribution.

Interpretation of results

Consider that at the beginning all the particles are in one of the containers. It is expected that over time the number of particles in this container will approach ${\displaystyle N/2}$ and stabilize near that state (containers will have approximately the same number of particles). However from mathematical point of view, going back to the initial state is possible (even almost sure). From mean recurrence theorem follows that even the expected time to going back to the initial state is finite, and it is ${\displaystyle 2^{N}}$. Using Stirling's approximation one finds that if we start at equilibrium (equal number of particles in the containers), the expected time to return to equilibrium is asymptotically equal to ${\displaystyle \textstyle {\sqrt {\pi N/2}}}$. If we assume that particles change containers at rate one in a second, in the particular case of ${\displaystyle N=100}$ particles, starting at equilibrium the return to equilibrium is expected to occur in ${\displaystyle 13}$ seconds, while starting at configuration ${\displaystyle 100}$ in one of the containers, ${\displaystyle 0}$ at the other, the return to that state is expected to take ${\displaystyle 4\cdot 10^{22}}$ years. This supposes that while theoretically sure, recurrence to the initial highly disproportionate state is unlikely to be observed.

References

1. Nauenberg, M. (2004). "The evolution of radiation toward thermal equilibrium: A soluble model that illustrates the foundations of statistical mechanics". American Journal of Physics. 72 (3): 313–323. arXiv:cond-mat/0305219. Bibcode:2004AmJPh..72..313N. doi:10.1119/1.1632488.

• F.P. Kelly Reversibility and Stochastic Networks (Wiley, Chichester, 1979) ISBN 0-471-27601-4 pp. 17–20
• "Ehrenfest model of diffusion." Encyclopædia Britannica (2008)
• Paul und Tatjana Ehrenfest. Über zwei bekannte Einwände gegen das Boltzmannsche H-Theorem. Physikalische Zeitschrift, vol. 8 (1907), pp. 311–314.