Drop ink in water and it spreads. It never gathers itself back up. Yet each molecule follows laws that work just as well in reverse. So where does the direction of time come from? The answer is counting.
- Watch the graph settle near one half. Nothing's pushing them there.
- Compare 10 particles and 400. With 10, how far does it stray from half?
- Close the gap while they're spread out. They stay spread out.
The idea
Nothing forbids every particle from being on the left. It's just that there's only one way to do that, and a colossal number of ways to be spread evenly. Particles wander at random, so you'll nearly always find them in the kind of state with the most arrangements.
For \(N\) particles with \(n\) on the left, the number of arrangements is:
Boltzmann's great step was to define entropy as the log of this count. His equation is carved on his gravestone.
So the second law, that entropy tends to increase, isn't really a force. It's overwhelming probability. The readout above shows how overwhelming.
Worked example
Take 4 particles. Each one can be left or right, so there are this many arrangements altogether.
All on the left: only one way.
Two on each side: six ways.
With just 4 particles, an even split is 6 times as likely as all on the left. For the \(10^{27}\) particles in a room, the gap is beyond imagining.
The same count, with coins
A coin that lands heads or tails is a particle that ends up on the left or the right. Throw \(N\) coins again and again, and keep a tally of how many heads come up each time.
- Start with 4 coins and check the worked example: two heads can happen in 6 ways out of 16, and all heads comes up about one throw in 16. Slow it to 2 throws a second to read each one: the readout counts the ways for the throw that has just landed.
- Go up to 40, 100 and 400 coins, at 200 throws a second. What happens to the width of the hump?
- With 100 coins, how long would you wait to see all heads? The readout gives the number of arrangements.
The universe began in a state of very low entropy, and has been spreading out ever since. That may be why the past differs from the future at all. It's the argument at the heart of Carroll's From Eternity to Here.
Problems
With 4 particles, what's the chance of all being on the left? And a 2–2 split?
Answer
\(\frac{1}{16}\), and \(\frac{6}{16} = \frac{3}{8}\).
With 10 particles, what's the chance of an exact 5–5 split?
Answer
\(\frac{252}{1024} \approx 25\%\). An exact split gets less likely as \(N\) grows, even though being close to it gets more likely.
What's the chance of 100 particles all being on the left at once?
Answer
\(2^{-100} \approx 8 \times 10^{-31}\).
A gas of \(N\) particles doubles its volume. By how much does its entropy grow?
Answer
Each particle has twice the places to be, so \(W\) grows by \(2^N\), and \(\Delta S = k_B \ln 2^N = Nk_B\ln 2\).