The Universal laws behind growth patterns, or what Tetris can teach us about coffee stains

The morning after a big snowstorm swept through the US northeast, I sat in my car, ready to brave hazardous road conditions and drive to the local coffee shop. My home in New Jersey was outside of the storm’s central path, so instead of piles of snow, we were greeted with a delightful wintry mix of sleet and freezing rain. And sitting in my car, I couldn’t help but be mesmerized by these strange patterns of ice particles forming on my windshield. Here’s what I saw:

As I watched this miniature world self-assemble on my windshield like an alien landscape, I wondered about the physics behind these patterns. I learned later that these patterns of ice are related to a rich and very active current area of research in math and physics known as universality. The key mathematical principles that belie these intricate patterns lead us to some unexpected places, such as coffee rings, growth patterns in bacterial colonies, and the wake of a flame as it burns through cigarette paper.

Let’s start with a simple example. Imagine a game similar to Tetris, but where you only have one kind of block – a 1 x 1 square. These identical blocks fall at random, like raindrops. Here’s a question for you. What pattern of blocks would you expect to see building up at the bottom of the screen?

You might guess that since the blocks are falling randomly, you should end up with a smooth, uniform pile of blocks, like the piles of sand that collect on a beach. But this isn’t what happens. Instead, in our make-believe Tetris world, you end up with a rough, jagged skyline, where tall towers sit next to deep gaps. A tall stack of blocks is just as likely to sit next to a short stack as it is to sit next to another tall stack.

tetris

This doesn’t look much like what I saw on my windshield. For one thing, there aren’t any gaps or holes. But we’ll get to that later.

This Tetris world is an example of what’s known as a Poisson process, and I’ve written about these processes before. The main point is that randomness doesn’t mean uniformity. Instead, randomness is typically clumpy, just like the jagged skyline of Tetris blocks that you see above, or like the clusters of buzzbombs dropped over London in World War II.

This Tetris example might seem a bit abstract, so let me introduce you to a guy who takes abstract ideas and connects them to real-world examples. His name is Peter Yunker, and he’s a physicist at Harvard who’s also really into his coffee.

coffeestain
What’s the science behind these stains? Coffee stain typeface by Mark Mustaine

Yunker was curious about what causes these ring shaped coffee stains. In 1997, a group of physicists worked out the reason that coffee forms this ring. As a drop of coffee evaporates, liquid from the center rushes outwards to the edge of the drop, carrying coffee particles with it. The drop starts to flatten. Eventually, all you’re left with is a thin ring, as the coffee particles have all rushed to the edge of the drop. Here’s a (wonderfully trippy) video of work by Yunker’s team, showing what this process looks like.

What Yunker demonstrated is really pretty neat. He discovered that the reason that coffee makes a ring has to do with the shape of the coffee particles. Look at a drop of coffee under a microscope, and you’ll find tiny, round coffee particles suspended in water. If you zoom into the edge of an evaporating coffee drop, you’ll see coffee particles sliding past each other, just like the blocks in our Tetris world. In fact, Yunker demonstrated mathematically that the pattern of growth of these coffee particles exactly mirrors that of our randomly falling Tetris blocks!

And here’s the crazy thing. Yunker and his colleagues also discovered that if you replaced all the spherical coffee particles with new particles that are more elongated, sort of like ovals, then you get an entirely different pattern. Instead of a ring, you get a solid blotch. You can see this happening in the video above.

coffeeringblotch
If the coffee particles are round (spheres), you get a coffee ring, but if they’re oval (ellipsoids) you get a coffee blotch instead. Image Credit: Yunker et al (2011)

In one case you get a coffee ring, and in the other case you get a solid blotch. So why does tweaking the shape of the particle change the overall pattern of growth? To understand why the oval particles behave differently from the spherical ones, we first need to tweak our Tetris game. Let’s call the new version Sticky Tetris.

In sticky Tetris, a block keeps falling until it touches another block. As soon as the falling block touches another block, even if only from the side, it immediately sticks into place.

It’s a small modification to the rules, but it has a pretty big consequence. In regular Tetris, it takes very many blocks to fill a deep gap, in sticky Tetris, you can fill a gap with a single block. Very quickly, the height differences between towers start to even out. Instead of the jagged, rough skyline of our regular Tetris world, the skyline in the sticky Tetris world is more smooth.

stickytetris

That looks a lot more like the pattern on my windshield!

And here’s the point. While the spherical coffee particles behave like regular Tetris pieces, the oval shaped particles behave just like these sticky Tetris pieces. The moment an oval coffee particle touches another one, it sticks in place. Instead of the jagged skyline from before, you get this Swiss cheese like pattern, an intricate structures of sprawling filaments separated by holes and gaps.

Oval shaped coffee particles form blotches, mirroring the intricate patterns formed by sticky Tetris blocks. Image credit: Felice Macera

So here we have essentially two distinct kinds of growth processes. On the one hand we have things that accumulate like Tetris blocks, or like particle of coffee in a coffee ring. Here’s an animation of real data from Yunker’s lab showing what this looks like.

poissoncoffee

On the other hand, we have things that accumulate like Sticky Tetris blocks or like oval shaped coffee particles. The growth of these particles looks like this (again, this is real data).

KPZcoffeeIt’s clear that these are two qualitatively different kinds of patterns.

But it’s also a quantitative difference. Remember that in the Tetris world, you end up with a jagged skyline, while in the sticky Tetris world, the skyline is more smooth. By studying how the topmost layer of particles (the skyline) widens over time, physicists can classify growth processes into different categories. In the jargon of the field, processes that grow at different rates really belong into different Universality Classes.

powerlaws
If the skyline of a growth process widens according to the blue curve, it falls into the same universality class as Tetris. If it widens according to the purple curve, it falls into the same universality class as Sticky Tetris.

You can think of universality classes like a sort of mathematical filing cabinet. Say that you’re studying how ice particles clunk together on your windshield. If the rate at which the skyline widens matches the blue curve above, ice clunking is in the same universality class as Tetris. If it matches the purple curve, then ice clunking is in the same universality class as Sticky Tetris. Now, there are other universality classes out there, and not all growth processes can be neatly filed into a universality class. But the key point is that many seemingly different physical systems, when analyzed mathematically, show identical patterns of growth. This slightly mysterious tendency for very different things to behave in very similar ways is the essence of universality.

What’s more, there is a rich mathematical theory behind this sticky Tetris universality class, described by an equation known as the Kardar–Parisi–Zhang (KPZ) equation. To give you a sense of how current this research is, it was as late as 2010 that mathematicians managed to prove that this KPZ equation is in the same universality class as sticky Tetris.

These deep connections between coffee rings and the KPZ equation took Peter Yunker by surprise. In Yunker’s words, “Alexei Borodin, a mathematician from MIT, contacted us after we published a paper on how particle shape affects particle deposition regarding the coffee-ring effect. He saw our experimental videos online and was reminded of simulations that he has performed. I think this is a great example of the value of reaching out across disciplines – we never would have studied this topic without Alexei bringing it to our attention.”

And this sticky Tetris universality class has turned up in all sorts of odd places. One example involves burning paper. A physics experiment in 1997 took sheets of copier paper, carefully lit them on fire from one end, and recorded the flame front as it burnt through the paper. Here’s a sketch of what they saw. You’re looking at multiple snapshots of the flame, as it burns through the paper.

slowburn
Snapshots of a flame as it burns through copier paper. J. Maunuksela et al., Phys. Rev. Lett. 79, 1515 (1997).

As the flame burns through the paper, it develops a smooth, wavy pattern. And when the physicists studied the growth of this flame front in detail, they found that it exactly matches the predictions of the KPZ equation. They repeated their experiment using cigarette paper as well as copier paper, and saw the same results. In their words, “The second set of experiments on the cigarette paper gave results consistent with those for the copier paper despite the fact that the cigarette paper is strongly anisotropic and may contain nontrivial correlations.” (Always gotta watch out for those nontrivial correlations in cigarette paper.)

And another example that’s pretty neat and unexpected – bacterial colonies. A team of Japanese physicists showed in 1997 that in certain nutrient conditions, the edge of a bacterial colony grows outwards in exactly the manner predicted by the KPZ (sticky Tetris) universality class. Here’s an animated gif of this in action, adapted from their paper. What you’re looking at is a zoomed in photograph of the edge of a bacterial colony, as it grows in a petri dish.

bacteria_opt

Now, if you think about it, there’s something deeply puzzling here. Bacterial colonies, travelling flames, and coffee particles are all totally different systems, and there’s no reason to expect that they should obey the same mathematical laws of growth. So what’s behind this mysterious universality? Why do such different beasts play by the same rules?

You might have noticed that all these examples look a little, well, fractal-esque. It turns out that the phenomenon of universality is intricately connected to the fact that these systems are each self-similar, like fractals. As I zoomed my camera into the ice particles on my windshield, the overall pattern looked basically the same. The same is true for the front of the flame, the edge of the bacterial colony, or the skyline of sticky Tetris. Here’s an example of a curve that’s self-similar (or scale-invariant, as physicists like to call it).

Fractals of the world, Unite! Self-similarity is at the heart of universality.

Surprisingly, this self-similarity implies that many of the nitty-gritty physics details of bacteria, flames, or coffee turn out to be irrelevant. According to Peter, “the fractal nature of these growth processes is essential to their universality. In order to be universal, a system cannot depend on its microscopic details, like particle size or typical interaction lengthscale. Thus, a universal system should be scale-invariant.”

Which brings me back to the ice particles on my windshield. They clumped together in these wonderfully fractal-esque patterns that, to my eye, looked a lot like sticky Tetris. I wanted to know if there’s a connection between these ice particles and the KPZ universality class. I put the question to Peter Yunker.

He responded, “These videos are fantastic. I agree with you that the underlying process occurring here appears quite similar to a KPZ process. However, this may be a great example of why it is difficult to identify KPZ processes in real experiments. The rearrangements of these structures have a strong effect on how the interface is developing. Thus, it is very unlikely that this system exhibits the same growth exponents as a KPZ process.”

It seems that the very piece of physics that makes these ice patterns short-lived is also what makes them so hard to study. And so, let me end with a very short video, a tiny meditation on the theme of growth and longevity. ;)

 

References

Coffee Stains Test Universal Equation. Physics 6, 7 (2013) – an excellent readable account on the research of Yunker, Yodh, Borodin and colleagues

In Mysterious Pattern, Math and Nature ConvergeNatalie Wolchover does a really great job of covering Universality from a totally different angle. If you’re not reading her stuff, you ought to!

Ace mathematician Terrence Tao has written a good explainer on Universality. It’s a long read that’s packed with insights.

Animated gifs of Tetris simulations and coffee deposition data were made with permission from data by Yunker et al. (2013)

Academic References

Effects of Particle Shape on Growth Dynamics at Edges of Evaporating Drops of Colloidal Suspensions. Yunker, Lohr, Still, Borodin, Durian and Yodh, Phys. Rev. Lett. 110, 035501 (2013)

Suppression of the coffee-ring effect by shape-dependent capillary interactions. Yunker, Still, Lohr and Yodh, Nature 476, 308–311 (2011)

The Kardar-Parisi-Zhang equation and universality class by Ivan Corwin – Although very mathematical, this an excellent and clearly written review of the KPZ equation and its connection to Universality, written by one of the experts in the field.

Self-Affinity for the Growing Interface of Bacterial Colonies. Wakita, Itoh, Matsuyama and Matsushita, J. Phys. Soc. Jpn. 66 (1997)

Kinetic Roughening in Slow Combustion of Paper. Maunuksela, Myllys, Kähkönen, Timonen, Provatas, Alava and Ala-Nissila, Phys. Rev. Lett. 79, 1515–1518 (1997)

 

  • http://twitter.com/sciencemeandyou Darakhshan Mir

    So, in the coffee example, there are just two discrete states of “ovalness” of the coffee particles: spherical and oval. Wonder what happens when the “ovalness” of the coffee particles changes continuously and what effect this has on the coffee ring? Would be cool to look at a simulation that takes in the ovalness as a parameter and see the coffee ring change continuously? Would there be a sudden transition or does the ring change continuously?

    • http://www.empiricalzeal.com Aatish

      That’s a really interesting and, I suspect, very hard questiion. Here’s a partial answer – if you repeat the coffee experiment with particles that are extremely oval – so much so that they’re basically rods, then you get growth rates in a different Universality class, called the KPZQ class. You can read a bit more about it here: http://physics.aps.org/articles/v6/7

  • Parz in the Yukon

    The first video is blocked by EMI. Don’t do science with the radio on, and be thankful you haven’t triggered a “signature” drone strike.

  • http://www.facebook.com/ime.priimek Jaka Kranjc

    Excellent article! “As a drop of coffee evaporates, liquid from the center rushes outwards to the edge of the drop”. Why does this happen, it’s counterintuitive to me? I’d expect the surrounding liquid to rush inwards, towards the lower pressure area that the evaporation creates. Is there a strong interaction with the surface of the liquid and its tension comes into play?

    • http://andreas.com/ Andreas Ramos

      Yes, that’s a good question. Why would the particles go to the edge, not the center? Are the particle floating on top of the surface, and the surface of a water bubble is curved with a high center, and thus the particles move down (i.e., to the edge), where they collect?

      • http://twitter.com/fostytou Jon Frost

        I assume they are probably trying to “wick” to the water that is drying out due to increased cohesion at that edge. This is probably the natural motion that is disturbed by the oblong shape causing changes in the dynamic movement of the water molecules. It is probably similar to the inverse of watching silt in candle wax as the flame burns above it.

  • Yomero

    The rain and the background music n_n
    Thanks for this wonderful article.

  • http://andreas.com/ Andreas Ramos

    Aatish, look carefully. Coffee rings aren’t formed as you describe. Look at the bottom of a coffee cup. It’s not flat. There is a raised rim around the bottom. That’s what creates the circle. Nevertheless, you’re partly right. Look CAREFULLY at your photos of the coffee rings. Zoom in perhaps 200%. The ring has a light zone in its center and dark zones at its borders (both inner and outer border.) The rest of your explanation fits that result. I don’t have a chemistry beaker, but I suspect you could easily test this: dip the bottom of the beaker in coffee, set it on a glass surface, and let it dry. The coffee particles should move to the edges and form a coffee splot with dark border and a light center.

    • http://www.empiricalzeal.com Aatish

      Hi Andreas, thanks for your comment. On reading it, I realized that I was rather unclear in setting up my explanation of the coffee drying experiment.

      Here’s what I meant: take some coffee and spill it on a sheet of paper, in the shape of a circular drop. Now, for most substances, as the drop dries, it should leave a more-or-less uniformly colored circular stain. But in the case of coffee, the particles migrate to the periphery of the drop, and you’re left with a ring, not a circle. The important point that was unclear in my discussion as that there is no coffee mug involved that forces the ring shape – just spill some coffee on a surface, and you will see a ring spontaneously form.

  • ChingPing

    Here’s a question I’ve been wandering for a while now and its rather loosely related to this awesome post.
    Is there a pattern or formula for the way trees’ branches sway when wind flows through them?? I was watching this behaviour from my back yard for awhile and there seemed to be a type of pattern to it. Maybe something to do with how much force the wind exerts on the trees’ leaves and the elasticity of the wood itself etc. etc??

    • http://andreas.com/ Andreas Ramos

      Fascinating question. I know the force of wind on a surface is the square of the speed (see http://bit.ly/12PGJFQ). A tree branch is a fractal pattern. As you move from the tree trunk to the tip, the surface area drops. So the pressure per centimeter will also drop. But the branch also becomes more flexible as you move out. Which means the tip will move more, even though it has the least pressure.

  • Frolenarzt

    Hi, Aatish and thank you for article!
    I want to translate this post into Russian language and publish it on Russian-language geek-portal if you do not mind (with reference to the original of course).

    But there’s one thing that not clear for me.
    At first you wrote that shape of particles affect to whole pattern. But according to Peter Y. – to be universal “system cannot depend on its microscopic details”.
    So I didn’t understand how this fits and what conclusions we can make from this.
    Could you clarify this please?

    Thank you!

    • http://www.empiricalzeal.com Aatish

      Hi there. This is a really good question, and I’m not sure I can do justice to it. My understanding is that the shape of the particle can change what universality class it falls in because it changes the essential underlying physics involved – spherical particles slide past each other, while ellipsoidal particles stick, and rod shaped particles accumulate in a very different way.

      But, when you look at the equation that captures this underlying physics, it doesn’t depend on things like the size of the particles, or on a certain lengthscale (e.g. 1 cm), because if it did then these phenomena would be limited to just that scale of 1 cm. One reason that universality is widespread is that these underlying equations do not depend on particle size or on a certain lengthscale, which means that these behaviors can be reproduced in different systems at varied length scales (1 mm or 1 cm or 1 m..).

      Summary: some microscopic details (like shape) matter, because they can fundamentally alter the type of interaction, but others (like size) shouldn’t matter if the process really is universal.

      • Frolenarzt

        Well, seems that it’s true.
        This is what Peter Yunker wrote me:
        “This is a good question, which requires a linguistic balancing act to answer. In one context, the microscopic details are incredibly important. In another context, the microscopic details do not matter.

        Clearly, particle shape is important; this is obvious from watching the experimental videos Aatish posted. Spheres, slightly stretched particles, and highly stretched ellipsoids all behave differently. Particle shape is in fact the most important parameter in deciding which type of growth process will occur. In fact, the microscopic details set the rules that govern the growth process. In this context, the microscopic details matter.

        However, if you compare members of the same universality class, the microscopic details no longer matter. Their behaviors are indistinguishable. For example, Aatish showed a plot of the interface height for a burning piece of paper. However, if Aatish did not label this plot, it would be impossible to tell if it came from the burning paper experiment, our drying drop experiment, or any other experiment that observed a KPZ process. For any KPZ processes these plots would be indistinguishable. In this context, the microscopic details no longer matter.”

        And here is a translation – http://habrahabr.ru/post/173905/

        • http://www.empiricalzeal.com Aatish

          Brilliantly put! Thanks for sharing his response.

      • Frolenarzt

        And here is a translation – http://habrahabr.ru/post/173905/

        • http://www.empiricalzeal.com Aatish

          Thank you for translating this piece. I really appreciate your efforts!