Tag Archives: thermodynamics

Entropy, the most important pattern in life

12 Replies

One evening at the Princeton grad college a younger fellow (an 18-year-old genius) asked the most simple, elegant question I had ever heard, one I’ve borrowed and used ever since: “tell me”, he asked, “something that’s important and true.” My answer that evening was that the entropy of the universe is always increasing. It’s a fundamentally important pattern in life; one I didn’t discover, but discovered to have a lot of applications and meaning. Let me explain why it’s true here, and then why I find it’s meaningful.

Famous entropy cartoon, Harris

Famous entropy cartoon, Harris

The entropy of the universe is not something you can measure directly, but rather indirectly, from the availability of work in any corner of it. It’s related to randomness and the arrow of time. First off, here’s how you can tell if time is moving forward: put an ice-cube into hot water, if the cube dissolves and the water becomes cooler, time is moving forward — or, at least it’s moving in the same direction as you are. If you can reach into a cup of warm water and pull out an ice-cube while making the water hot, time is moving backwards. — or rather, you are living backwards. Within any closed system, one where you don’t add things or energy (sunlight say), you can tell that time is moving forward because the forward progress of time always leads to the lack of availability of work. In the case above, you could have generated some electricity from the ice-cube and the hot water, but not from the glass of warm water.

You can not extract work from a heat source alone; to extract work some heat must be deposited in a cold sink. At best the entropy of the universe remains unchanged. More typically, it increases.

You can not extract work from a heat source alone; to extract work some heat must be deposited in a cold sink. At best the entropy of the universe remains unchanged.

This observation is about as fundamental as any to understanding the world; it is the basis of entropy and the second law of thermodynamics: you can never extract useful work from a uniform temperature body of water, say, just by making that water cooler. To get useful work, you always need something some other transfer into or out of the system; you always need to make something else hotter, colder, or provide some chemical or altitude changes that can not be reversed without adding more energy back. Thus, so long as time moves forward everything runs down in terms of work availability.

There is also a first law; it states that energy is conserved. That is, if you want to heat some substance, that change requires that you put in a set amount of work plus heat. Similarly, if you want to cool something, a set amount of heat + work must be taken out. In equation form, we say that, for any change, q +w is constant, where q is heat, and w is work. It’s the sum that’s constant, not the individual values so long as you count every 4.174 Joules of work as if it were 1 calorie of heat. If you input more heat, you have to add less work, and visa versa, but there is always the same sum. When adding heat or work, we say that q or w is positive; when extracting heat or work, we say that q or w are negative quantities. Still, each 4.174 joules counts as if it were 1 calorie.

Now, since for every path between two states, q +w is the same, we say that q + w represents a path-independent quantity for the system, one we call internal energy, U where ∆U = q + w. This is a mathematical form of the first law of thermodynamics: you can’t take q + w out of nothing, or add it to something without making a change in the properties of the thing. The only way to leave things the same is if q + w = 0. We notice also that for any pure thing or mixture, the sum q +w for the change is proportional to the mass of the stuff; we can thus say that internal energy is an intensive quality. q + w = n ∆u where n is the grams of material, and ∆u is the change in internal energy per gram.

We are now ready to put the first and second laws together. We find we can extract work from a system if we take heat from a hot body of water and deliver some of it to something at a lower temperature (the ice-cube say). This can be done with a thermopile, or with a steam engine (Rankine cycle, above), or a stirling engine. That an engine can only extract work when there is a difference of temperatures is similar to the operation of a water wheel. Sadie Carnot noted that a water wheel is able to extract work only when there is a flow of water from a high level to low; similarly in a heat engine, you only get work by taking in heat energy from a hot heat-source and exhausting some of it to a colder heat-sink. The remainder leaves as work. That is, q1 -q2 = w, and energy is conserved. The second law isn’t violated so long as there is no way you could run the engine without the cold sink. Accepting this as reasonable, we can now derive some very interesting, non-obvious truths.

We begin with the famous Carnot cycle. The Carnot cycle is an idealized heat engine with the interesting feature that it can be made to operate reversibly. That is, you can make it run forwards, taking a certain amount of work from a hot source, producing a certain amount of work and delivering a certain amount of heat to the cold sink; and you can run the same process backwards, as a refrigerator, taking in the same about of work and the same amount of heat from the cold sink and delivering the same amount to the hot source. Carnot showed by the following proof that all other reversible engines would have the same efficiency as his cycle and no engine, reversible or not, could be more efficient. The proof: if an engine could be designed that will extract a greater percentage of the heat as work when operating between a given hot source and cold sink it could be used to drive his Carnot cycle backwards. If the pair of engines were now combined so that the less efficient engine removed exactly as much heat from the sink as the more efficient engine deposited, the excess work produced by the more efficient engine would leave with no effect besides cooling the source. This combination would be in violation of the second law, something that we’d said was impossible.

Now let us try to understand the relationship that drives useful energy production. The ratio of heat in to heat out has got to be a function of the in and out temperatures alone. That is, q1/q2 = f(T1, T2). Similarly, q2/q1 = f(T2,T1) Now lets consider what happens when two Carnot cycles are placed in series between T1 and T2, with the middle temperature at Tm. For the first engine, q1/qm = f(T1, Tm), and similarly for the second engine qm/q2 = f(Tm, T2). Combining these we see that q1/q2 = (q1/qm)x(qm/q2) and therefore f(T1, T2) must always equal f(T1, Tm)x f(Tm/T2) =f(T1,Tm)/f(T2, Tm). In this relationship we see that the second term Tm is irrelevant; it is true for any Tm. We thus say that q1/q2 = T1/T2, and this is the limit of what you get at maximum (reversible) efficiency. You can now rearrange this to read q1/T1 = q2/T2 or to say that work, W = q1 – q2 = q2 (T1 – T2)/T2.

A strange result from this is that, since every process can be modeled as either a sum of Carnot engines, or of engines that are less-efficient, and since the Carnot engine will produce this same amount of reversible work when filled with any substance or combination of substances, we can say that this outcome: q1/T1 = q2/T2 is independent of path, and independent of substance so long as the process is reversible. We can thus say that for all substances there is a property of state, S such that the change in this property is ∆S = ∑q/T for all the heat in or out. In a more general sense, we can say, ∆S = ∫dq/T, where this state property, S is called the entropy. Since as before, the amount of heat needed is proportional to mass, we can say that S is an intensive property; S= n s where n is the mass of stuff, and s is the entropy change per mass. 

Another strange result comes from the efficiency equation. Since, for any engine or process that is less efficient than the reversible one, we get less work out for the same amount of q1, we must have more heat rejected than q2. Thus, for an irreversible engine or process, q1-q2 < q2(T1-T2)/T2, and q2/T2 is greater than -q1/T1. As a result, the total change in entropy, S = q1/T1 + q2/T2 >0: the entropy of the universe always goes up or stays constant. It never goes down. Another final observation is that there must be a zero temperature that nothing can go below or both q1 and q2 could be positive and energy would not be conserved. Our observations of time and energy conservation leaves us to expect to find that there must be a minimum temperature, T = 0 that nothing can be colder than. We find this temperature at -273.15 °C. It is called absolute zero; nothing has ever been cooled to be colder than this, and now we see that, so long as time moves forward and energy is conserved, nothing will ever will be found colder.

Typically we either say that S is zero at absolute zero, or at room temperature.

We’re nearly there. We can define the entropy of the universe as the sum of the entropies of everything in it. From the above treatment of work cycles, we see that this total of entropy always goes up, never down. A fundamental fact of nature, and (in my world view) a fundamental view into how God views us and the universe. First, that the entropy of the universe goes up only, and not down (in our time-forward framework) suggests there is a creator for our universe — a source of negative entropy at the start of all things, or a reverser of time (it’s the same thing in our framework). Another observation, God likes entropy a lot, and that means randomness. It’s his working principle, it seems.

But before you take me now for a total libertine and say that since science shows that everything runs down the only moral take-home is to teach: “Let us eat and drink,”… “for tomorrow we die!” (Isaiah 22:13), I should note that his randomness only applies to the universe as a whole. The individual parts (planets, laboratories, beakers of coffee) does not maximize entropy, but leads to a minimization of available work, and this is different. You can show that the maximization of S, the entropy of the universe, does not lead to the maximization of s, the entropy per gram of your particular closed space but rather to the minimization of a related quantity µ, the free energy, or usable work per gram of your stuff. You can show that, for any closed system at constant temperature, µ = h -Ts where s is entropy per gram as before, and h is called enthalpy. h is basically the potential energy of the molecules; it is lowest at low temperature and high order. For a closed system we find there is a balance between s, something that increases with increased randomness, and h, something that decreases with increased randomness. Put water and air in a bottle, and you find that the water is mostly on the bottom of the bottle, the air is mostly on the top, and the amount of mixing in each phase is not the maximum disorder, but rather the one you’d calculate will minimize µ.

As the protein folds its randomness and entropy decrease, but its enthalpy decreases too; the net effect is one precise fold that minimizes µ.

As a protein folds its randomness and entropy decrease, but its enthalpy decreases too; the net effect is one precise fold that minimizes µ.

This is the principle that God applies to everything, including us, I’d guess: a balance. Take protein folding; some patterns have big disorder, and high h; some have low disorder and very low h. The result is a temperature-dependent  balance. If I were to take a moral imperative from this balance, I’d say it matches better with the sayings of Solomon the wise: “there is nothing better for a person under the sun than to eat, drink and be merry. Then joy will accompany them in their toil all the days of the life God has given them under the sun.” (Ecclesiastes 8:15). There is toil here as well as pleasure; directed activity balanced against personal pleasures. This is the µ = h -Ts minimization where, perhaps, T is economic wealth. Thus, the richer a society, the less toil is ideal and the more freedom. Of necessity, poor societies are repressive. 

Dr. Robert E. Buxbaum, Mar 18, 2014. My previous thermodynamic post concerned the thermodynamics of hydrogen production. It’s not clear that all matter goes forward in time, by the way; antimatter may go backwards, so it’s possible that anti matter apples may fall up. On microscopic scale, time becomes flexible so it seems you can make a time machine. Religious leaders tend to be anti-science, I’ve noticed, perhaps because scientific miracles can be done by anyone, available even those who think “wrong,” or say the wrong words. And that’s that, all being heard, do what’s right and enjoy life too: as important a pattern in life as you’ll find, I think. The relationship between free-energy and societal organization is from my thesis advisor, Dr. Ernest F. Johnson.

Nerves are tensegrity structures and grow when pulled

Leave a reply

No one quite knows how nerve cells learn stuff. It is incorrectly thought that you can not get new nerves in the brain, nor that you can get brain cells to grow out further, but people have made new nerve cells, and when I was a professor at Michigan State, a Physiology colleague and I got brain and sensory nerves to grow out axons by pulling on them without the use of drugs.

I had just moved to Michigan State as a fresh PhD (Princeton) as an assistant professor of chemical engineering. Steve Heidemann was a few years ahead of me, a Physiology professor PhD from Princeton. We were both new Yorkers. He had been studying nerve structure, and wondered about how the growth cone makes nerves grow out axons (the axon is the long, stringy part of the nerve). A thought was that nerves were structured as Snelson-Fuller tensegrity structures, but it was not obvious how that would relate to growth or anything else. A Snelson-Fuller structure is shown below the structure stands erect not by compression, as in a pyramid or igloo, but rather because tension in the wires helps lift the metal pipes, and puts them in compression. The nerve cell, shown further below is similar with actin-protein as the outer, tensed skin, and a microtubule-protein core as the compress pipes. 

A Snelson-Fuller tensegrity sculpture in the graduate college courtyard at Princeton, where Steve and I got our PhDs

A Snelson-Fuller tensegrity sculpture in the graduate college courtyard at Princeton, an inspiration for our work.

Biothermodynamics was pretty basic 30 years ago (It still is today), and it was incorrectly thought that objects were more stable when put in compression. It didn’t take too much thermodynamics on my part to show otherwise, and so I started a part-time career in cell physiology. Consider first how mechanical force should affect the Gibbs free energy, G, of assembled microtubules. For any process at constant temperature and pressure, ∆G = work. If force is applied we expect some elastic work will be put into the assembled Mts in an amount  ∫f dz, where f is the force at every compression, and ∫dz is the integral of the distance traveled. Assuming a small force, or a constant spring, f = kz with k as the spring constant. Integrating the above, ∆G = ∫kz dz = kz2; ∆G is always positive whether z is positive or negative, that is the microtubule is most stable with no force, and is made less stable by any force, tension or compression. 

A cell showing what appears to be tensegrity. The microtubules in green surrounded by actin in red. If the actin is under tension the microtubules are in compression. From here.

A cell showing what appears to be tensegrity. The microtubules (green) surrounded by actin (red). In nerves Heidemann and I showed actin is in tension the microtubules in compression.

Assuming that microtubules in the nerve- axon are generally in compression as in the Snelson-Fuller structure, then pulling on the axon could potentially reduce the compression. Normally, this is done by a growth cone, we posited, but we could also do it by pulling. In either case, a decrease in the compression of the assembled microtubules should favor microtubule assembly.

To calculate the rates, I used absolute rate theory, something I’d learned from Dr. Mortimer Kostin, a most-excellent thermodynamics professor. I assumed that the free energy of the monomer was unaffected by force, and that the microtubules were in pseudo- equilibrium with the monomer. Growth rates were predicted to be proportional to the decrease in G, and the prediction matched experimental data. 

Our few efforts to cure nerve disease by pulling did not produce immediate results; it turns out to by hard to pull on nerves in the body. Still, we gained some publicity, and a variety of people seem to have found scientific and/or philosophical inspiration in this sort of tensegrity model for nerve growth. I particularly like this review article by Don Ingber in Scientific American. A little more out there is this view of consciousness life and the fate of the universe (where I got the cell picture). In general, tensegrity structures are more tough and flexible than normal construction. A tensegrity structure will bend easily, but rarely break. It seems likely that your body is held together this way, and because of this you can carry heavy things, and still move with flexibility. It also seems likely that bones are structured this way; as with nerves; they are reasonably flexible, and can be made to grow by pulling.

Now that I think about it, we should have done more theoretical or experimental work in this direction. I imagine that  pulling on the nerve also affects the stability of the actin network by affecting the chain configuration entropy. This might slow actin assembly, or perhaps not. It might have been worthwhile to look at new ways to pull, or at bone growth. In our in-vivo work we used an external magnetic field to pull. We might have looked at NASA funding too, since it’s been observed that astronauts grow in outer space by a solid inch or two, and their bodies deteriorate. Presumably, the lack of gravity causes the calcite in the bones to grow, making a person less of a tensegrity structure. The muscle must grow too, just to keep up, but I don’t have a theory for muscle.

Robert Buxbaum, February 2, 2014. Vaguely related to this, I’ve written about architecture, art, and mechanical design.

Thermodynamics of hydrogen generation

7 Replies

Perhaps the simplest way to make hydrogen is by electrolysis: you run some current through water with a little sulfuric acid or KOH added, and for every two electrons transferred, you get a molecule of hydrogen from one electrode and half a molecule of oxygen from the other.

2 OH- –> 2e- + 1/2 O2 +H2O

2H2O + 2e- –>  H2 + 2OH-

The ratio between amps, seconds and mols of electrons (or hydrogen) is called the Faraday constant, F = 96500; 96500 amp-seconds transfers a mol of electrons. For hydrogen production, you need 2 mols of electrons for each mol of hydrogen, n= 2, so

it = 2F where and i is the current in amps, and t is the time in seconds and n is the number electrons per molecule of desired product. For hydrogen, t = 96500*2/i; in general, t = Fn/i.

96500 is a large number, and it takes a fair amount of time to make any substantial amount of hydrogen by electrolysis. At 1 amp, it takes 96500*2 = 193000 seconds, 2 days, to generate one mol of hydrogen (that’s 2 grams H2 or 22.4 liters, enough to fill a garment bag). We can reduce the time by using a higher current, but there are limits. At 25 amps, the maximum current of you can carry with house wiring it takes 2.14 hours to generate 2 grams. (You’ll have to rectify your electricity to DC or you’ll get a nasty H2 /O2 mix called Brown’s gas, While normal H2 isn’t that dangerous, Browns gas is a mix of H2 and O2 and is quite explosive. Here’s an essay I wrote on separating Browns gas).

Electrolysis takes a fair amount of electric energy too; the minimum energy needed to make hydrogen at a given temperature and pressure is called the reversible energy, or the Gibbs free energy ∆G of the reaction. ∆G = ∆H -T∆S, that is, ∆G equals the heat of hydrogen production ∆H – minus an entropy effect, T∆S. Since energy is the product of voltage current and time, Vit = ∆G, where ∆G is the Gibbs free energy measured in Joules and V,i, and t are measured Volts, Amps, and seconds respectively.

Since it = nF, we can rewrite the relationship as: V =∆G/nF for a process that has no energy losses, a reversible process. This is the form found in most thermodynamics textbooks; the value of V calculated this way is the minimum voltage to generate hydrogen, and the maximum voltage you could get in a fuel cell putting water back together.

To calculate this voltage, and the power requirements to make hydrogen, we use the Gibbs free energy for water formation found in Wikipedia, copied below (in my day, we used the CRC Handbook of Chemistry and Physics or a table in out P-chem book). You’ll notice that there are two different values for ∆G depending on whether the water is a gas or a liquid, and you’ll notice a small zero at the upper right (∆G°). This shows that the values are for an imaginary standard state: 20°C and 1 atm pressure. You can’t get 1 atm steam at 20°C, it’s an extrapolation; behavior at typical temperatures, 40°C and above is similar but not identical. I’ll leave it to a reader to send this voltage as a comment.

Liquid H2O formation ∆G° = -237.14
Gaseous H2O formation ∆G° = -228.61

The reversible voltage for creating liquid water in a reversible fuel cell is found to be -237,140/(2 x 96,500) = -1.23V. We find that 1.23 Volts is about the minimum voltage you need to do electrolysis at 0°C because you need liquid water to carry the current; -1.18 V is about the maximum voltage you can get in a fuel cell because they operate at higher temperature with oxygen pressures significantly below 1 atm. (typically). The minus sign is kept for accounting; it differentiates the power out case (fuel cells) from power in (electrolysis). It is typical to find that fuel cells operate at lower voltages, between about .5V and 1.0V depending on the fuel cell and the power load.

Most electrolysis is done at voltages above about 1.48 V. Just as fuel cells always give off heat (they are exothermic), electrolysis will absorb heat if run reversibly. That is, electrolysis can act as a refrigerator if run reversibly. but electrolysis is not a very good refrigerator (the refrigerator ability is tied up in the entropy term mentioned above). To do electrolysis at reasonably fast rates, people give up on refrigeration (sucking heat from the environment) and provide all the entropy needed for electrolysis in the electricity they supply. This is to say, they operate at V’ were nFV’ ≥ ∆H, the enthalpy of water formation. Since ∆H is greater than ∆G, V’ the voltage for electrolysis is higher than V. Based on the enthalpy of liquid water formation,  −285.8 kJ/mol we find V’ = 1.48 V at zero degrees. The figure below shows that, for any reasonably fast rate of hydrogen production, operation must be at 1.48V or above.

Electrolyzer performance; C-Pt catalyst on a thin, nafion membrane

Electrolyzer performance; C-Pt catalyst on a thin, nafion membrane

If you figure out the energy that this voltage and amperage represents (shown below) you’re likely to come to a conclusion I came to several years ago: that it’s far better to generate large amounts of hydrogen chemically, ideally from membrane reactors like my company makes.

The electric power to make each 2 grams of hydrogen at 1.5 volts is 1.5 V x 193000 Amp-s = 289,500 J = .080 kWh’s, or 0.9¢ at current rates, but filling a car takes 20 kg, or 10,000 times as much. That’s 800 kW-hr, or $90 at current rates. The electricity is twice as expensive as current gasoline and the infrastructure cost is staggering too: a station that fuels ten cars per hour would require 8 MW, far more power than any normal distributor could provide.

By contrast, methanol costs about 2/3 as much as gasoline, and it’s easy to deliver many giga-joules of methanol energy to a gas station by truck. Our company’s membrane reactor hydrogen generators would convert methanol-water to hydrogen efficiently by the reaction CH3OH + H2O –> 3H2 + CO2. This is not to say that electrolysis isn’t worthwhile for lower demand applications: see, e.g.: gas chromatography, and electric generator cooling. Here’s how membrane reactors work.

R. E. Buxbaum July 1, 2013; Those who want to show off, should post the temperature and pressure corrections to my calculations for the reversible voltage of typical fuel cells and electrolysis.

How and why membrane reactors work

6 Replies

Here is a link to a 3 year old essay of mine about how membrane reactors work and how you can use them to get past the normal limits of thermodynamics. The words are good, as is the example application, but I think I can write a shorter version now. Also, sorry to say, when I wrote the essay I was just beginning to make membrane reactors; my designs have gotten simpler since.

At left, for example, is a more modern, high pressure membrane reactor design. A common size is  72 tube reactor assembly; high pressure. The area around the shell is used for heat transfer. Normally the reactor would sit with this end up, and the tube area filled or half-filled with catalyst, e.g. for the water gas shift reaction, CO + H2O –> CO2 + H2 or for the methanol reforming CH3OH + H2O –> 3H2 + CO2, or ammonia cracking 2NH3 –> N2 + 3H2. According to normal thermodynamics, the extent of reaction for these reactions will be negatively affected by pressure (WGS is unaffected). Separation of the hydrogen generally requires high pressure and a separate step or two. This setup combines the steps of reaction with separation, give you ultra high purity, and avoids the normal limitations of thermodynamics.

Once equilibrium is reached in a normal reactor, your only option to drive the reaction isby adjusting the temperature. For the WGS, you have to operate at low temperatures, 250- 300 °C, if you want high conversion, and you have to cool externally to remove the heat of reaction. In a membrane reactor, you can operate in your preferred temperature ranges and you don’t have to work so hard to remove, or add heat. Typically with a MR, you want to operate at high reactor pressures, and you want to extract hydrogen at a lower pressure. The pressure difference between the reacting gas and the extracted hydrogen allows you to achieve high reaction extents (high conversions) at any temperature. The extent is higher because you are continuously removing product – H2 in this case.

Here’s where we sell membrane reactors; we also sell catalyst and tubes.