Entropy

Definition

Fundamental Concept

Entropy (S): state function measuring system disorder or randomness. Units: joules per kelvin (J/K). Indicator of energy unavailable for work. Extensive property: depends on system size.

Thermodynamic State Function

Defined for equilibrium states only. Function of internal energy, volume, pressure, temperature. Independent of path taken between states.

Microscopic Interpretation

Represents number of microstates (Ω) corresponding to macrostate. Higher entropy = more microstates accessible. Link between macroscopic thermodynamics and microscopic configurations.

Historical Background

Rudolf Clausius (1850s)

Introduced entropy concept. Defined as integral of heat transfer over temperature in reversible processes. Established second law formulation based on entropy change.

Ludwig Boltzmann (1870s)

Connected entropy to molecular statistics. Boltzmann's entropy formula: S = k_B ln(Ω). Provided statistical mechanics foundation.

Development Timeline

Initial thermodynamic formulations refined to include statistical basis. Entropy became central to understanding irreversibility and the arrow of time.

Thermodynamic Interpretation

Second Law of Thermodynamics

Entropy of isolated system never decreases. ΔS ≥ 0 for spontaneous processes. Equality holds in reversible processes.

Reversible vs Irreversible Processes

Reversible: ΔS_sys + ΔS_sur = 0. Irreversible: ΔS_sys + ΔS_sur > 0. Real processes generate entropy.

Entropy and Energy Quality

Entropy increase implies decrease in energy quality. Work potential lost as entropy rises. Heat flow direction dictated by entropy gradient.

Statistical Mechanics

Microstates and Macrostates

Macrostate: macroscopic parameters (P, V, T). Microstate: specific molecular configuration. Entropy quantifies microstate multiplicity.

Boltzmann's Entropy Formula

S = k_B ln(Ω)

k_B: Boltzmann constant (1.380649×10⁻²³ J/K). Ω: number of microstates consistent with macrostate.

Gibbs Entropy

S = -k_B Σ p_i ln(p_i)

p_i: probability of ith microstate. Generalized entropy for non-equilibrium and mixed states.

Relationship with Second Law

Entropy as Second Law Quantifier

Second law states entropy of isolated system increases or remains constant. Entropy rise defines process direction.

Mathematical Statement

ΔS_total = ΔS_system + ΔS_surroundings ≥ 0

Equality for reversible, inequality for irreversible.

Practical Implications

Limits efficiency of heat engines. Governs feasibility of chemical reactions and phase transitions.

Entropy Change Calculations

Reversible Heat Transfer

ΔS = ∫(δQ_rev / T). Integration over reversible path.

Ideal Gas Entropy Change

ΔS = nC_V ln(T₂/T₁) + nR ln(V₂/V₁)

n: moles, C_V: heat capacity at constant volume, R: gas constant.

Entropy of Phase Changes

ΔS = ΔH_transition / T_transition, where ΔH is enthalpy change at phase change temperature.

Entropy in Isolated Systems

Definition of Isolated Systems

No exchange of matter or energy with surroundings. Total energy and mass fixed.

Entropy Evolution

Entropy can only increase or remain constant (ΔS ≥ 0). Systems evolve toward thermodynamic equilibrium.

Equilibrium State

Maximum entropy state. No net macroscopic flows or gradients. Represents most probable macrostate.

Irreversibility and Entropy

Sources of Irreversibility

Friction, unrestrained expansion, mixing, heat transfer across finite temperature difference, chemical reactions.

Entropy Generation

Entropy produced internally (S_gen ≥ 0). Total entropy change includes system and surroundings.

Quantifying Irreversibility

ΔS_total = ΔS_system + ΔS_surroundings = S_gen ≥ 0

S_gen = 0 only for ideal reversible processes.

Entropy Units and Measurement

SI Units

Joule per kelvin (J/K) standard. Extensive property scales with system size.

Measurement Techniques

Calorimetric methods: measure ΔQ_rev and T. Spectroscopic and statistical methods for molecular systems.

Standard Entropy Values

Absolute entropy of substances tabulated at standard conditions. Used as reference for thermodynamic calculations.

Applications

Thermodynamic Efficiency

Determines maximum work output of engines. Carnot efficiency limited by entropy increase.

Chemical Reactions

Predicts spontaneity via Gibbs free energy (ΔG = ΔH - TΔS). Entropy contribution critical in reaction feasibility.

Information Theory

Entropy analogous to information uncertainty. Measures information content and data compression limits.

Biological Systems

Describes molecular disorder, protein folding, and metabolic energy transformations.

Material Science

Phase stability and transitions governed by entropy and enthalpy balance.

Common Misconceptions

Entropy as Disorder Only

Oversimplified interpretation. Entropy linked to microstate probability, not just “chaos.”

Entropy Always Increases

True only for isolated systems. Open systems can decrease entropy locally with external energy input.

Entropy and Time

Entropy increase gives arrow of time direction but does not define time itself.

Mathematical Formulations

Clausius Inequality

∮ (δQ / T) ≤ 0

Integral over closed cycle. Equality for reversible cycles.

Entropy Differential

dS = δQ_rev / T

Exact differential for state function S.

Combined First and Second Law

dU = TdS - PdV

Internal energy differential in terms of entropy and volume changes.

References

• Clausius, R., "On the Moving Force of Heat and the Laws Regarding the Nature of Heat Itself," Annalen der Physik, vol. 125, 1850, pp. 353–400.
• Boltzmann, L., "Further Studies on the Thermal Equilibrium of Gas Molecules," Sitzungsberichte der Kaiserlichen Akademie der Wissenschaften, vol. 66, 1877, pp. 275–370.
• Callen, H.B., "Thermodynamics and an Introduction to Thermostatistics," 2nd ed., Wiley, 1985, pp. 80–105.
• Gibbs, J.W., "On the Equilibrium of Heterogeneous Substances," Transactions of the Connecticut Academy of Arts and Sciences, vol. 3, 1876, pp. 108–248.
• Atkins, P., de Paula, J., "Physical Chemistry," 10th ed., Oxford University Press, 2014, pp. 150–180.