logo AFST
From Boltzmann to random matrices and beyond
Annales de la Faculté des sciences de Toulouse : Mathématiques, Serie 6, Volume 24 (2015) no. 4, pp. 641-689.

These expository notes propose to follow, across fields, some aspects of the concept of entropy. Starting from the work of Boltzmann in the kinetic theory of gases, various universes are visited, including Markov processes and their Helmholtz free energy, the Shannon monotonicity problem in the central limit theorem, the Voiculescu free probability theory and the free central limit theorem, random walks on regular trees, the circular law for the complex Ginibre ensemble of random matrices, and finally the asymptotic analysis of mean-field particle systems in arbitrary dimension, confined by an external field and experiencing singular pair repulsion. The text is written in an informal style driven by energy and entropy. It aims to be recreative and to provide to the curious readers entry points in the literature, and connections across boundaries.

Ces notes d’exposition proposent de suivre, à travers différents domaines, quelques aspects du concept d’entropie. À partir du travail de Boltzmann en théorie cinétique des gas, plusieurs univers sont visités, incluant les processus de Markov et leur énergie libre de Helmholtz, le problème de Shannon de monotonie de l’entropie dans le théorème central limite, la théorie des probabilités libres de Voiculescu et le théorème central limite libre, les marches aléatoires sur les arbres réguliers, la loi du cercle pour l’ensemble de Ginibre complexe de matrices aléatoires, et enfin l’analyse asymptotique de systèmes de particules champ moyen en dimension arbitraire, confinées par un champ extérieur et subissant une répulsion singulière à deux corps. Le texte est écrit dans un style informel piloté par l’énergie et l’entropie. Il vise a être récréatif, à fournir aux lecteurs curieux des points d’entrée dans la littérature, et des connexions au delà des frontières.

Published online : 2016-01-21
@article{AFST_2015_6_24_4_641_0,
     author = {Djalil Chafa\"\i },
     title = {From Boltzmann to random matrices and beyond},
     journal = {Annales de la Facult\'e des sciences de Toulouse : Math\'ematiques},
     publisher = {Universit\'e Paul Sabatier, Toulouse},
     volume = {Ser. 6, 24},
     number = {4},
     year = {2015},
     pages = {641-689},
     language = {en},
     url={afst.centre-mersenne.org/item/AFST_2015_6_24_4_641_0/}
}
Chafaï, Djalil. From Boltzmann to random matrices and beyond. Annales de la Faculté des sciences de Toulouse : Mathématiques, Serie 6, Volume 24 (2015) no. 4, pp. 641-689. https://afst.centre-mersenne.org/item/AFST_2015_6_24_4_641_0/

[1] Ané (C), Blachère (S.), Chafaï (D.), Fougères (P.), Gentil (I.), Malrieu (F.), Roberto (C.), Scheffer (G.), with a preface by Bakry (D.) and Ledoux (M.).— Sur les inégalités de Sobolev logarithmiques, Panoramas et Synthèses 10, Société Mathématique de France (SMF), xvi+217p. (2000). | MR 1845806 | Zbl 0982.46026

[2] Artstein (S.), Ball (K. M.), Barthe (F.), and Naor (A.).— On the rate of convergence in the entropic central limit theorem, Probab. Theory Related Fields 129, no. 3, p. 381-390 (2004). | MR 2128238 | Zbl 1055.94004

[3] Artstein (S.), Ball (K. M.), Barthe (F.), and Naor (A.).— Solution of Shannon’s problem on the monotonicity of entropy, J. Amer. Math. Soc. 17, no. 4, p. 975-982 (electronic) (2004). | MR 2083473 | Zbl 1062.94006

[4] Arnold (A.), Carrillo (J. A.), Desvillettes (L.), Dolbeault (J.), Jüngel (A. J.), Lederman (C.), Markowich (P. A.), Toscani (G.), Villani (C.).— Entropies and equilibria of many-particle systems: an essay on recent research. Monatsh. Math. 142, no. 1-2, p. 35-43 (2004). | MR 2065020 | Zbl 1063.35109

[5] Anderson (G. W.), Guionnet (A.), and Zeitouni (O.).— An introduction to random matrices, Cambridge Studies in Advanced Mathematics, vol. 118, Cambridge University Press, Cambridge (2010). | MR 2760897 | Zbl 1184.15023

[6] Ameur (Y.), Hedenmalm (H.), and Makarov (N.).— Fluctuations of eigenvalues of random normal matrices, Duke Math. J. 159, no. 1, p. 31-81 (2011). | MR 2817648 | Zbl 1225.15030

[7] Baudoin (F.).— Bakry-Émery meet Villani, preprint arXiv:1308.4938

[8] Ben Arous (G.) and Zeitouni (O.).— Large deviations from the circular law, ESAIM Probab. Statist. 2, p. 123-134 (electronic) (1998). | | Numdam | MR 1660943 | Zbl 0916.60022

[9] Bessières (L.), Besson (G.), and Boileau (M.).— La preuve de la conjecture de Poincaré d’après G. Perelman, Images des math., CNRS (2006) http://images.math.cnrs.fr/La-preuve-de-la-conjecture-de.html | Zbl 1206.53069

[10] Bordenave (Ch.) and Caputo (P.).— Large deviations of empirical neighborhood distribution in sparse random graphs preprint arXiv:1308.5725 | MR 3405616

[11] Bordenave (Ch.) and Chafaï (D.).— Around the circular law, Probab. Surv. 9, p. 1-89 (2012). | MR 2908617 | Zbl 1243.15022

[12] Bordenave (Ch.), Chafaï (D.) and Caputo (P.).— Circular law theorem for random Markov matrices, Probability Theory and Related Fields, 152:3-4, p. 751-779 (2012). | MR 2892961 | Zbl 1242.15034

[13] Bordenave (Ch.), Chafaï (D.) , and Caputo (P.).— Spectrum of Markov generators on sparse random graphs. Comm. Pure Appl. Math. 67, no. 4, p. 621-669 (2014). | MR 3168123 | Zbl 1301.60093

[14] Bekerman (F.), Figalli (A.), Guionnet (A.).— Transport maps for Beta-matrix models and Universality, preprint arXiv:1311.2315

[15] Bodineau (Th.) and Guionnet (A.).— About the stationary states of vortex systems, Ann. Inst. H. Poincaré Probab. Statist. 35, no. 2, p. 205-237 (1999). | Numdam | MR 1678526 | Zbl 0920.60095

[16] Bakry (D.), Gentil (I.), and Ledoux (M.).— Analysis and Geometry of Markov Diffusion Operators, Springer (2014). | MR 3155209

[17] Bleher (P. M.) and Kuijlaars (A. B. J.).— Orthogonal polynomials in the normal matrix model with a cubic potential, Adv. Math. 230, no. 3, p. 1272-1321 (2012). | MR 2921180 | Zbl 1250.42079

[18] Bai (Z.-D.) and Silverstein (J. W.).— Spectral analysis of large dimensional random matrices, second ed., Springer Series in Statistics, Springer, New York (2010). | MR 2567175 | Zbl 1196.60002

[19] Berman (R. J.).— Determinantal point processes and fermions on complex manifolds: large deviations and bosonization, preprint arXiv:0812.4224, December 2008. | MR 3177931

[20] Biane (Ph.).— Free probability for probabilists, Quantum probability communications, Vol. XI (Grenoble, 1998), QP-PQ, XI, World Sci. Publ., River Edge, NJ, p. 55-71 (2003). | MR 2032363 | Zbl 1105.46045

[21] Bourgade (P.), Erdös (L.), Yau (H.-T).— Bulk universality of general β-ensembles with non-convex potential. J. Math. Phys. 53, 9, 095221, 19pp, (2012). | MR 2905803 | Zbl 1278.82032

[22] Chafaï (D.).— Aspects of large random Markov kernels. Stochastics 81, no. 3-4, p. 415-429 (2009). | MR 2549497 | Zbl 1186.60004

[23] Chafaï (D.).— Binomial-Poisson entropic inequalities and the M/M/ queue. ESAIM Probab. Stat. 10, p. 317-339 (2006). | Numdam | MR 2247924 | Zbl 1188.60047

[24] Chafaï (D.).— Entropies, convexity, and functional inequalities: on Φ-entropies and Φ-Sobolev inequalities, J. Math. Kyoto Univ. 44, no. 2, p. 325-363 (2004). | MR 2081075 | Zbl 1079.26009

[25] Cropper (W.).— Great physicists: The life and times of leading physicists from Galileo to Hawking, Oxford University Press (2001). | MR 1881344 | Zbl 0996.01015

[26] Caputo (P.), Dai Pra (P.), and Posta (G.).— Convex entropy decay via the Bochner-Bakry-Émery approach, Ann. Inst. H. Poincaré Probab. Statist. Volume 45, Number 3, p. 589-886 (2009). | Numdam | MR 2548501 | Zbl 1181.60142

[27] Chafaï (D.), Gozlan (N.), and Zitt (P.-A.).— First order global asymptotics for confined particles with singular pair repulsion, preprint arXiv:1304.7569 to appear in The Annals of Applied Probability. | MR 3262506 | Zbl 1304.82050

[28] Chafaï (D.) and Joulin (A.).— Intertwining and commutation relations for birth-death processes. Bernoulli 19, no. 5A, p. 1855-1879 (2013). | MR 3129037 | Zbl 1286.60084

[29] Caglioti (E.), Lions (P.-L.), Marchioro (C.), and Pulvirenti (M.).— A special class of stationary flows for two-dimensional Euler equations: a statistical mechanics description, Comm. Math. Phys. 143 (1992), no. 3, 501-525. and II, Comm. Math. Phys. 174, no. 2, p. 229-260 (1995). | MR 1145596 | Zbl 0840.76002

[30] Chafaï (D.) and Péché (S.).— A note on the second order universality at the edge of Coulomb gases on the plane, preprint arXiv:1310.0727, to appear in Journal of Statistical Physics. | Zbl 1303.82013

[31] Cover (Th. M.) and Thomas (J. A.).— Elements of information theory. Second edition. Wiley-Interscience [John Wiley & Sons], Hoboken, NJ, xxiv+748 pp. (2006). | MR 2239987 | Zbl 0762.94001

[32] Desvillettes (L.), Mouhot (C.), Villani (C.).— Celebrating Cercignani’s conjecture for the Boltzmann equation. Kinet. Relat. Models 4, no. 1, p. 277-294 (2011). | MR 2765747 | Zbl 1217.82064

[33] Dragnev (P. D.) and Saff (E. B.).— Riesz spherical potentials with external fields and minimal energy points separation, Potential Anal. 26, no. 2, p. 139-162 (2007). | MR 2276529 | Zbl 1115.31003

[34] Diaconis (P.), and Saloff-Coste (L.).— Logarithmic Sobolev inequalities for finite Markov chains, Ann. Appl. Probab. 6, no. 3, p. 695-750 (1996). | MR 1410112 | Zbl 0867.60043

[35] Dembo (A.) and Zeitouni (O.).— Large deviations techniques and applications. Corrected reprint of the second (1998) edition. Stochastic Modelling and Applied Probability, 38. Springer-Verlag, Berlin, xvi+396 pp. (2010). | MR 2571413 | Zbl 1177.60035

[36] Erdös (L.), Schlein (B.), Yau (H.-T).— Universality of random matrices and local relaxation flow. Invent. Math. 185, 1, p. 75-119 (2011). | MR 2810797 | Zbl 1225.15033

[37] Fermi (E.).— Thermodynamics, Dover, 1956, reprint of the 1936 original version.

[38] Forrester (P. J.).— Log-gases and random matrices, London Mathematical Society Monographs Series 34, Princeton University Press, xiv+791 (2010). | MR 2641363 | Zbl 1217.82003

[39] Frostman (O.).— Potentiel d’Équilibre et Capacité des Ensembles, Ph.D. thesis, Faculté des sciences de Lund (1935).

[40] Ginibre (J.).— Statistical ensembles of complex, quaternion, and real matrices. J. Mathematical Phys. 6, p. 440-449 (1965). | MR 173726 | Zbl 0127.39304

[41] Gross (L.).— Logarithmic Sobolev inequalities, Amer. J. Math. 97, no. 4, p. 1061-1083 (1975). | MR 420249 | Zbl 0318.46049

[42] Hardy (A.).— A note on large deviations for 2D Coulomb gas with weakly confining potential, Electron. Commun. Probab. 17, no. 19, 12 (2012). | MR 2926763 | Zbl 1258.60027

[43] Hough (B. J.), Krishnapur (M.), Peres (Y.), and Virág (B.).— Determinantal processes and independence, Probab. Surv. 3, p. 206-229 (2006). | MR 2216966 | Zbl 1189.60101

[44] Hough (B. J.), Krishnapur (M.), Peres (Y.), and Virág (B.).— Zeros of Gaussian analytic functions and determinantal point processes, University Lecture Series, vol. 51, American Mathematical Society, Providence, RI (2009). | MR 2552864 | Zbl 1190.60038

[45] Hora (A.) and Obata (N.).— Quantum probability and spectral analysis of graphs, Theoretical and Mathematical Physics, Springer, Berlin, With a foreword by Luigi Accardi (2007). | MR 2316893 | Zbl 1141.81005

[46] Hiai (F.) and Petz (D.).— The semicircle law, free random variables and entropy, Mathematical Surveys and Monographs, vol. 77, American Mathematical Society, Providence, RI (2000). | MR 1746976 | Zbl 0955.46037

[47] Johnson (O.).— Information theory and the central limit theorem, Imperial College Press, London, xiv+209 pp. (2004). | MR 2109042 | Zbl 1061.60019

[48] Jog (V.) and Anantharam (V.).— Convex Relative Entropy Decay in Markov Chains, to appear in the proceedings of the 48th Annual Conference on Information Sciences and Systems, CISS-2014, Princeton University, Princeton, NJ, March 19-21 (2014).

[49] Kullback (S.) and Leibler (R. A).— On information and sufficiency. Ann. Math. Statistics 22, p. 79-86 (1951). | MR 39968 | Zbl 0042.38403

[50] Khoruzhenko (B.) and Sommers (H. J.).— Non-Hermitian ensembles. The Oxford handbook of random matrix theory, p. 376-397, Oxford Univ. Press, Oxford (2011). | MR 2932638 | Zbl 1236.15069

[51] Kiessling (M. K.-H.) and Spohn (H.).— A note on the eigenvalue density of random matrices, Comm. Math. Phys. 199, no. 3, p. 683-695 (1999). | MR 1669669 | Zbl 0928.15015

[52] Kac (M.).— Probability and related topics in physical sciences. With special lectures by G. E. Uhlenbeck, A. R. Hibbs, and B. van der Pol. Lectures in Applied Mathematics. Proceedings of the Summer Seminar, Boulder, Colo. (1957), Vol. I Interscience Publishers, London-New York (1959) xiii+266 pp. | MR 102849 | Zbl 0087.33003

[53] Kesten (H.).— Symmetric random walks on groups, Trans. Amer. Math. Soc. 92, p. 336-354 (1959). | MR 109367 | Zbl 0092.33503

[54] Kiessling (M. K.-H.).— Statistical mechanics of classical particles with logarithmic interactions, Comm. Pure Appl. Math. 46, no. 1, p. 27-56 (1993). | MR 1193342 | Zbl 0811.76002

[55] Kullback (S.).— Information theory and statistics, Reprint of the second (1968) edition. Dover Publications. xvi+399 pp. (1997). | MR 1461541 | Zbl 0897.62003

[56] López García (A.).— Greedy energy points with external fields, Recent trends in orthogonal polynomials and approximation theory, Contemp. Math., vol. 507, Amer. Math. Soc., Providence, RI, p. 189-207 (2010). | MR 2647570 | Zbl 1203.31011

[57] Lott (J.) and Villani (C.).— Ricci curvature for metric-measure spaces via optimal transport, Ann. of Math. (2) 169, no. 3, p. 903-991 (2009). | MR 2480619 | Zbl 1178.53038

[58] Lewin (M.).— Limite de champ moyen et condensation de Bose-Einstein, Gazette des Mathématiciens, no. 139, p. 35-49 (2014). | MR 3183987

[59] Li (X.-D.).— From the Boltzmann H-theorem to Perelman’s W-entropy formula for the Ricci flow, preprint arXiv:1303.5193 | MR 3289419

[60] Lieb (E. H.).— Proof of an entropy conjecture of Wehrl, Comm. Math. Phys. 62, p. 35-41 (1978). | MR 506364 | Zbl 0385.60089

[61] Liggett (Th. M.).— Interacting particle systems, Classics in Mathematics, Springer-Verlag, Berlin, 2005, Reprint of the 1985 original. | MR 2108619 | Zbl 1103.82016

[62] Linnik (Ju. V.).— An information-theoretic proof of the central limit theorem with Lindeberg conditions, Theor. Probability Appl. 4, p. 288-299 (1959). | MR 124081 | Zbl 0097.13103

[63] Miclo (L.).— Remarques sur l’hypercontractivité et l’évolution de l’entropie pour des chaînes de Markov finies, Séminaire de Probabilités, XXXI, 136-167, Lecture Notes in Math. (1655), Springer, Berlin (1997). | Numdam | MR 1478724 | Zbl 0882.60065

[64] McKay (B. D.).— The expected eigenvalue distribution of a large regular graph, Linear Algebra and its Applications 40, p. 203-216 (1981). | MR 629617 | Zbl 0468.05039

[65] Messer (J.) and Spohn (H.).— Statistical mechanics of the isothermal Lane-Emden equation, J. Statist. Phys. 29, no. 3, p. 561-578 (1982). | MR 704588

[66] Montenegro (R. R.) and Tetali (P.).— Mathematical Aspects of Mixing Times in Markov Chains, Now Publishers Inc, p. 121 (2006). | MR 2341319

[67] Nelson (E.).— A quartic interaction in two dimensions, Mathematical Theory of Elementary Particles (Proc. Conf., Dedham, Mass., 1965), p. 69-73, M.I.T. Press, Cambridge, Mass. (1966). | MR 210416

[68] Ollivier (Y.).— Ricci curvature of Markov chains on metric spaces, J. Funct. Anal. 256, no. 3, p. 810-864 (2009). | MR 2484937 | Zbl 1181.53015

[69] Petz (D.) and Hiai (F.).— Logarithmic energy as an entropy functional, Advances in differential equations and mathematical physics (Atlanta, GA, 1997), Contemp. Math., vol. 217, Amer. Math. Soc., Providence, RI, p. 205-221 (1998). | MR 1606719 | Zbl 0893.15011

[70] Ramírez (J. A.), Rider (B.), Virág (B.), Beta ensembles, stochastic Airy spectrum, and a diffusion. J. Amer. Math. Soc. 24, no. 4, p. 919-944 (2011). | MR 2813333 | Zbl 1239.60005

[71] von Renesse (M.-K.) and Sturm (K.-T.).— Transport inequalities, gradient estimates, entropy, and Ricci curvature, Comm. Pure Appl. Math. 58, no. 7, p. 923-940 (2005). | MR 2142879 | Zbl 1078.53028

[72] Saff (E. B.) and Totik (V.).— Logarithmic potentials with external fields, Grundlehren der Mathematischen Wissenschaften [Fundamental Principles of Mathematical Sciences], vol. 316, Springer-Verlag, Berlin (1997), Appendix B by Thomas Bloom. | MR 1485778 | Zbl 0881.31001

[73] Shannon (C. E.) and Weaver (W.).— The Mathematical Theory of Communication, The University of Illinois Press, Urbana, Ill. (1949). | MR 32134 | Zbl 0126.35701

[74] Saloff-Coste (L.).— Lectures on finite Markov chains. Lectures on probability theory and statistics (Saint-Flour, 1996), p. 301-413, Lecture Notes in Math., 1665, Springer, Berlin (1997). | MR 1490046 | Zbl 0885.60061

[75] Seneta (E.).— Markov and the Birth of Chain Dependence, International Statistical Review 64, no. 3, p. 255-263 (1966). | Zbl 0918.60008

[76] Serfaty (S.).— Coulomb Gases and Ginzburg-Landau Vortices, preprint arXiv:1403.6860 | MR 3309890

[77] Serfaty (S.).— Ginzburg-Landau vortices, Coulomb gases, and renormalized energies, J. Stat. Phys. 154, no. 3, p. 660-680 (2014). | MR 3163544 | Zbl 1291.82142

[78] Shlyakhtenko (D.).— A free analogue of Shannon’s problem on monotonicity of entropy, Adv. Math. 208, no. 2, p. 824-833 (2007). | MR 2304337 | Zbl 1106.94015

[79] Shlyakhtenko (D.).— Shannon’s monotonicity problem for free and classical entropy, Proc. Natl. Acad. Sci. USA 104, no. 39, 15254-15258 (electronic), With an appendix by Hanne Schultz (2007). | MR 2346565 | Zbl 1191.46052

[80] Stam (A. J.).— Some inequalities satisfied by the quantities of information of Fisher and Shannon, Information and Control 2, p. 101-112 (1959). | MR 109101 | Zbl 0085.34701

[81] Tao (T.).— Topics in random matrix theory, Graduate Studies in Mathematics, vol. 132, American Mathematical Society, Providence, RI (2012). | MR 2906465 | Zbl 1256.15020

[82] Tao (T.) and Vu (V.).— Random matrices: universality of ESDs and the circular law. Ann. Probab. 38(5), p. 2023-2065. With an appendix by Manjunath Krishnapur (2010). | MR 2722794 | Zbl 1203.15025

[83] Tribus (M.) and McIrvine (E. C.).— Energy and information, Scientific American 225, no. 3, p. 179-188 (1971).

[84] Voiculescu (D.-V.), Dykema (K. J.), and Nica (A.).— Free random variables, CRM Monograph Series, vol. 1, American Mathematical Society, Providence, RI, 1992, A noncommutative probability approach to free products with applications to random matrices, operator algebras and harmonic analysis on free groups. | MR 1217253 | Zbl 0795.46049

[85] Villani (C.).— H-Theorem and beyond: Boltzmann’s entropy in today’s mathematics, Boltzmann’s legacy, ESI Lect. Math. Phys., Eur. Math. Soc., Zürich, p. 129-143 (2008). | MR 2509760 | Zbl 1156.82313

[86] Villani (C.).— Irreversibility and entropy, Time, Prog. Math. Phys. 63, p. 19-79, Birkhäuser/Springer (2013). | MR 3076094

[87] Voiculescu (D.-V.).— Free entropy, Bull. London Math. Soc. 34 (3), p. 257-278 (2002). | MR 1887698 | Zbl 1036.46051

[88] Wigner (E. P.).— On the distribution of the roots of certain symmetric matrices. Ann. of Math. (2) 67, p. 325-327 (1958). | MR 95527 | Zbl 0085.13203

[89] Zinsmeister (M.).— Thermodynamic formalism and holomorphic dynamical systems. Translated from the 1996 French original by C. Greg Anderson. SMF/AMS Texts and Monographs, 2. American Mathematical Society, Providence, RI; Société Mathématique de France, Paris, x+82 pp. (2000). | MR 1724307 | Zbl 0959.37003