The computation of nature: from the Ising model to generative learning

WANG Lei; ZHANG Pan

doi:10.7693/wl20250102

PHYSICS > 2025 > 54(1): 10-18. > DOI: 10.7693/wl20250102 CSTR: 32040.14.wl20250102

WANG Lei, ZHANG Pan. The computation of nature: from the Ising model to generative learning[J]. PHYSICS, 2025, 54(1): 10-18. DOI: 10.7693/wl20250102

Citation:

WANG Lei, ZHANG Pan. The computation of nature: from the Ising model to generative learning[J]. PHYSICS, 2025, 54(1): 10-18. DOI: 10.7693/wl20250102

Citation:

WANG Lei, ZHANG Pan. The computation of nature: from the Ising model to generative learning[J]. PHYSICS, 2025, 54(1): 10-18. DOI: 10.7693/wl20250102

PDF (7781 KB)

The computation of nature: from the Ising model to generative learning

WANG Lei^1, ,,
ZHANG Pan^2, ,

1 Institute of Physics, Chinese Academy of Sciences, Beijing 100190, China;
2 Institute of Theoretical Physics, Chinese Academy of Sciences, Beijing 100190, China

More Information

Received Date: January 09, 2025
Available Online: January 16, 2025

Graphical Abstract

Abstract

Abstract

The 2024 Nobel Prize in Physics was awarded to John Hopfield and Geoffrey Hinton, which came as a surprise to many people. In this introductory article, we will explore their major contributions from the perspective of statistical physics, starting with the Ising model. This includes the Hopfield model, Boltzmann machines, unsupervised learning, and modern generative models. The article will also review the exciting collaboration between statistical physics and machine learning at the end of the last century and provide a brief outlook on the future directions of the interdisciplinary field between physics and machine learning.
- Boltzmann machine,
- Hopfield model,
- Ising model,
- machine learning,
- statistical physics,
- generative model

FullText(HTML)

References (27)

References

[1]	The Nobel Prize in Physics 2024. https://www.nobelprize.org/prizes/physics/2024/summary/
[2]	They cracked the code for proteins’amazing structures. https://www.nobelprize.org/prizes/chemistry/2024/press-release/
[3]	Midjourney主页. https://www.midjourney.com/
[4]	WaveNet：A generative model for raw Audio. https://deepmind.google/discover/blog/wavenet-a-generative-model-for-raw-audio/
[5]	ChatGPT主页. https://www.chatgpt.com/
[6]	伊辛模型. https://en.wikipedia.org/wiki/Ising_model
[7]	Hopfield J J.Proceedings of the National Academy of Sciences， 1982，79：2554
[8]	Hebb学习规则. https://en.wikipedia.org/wiki/Hebbian_theory
[9]	Amit D J，Gutfreund H，Sompolinsky H. Physical Review A， 1985，32(2)：1007
[10]	Gutfreund H，Toulouse G. The Physics of Neural Networks.In： Spin Glasses and Biology. 1992. pp.7—59
[11]	Rosenblatt F. Proceedings of the IRE，1960，48(3)：301
[12]	Minsky M，Papert S A.Perceptrons: An Introduction to Computational Geometry.The MIT Press，2017
[13]	Sherrington D，Kirkpatrick S. Phys. Rev. Lett.，1975，35(26)： 1792
[14]	Parisi G. Phys. Rev. Lett.，1979，43(23)：1754
[15]	Gardner E，Derrida B. Journal of Physics A：Mathematical and General，1988，21(1)：271
[16]	Krauth W，Mézard M. Journal de Physique，1989，50(20)：3057
[17]	Cortes C. Machine Learning，1995，20：273
[18]	Nguyen H C，Zecchina R，Berg J. Advances in Physics，2017，66 (3)：197
[19]	Ackley D H，Hinton G E，Sejnowski T J. Cognitive Science， 1985，9(1)：147
[20]	Hinton G E. Momentum，2010，9(1)：926
[21]	Hinton G E，Salakhutdinov R R. Science，2006，313(5786)：504
[22]	Neal R M. Statistics and Computing，2001，11：125
[23]	Deng J，Dong W，Socher R et al. ImageNet: A large-scale Hierarchical Image Database.In：2009 IEEE Conference on Computer Vision and Pattern Recognition，Miami，FL，USA. pp.248—255
[24]	Krizhevsky A，Sutskever I，Hinton G E. lmagenet cassification with deep convolutional neural networks. In：Advances in Neural Information Processing Systems 25，2012
[25]	Goodfellow I，Pouget-Abadie J，Mirza M et al. Generative adversarial nets. In：Advances in Neural Information Processing Systems 27，2014
[26]	Kingma D P. 2013，arXiv：1312.6114
[27]	Vaswani A et al. Attention is all you need. In：Advances in Neural Information Processing Systems 30，2017

[1]	CHEN Le-Tian, YUAN Hong, SUN Chang-Pu. Brownian motion theory and its application in the study of complex climate systems[J]. PHYSICS, 2022, 51(9): 588-601. DOI: 10.7693/wl20220901
[2]	LIN Yan-Luan. From radiative-convective equilibrium to global climate models——an introduction to the work of the 2021 Nobel laureate in Physics, Syukuro Manabe[J]. PHYSICS, 2022, 51(1): 16-23. DOI: 10.7693/wl20220103
[3]	HU Yong-Yun. The complex climate system and global warming[J]. PHYSICS, 2022, 51(1): 10-15. DOI: 10.7693/wl20220102
[4]	CHEN Xiao-Song, FAN Jing-Fang. Opportunities for complexity science: the Nobel Prize in Physics 2021[J]. PHYSICS, 2022, 51(1): 1-9. DOI: 10.7693/wl20220101
[5]	GAO Peng-Yue, LV Jian, WANG Yan-Chao, MA Yan-Ming. Structure prediction via intelligent global optimization algorithms[J]. PHYSICS, 2017, 46(9): 582-589. DOI: 10.7693/wl20170902
[6]	Double-strand DNA melted by laser micro-flow method[J]. PHYSICS, 2010, 39(06): 423-425.
[7]	Solution methods for preparing Graphene[J]. PHYSICS, 2009, 38(06): 387-394.
[8]	Physical problems in the global climate change[J]. PHYSICS, 2009, 38(02): 71-83.
[9]	An optimized design method for city-street-lamps collocations[J]. PHYSICS, 2007, 36(04): 330-333.
[10]	Multimedia applying in course of methods of mathematical physics[J]. PHYSICS, 2007, 36(02): 153-158.

Cited By

Cited by

Periodical cited type(2)

1.	程伟，罗勇，曹龙，丹利，黄磊，邓祥征. 二氧化碳移除技术研究进展与评述. 气候变化研究进展. 2023(05): 672-682 .
2.	陈乐天，袁红，孙昌璞. 布朗运动理论及其在复杂气候系统研究中的应用. 物理. 2022(09): 588-601 . 本站查看

Other cited types(0)

Get Citation

PDF

XML

Article views (698) PDF downloads (1561) Cited by(2)

Turn off MathJax

Article Contents

Abstract

References

The computation of nature: from the Ising model to generative learning

Abstract

References

Related Articles

Cited by

Periodical cited type(2)

Other cited types(0)

Catalog

The computation of nature: from the Ising model to generative learning

Abstract

References

Related Articles

Cited by

Periodical cited type(2)

Other cited types(0)

Catalog

Export File

Citation

Format

Content