The computation of nature: from the Ising model to generative learning
-
摘要: 2024年诺贝尔物理学奖授予约翰·霍普菲尔德和杰弗里·辛顿，这对很多人来说是出乎意料的。文章将从统计物理的视角，从伊辛模型出发，逐步介绍霍普菲尔德和辛顿的主要贡献，其中包括Hopfield模型、玻尔兹曼机、非监督学习，以及现代生成模型。还将回顾统计物理和机器学习在20世纪末期的精彩合作历程，并对未来物理与机器学习交互领域的发展方向进行简单展望。Abstract: The 2024 Nobel Prize in Physics was awarded to John Hopfield and Geoffrey Hinton, which came as a surprise to many people. In this introductory article, we will explore their major contributions from the perspective of statistical physics, starting with the Ising model. This includes the Hopfield model, Boltzmann machines, unsupervised learning, and modern generative models. The article will also review the exciting collaboration between statistical physics and machine learning at the end of the last century and provide a brief outlook on the future directions of the interdisciplinary field between physics and machine learning.
-
Keywords:
- Boltzmann machine /
- Hopfield model /
- Ising model /
- machine learning /
- statistical physics /
- generative model
-
-
[1] The Nobel Prize in Physics 2024. https://www.nobelprize.org/prizes/physics/2024/summary/
[2] They cracked the code for proteins’amazing structures. https://www.nobelprize.org/prizes/chemistry/2024/press-release/
[3] Midjourney主页. https://www.midjourney.com/ [4] WaveNet：A generative model for raw Audio. https://deepmind.google/discover/blog/wavenet-a-generative-model-for-raw-audio/
[5] ChatGPT主页. https://www.chatgpt.com/ [6] 伊辛模型. https://en.wikipedia.org/wiki/Ising_model [7] Hopfield J J.Proceedings of the National Academy of Sciences， 1982，79：2554
[8] Hebb学习规则. https://en.wikipedia.org/wiki/Hebbian_theory [9] Amit D J，Gutfreund H，Sompolinsky H. Physical Review A， 1985，32(2)：1007
[10] Gutfreund H，Toulouse G. The Physics of Neural Networks.In： Spin Glasses and Biology. 1992. pp.7—59
[11] Rosenblatt F. Proceedings of the IRE，1960，48(3)：301
[12] Minsky M，Papert S A.Perceptrons: An Introduction to Computational Geometry.The MIT Press，2017
[13] Sherrington D，Kirkpatrick S. Phys. Rev. Lett.，1975，35(26)： 1792
[14] Parisi G. Phys. Rev. Lett.，1979，43(23)：1754
[15] Gardner E，Derrida B. Journal of Physics A：Mathematical and General，1988，21(1)：271
[16] Krauth W，Mézard M. Journal de Physique，1989，50(20)：3057
[17] Cortes C. Machine Learning，1995，20：273
[18] Nguyen H C，Zecchina R，Berg J. Advances in Physics，2017，66 (3)：197
[19] Ackley D H，Hinton G E，Sejnowski T J. Cognitive Science， 1985，9(1)：147
[20] Hinton G E. Momentum，2010，9(1)：926
[21] Hinton G E，Salakhutdinov R R. Science，2006，313(5786)：504
[22] Neal R M. Statistics and Computing，2001，11：125
[23] Deng J，Dong W，Socher R et al. ImageNet: A large-scale Hierarchical Image Database.In：2009 IEEE Conference on Computer Vision and Pattern Recognition，Miami，FL，USA. pp.248—255
[24] Krizhevsky A，Sutskever I，Hinton G E. lmagenet cassification with deep convolutional neural networks. In：Advances in Neural Information Processing Systems 25，2012
[25] Goodfellow I，Pouget-Abadie J，Mirza M et al. Generative adversarial nets. In：Advances in Neural Information Processing Systems 27，2014
[26] Kingma D P. 2013，arXiv：1312.6114
[27] Vaswani A et al. Attention is all you need. In：Advances in Neural Information Processing Systems 30，2017
计量
- 文章访问数: 631
- HTML全文浏览量: 79
- PDF下载量: 1504
下载:
