Colloquium: Statistical Physics of Learning in the Age of Attention
- Date
- May 28, 2026
- Time
- 3:30 PM - 4:30 PM
- Speaker
- Prof. Lenka Zdeborová
- Affiliation
- EPFL
- Series
- MPI-PKS Kolloquium
- Language
- en
- Main Topic
- Physik
- Other Topics
- Physik
- Description
- Over the past decades, statistical physics has provided a powerful framework for analyzing learning in high-dimensional models, revealing phase transitions, fundamental limits on generalization, and the role of algorithms and architectures. In this talk, I will discuss how these ideas are now being extended beyond classical perceptron-type models to attention-based architectures that process sequences of tokens, opening a path toward a statistical physics theory of transformers.
Last modified: Apr 29, 2026, 7:38:53 AM
Location
Max-Planck-Institut für Physik komplexer SystemeNöthnitzer Straße3801187Dresden
- Phone
- + 49 (0)351 871 0
- MPI-PKS
- Homepage
- http://www.mpipks-dresden.mpg.de
Organizer
Max-Planck-Institut für Physik komplexer SystemeNöthnitzer Straße3801187Dresden
- Phone
- + 49 (0)351 871 0
- MPI-PKS
- Homepage
- http://www.mpipks-dresden.mpg.de
Scan this code with your smartphone and get directly this event in your calendar. Increase the image size by clicking on the QR-Code if you have problems to scan it.
Legend
- Biology
- Chemistry
- Civil Eng., Architecture
- Computer Science
- Economics
- Electrical and Computer Eng.
- Environmental Sciences
- for Pupils
- Law
- Linguistics, Literature and Culture
- Materials
- Mathematics
- Mechanical Engineering
- Medicine
- Physics
- Psychology
- Society, Philosophy, Education
- Spin-off/Transfer
- Traffic
- Training
- Welcome