CondMat for Dummies: Attention Is All You Need: Transformers and the Physics They're Starting to Solve
- Datum
- 17.04.2026
- Zeit
- 17:00 - 18:00
- Sprecher
- Giovanni Cemin
- Zugehörigkeit
- MPIPKS
- Sprache
- en
- Hauptthema
- Physik
- Andere Themen
- Physik
- Beschreibung
- In 2017, a paper with an unusually confident title proposed replacing recurrent neural networks with a mechanism called self-attention — and quietly started a revolution. In this talk I will explain what attention is, why it works, and how it became the dominant paradigm in machine learning. Starting from the limitations of RNNs, I will introduce the transformer architecture. Beyond the applications in large language models, I will discuss how this machinery is finding its way into physics: the variational description of strongly correlated quantum systems, and the operator-learning approach to solving partial differential equations.
Letztmalig verändert: 17.04.2026, 07:38:57
Veranstaltungsort
Max-Planck-Institut für Physik komplexer SystemeNöthnitzer Straße3801187Dresden
- Telefon
- + 49 (0)351 871 0
- MPI-PKS
- Homepage
- http://www.mpipks-dresden.mpg.de
Veranstalter
Max-Planck-Institut für Physik komplexer SystemeNöthnitzer Straße3801187Dresden
- Telefon
- + 49 (0)351 871 0
- MPI-PKS
- Homepage
- http://www.mpipks-dresden.mpg.de
Legende
- Ausgründung/Transfer
- Bauing., Architektur
- Biologie
- Chemie
- Elektro- u. Informationstechnik
- für Schüler:innen
- Gesellschaft, Philos., Erzieh.
- Informatik
- Jura
- Maschinenwesen
- Materialien
- Mathematik
- Medizin
- Physik
- Psychologie
- Sprache, Literatur und Kultur
- Umwelt
- Verkehr
- Weiterbildung
- Willkommen
- Wirtschaft
