Enrico Ventura

Jeudi 06 Février 2025, 14h00, salle E4.13b

Enrico Ventura

Computing Sciences Dept, Université Bocconi

Memorization as Generalization in Physics-inspired Generative Models

Our daily experience proves that humans are able to acquire and manipulate the hidden structure of the surrounding environment to generate creative ideas and survive. Artificial machines are also able to learn the unknown distribution of a set of data-points and use it to generate new examples. This capability, known under the name of generalization, is usually opposed to learning specific point-wise examples from the training-set. This second ability is called memorization. In this talk I will report some recent results supporting the picture of generalization as a “thermal” version of memorization with respect to a fictitious learning temperature. Both biologically-inspired (i.e spin-glass like neural networks) and artificial learning systems (i.e. diffusion models) will be analyzed under the lens of statistical mechanics.

Lien teams: https://teams.microsoft.com/l/meetup-join/19%3aac3d3339d1c740e0a3b81b94e49808c1%40thread.tacv2/1698658652943?context=%7b%22Tid%22%3a%22b8c19512-2aed-471d-a8d1-9b06e7da786a%22%2c%22Oid%22%3a%222ea0eb78-4abd-439c-8240-cc89774321a2%22%7d