Simone Brugiapaglia
The Mathematical Foundations of Deep Learning: From Rating Impossibility to Practical Existence Theorems
Université Concordia
Colloque
10 février 2023 de 15 h 30 à 18 h 30 (heure de Montréal/HNE) Sur place
The Mathematical Foundations of Deep Learning: From Rating Impossibility to Practical Existence Theorems
Colloque par Simone Brugiapaglia (Université Concordia)
Deep learning is having a profound impact on industry and scientific research. Yet, while this paradigm continues to show impressive performance in a wide variety of applications, its mathematical foundations are far from being well established. In this talk, I will present recent developments in this area by illustrating two case studies.
First, motivated by applications in cognitive science, I will present “rating impossibility" theorems. They identify frameworks where deep learning is provably unable to generalize outside the training set for the seemingly simple task of learning identity effects, i.e. classifying whether pairs of objects are identical or not.
Second, motivated by applications in scientific computing, I will illustrate “practical existence" theorems. They combine universal approximation results for deep neural networks with compressed sensing and high-dimensional polynomial approximation theory. As a result, they yield sufficient conditions on the network architecture, the training strategy, and the number of samples able to guarantee accurate approximation of smooth functions of many variables.
Time permitting, I will also discuss work in progress and open questions.
Adresse
Centre de recherches mathématiques Pavillon André-Aisenstadt, Université de Montréal Room 5340