Tutorial: Isabela Albuquerque

speaker

On generalization out-of-distribution and the multiple faces of neural networks robustness

Dr. Isabela Albuquerque

Supervised learning under the risk minimization framework is based on the assumption that training and testing data are drawn from the same distribution. However, real-world machine learning applications are often susceptible to distribution shifts, which can occur due to changes in the data collection conditions, adversarial attacks, or other factors. In this tutorial, we will discuss distribution shifts that affect neural networks performance in-the-wild and provide an overview of the different settings often considered in the literature. We will then focus on the ubiquitous domain generalization case, which applies to scenarios where the data generating process at test time may yield samples from never-before-seen distributions. We will cover both theoretical results and techniques to improve neural networks performance for this setting.