Plans for the week of April 1-5

Dear all, we hope you had an enjoyable Easter break and have been able to properly recharge your batteries. 

This week we will start with generative models and the aim is to give you an overview of

1) Generative models in general and mathematics of generative models

2)  Our first generative model, the restricted Boltzmann machine (a so-called energy model). 

Most of the material we will cover is described by chapter 16 of Goodfellow et al, see https://www.deeplearningbook.org/contents/graphical_models.html.   If we get time

we will also discuss chapters 18.1 and 182. If you are not familiar with Markov chains and Monte Carlo methods, we recommend reading chapter 17 of the same authors.  The lecture notes this week will be upgraded and will most likely see its final form later today.

Different variants of project 2 will also be presented. 

The aim is to cover several generative models, starting with Bolztmann machines, then moving over to variational Autoencoders and GANs, before we wrap up with a discussion of stable diffusion models. 

The textbook by Foster contains several implementations of these algorithms, see his GitHub address at https://github.com/davidADSP/Generative_Deep_Learning_2nd_Edition

Chapter 7 covers Bolztmann machines. 

Best wishes to you all and cya soon,

Keran, Morten and Ruben