Plans for the week of February 16-20

Dear all, welcome back to FYS5429/9429.

The plan this week is to end the discussions we started last week on CNNs, with a discussion on how to write codes (either our own of interest for those of you who would like to do so or with Pytorch and/or Tensorflow/Keras). Thereafter we will look at recurrent neural networks (RNNs).

The RNN part will be followed up by the autoencoders before we move into transformers and then generative methods.?

Note that this week's lecture is via zoom (I am away for a meeting). The lecture will also be recorded for those of you who cannot be there during the lecture. Oda and Ruben will be at the lab in person from 1215pm to 2pm (our normal times) and I will be available for the whole lab session via zoom if you wish to discuss with me.? The zoom link is the same as always, https://uio.zoom.us/my/mortenhj

Plans for the week of February 16-20

Implementing Convolutional Neural Networks (CNNs), own codes, TensorFlow+Keras and PyTorch examples

Start discussion of Recurrent Neural Networks (RNNs).

Reading recommendations

For CNNs, see Goodfellow et al chapter 9. See also chapter 11 and 12 on practicalities and applications

For RNNs, see Goodfellow et al chapter 10.

Reading suggestions for implementation of CNNs in PyTorch:?See Rashcka et al.'s chapter 14 and GitHub site.

Reading suggestions for implementation of RNNs in PyTorch:?See Rashcka et al.'s chapter 15 and GitHub site.

TensorFlow examples

For TensorFlow (using Keras) implementations, we recommend

David Foster Generative Learning, see chapters 2 and 3 from the GitHub link

Joseph Babcock and Raghav Bali Generative AI with Python and their GitHub link, chapter 3

The jupyter-notebook is at https://github.com/CompPhysics/AdvancedMachineLearning/blob/main/doc/pub/week5/ipynb/week5.ipynb

Best wishes to you all,

Morten, Oda and Ruben

p.s. if you are looking after project partners, please send us an email and we will forward your name to everybody. At present, Olaf is seeking partners.

If you are interested please reach out to Olaf at olafw@student.geo.uio.no