Plans for week 39_澳门葡京手机版app下载

mhjensen
2022-09-27T10:28:32.070Z
type:structured-message
www.uio.no

Dear all, welcome back to FYS-STK3155/4155.
Here's the weekly update with some messages below which could be of interest to some of you.
Last week we discussed logistic regression and started with optimization methods. We will devote this week to several of these optimization methods and in particular on ways to estimate the gradients. This will lead us from the simple gradient descent to various variants of stochastic gradient descent. We will also discuss how to make life less painful with algorithms like automatic differentiation.

The material this week is covered by the slides for week 39 at https://compphysics.github.io/MachineLearning/doc/web/course.html. In addition, for a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and chapter 8. We will come back to this in our discussion of Neural networks as well. See https://www.deeplearningbook.org/
For Stochastic Gradient Descent an...