Plans for week 39, September 22-26

Dear all, welcome back to FYS-STK and a new week. We hope you had a great weekend.

Here are the plans for this week.

For the lecture on Monday the 22nd, the plans are

1. Resampling techniques, Bootstrap and cross validation and bias-variance tradeoff

2. Logistic regression, our first classification encounter and a stepping stone towards neural networks

Readings and Videos, resampling methods

1. Raschka et al, pages 175-192

2. Hastie et al Chapter 7, here we recommend 7.1-7.5 and 7.10 (cross-validation) and 7.11 (bootstrap). See https://link.springer.com/book/10.1007/978-0-387-84858-7.

3. Video on bias-variance tradeoff

4. Video on Bootstrapping

5. Video on cross validation

Readings and Videos, logistic regression

1. Hastie et al 4.1, 4.2 and 4.3 on logistic regression

2. Raschka et al, pages 53-76 on Logistic regression and pages 37-52 on gradient optimization

3. Video on Logistic regression

4. Yet another video on logistic regression

Lab sessions week 39

Material for the lab sessions on Tuesday and Wednesday.

1. Discussions on how to structure your report for the first project

2. Exercise for week 39 on how to write the abstract and the introduction of the report and how to include references.

3. Work on project 1, in particular resampling methods like cross-validation and bootstrap. For more discussions of project 1, chapter 5 of Goodfellow et al is a good read, in particular sections 5.1-5.5 and 5.7-5.11.

4. Video on how to write scientific reports recorded during one of the lab sessions

5. A general guideline can be found at https://github.com/CompPhysics/MachineLearning/blob/master/doc/Projects/EvaluationGrading/EvaluationForm.md.

Best wishes to you all,

Morten et al