Additional material for week 38
Dear all, the video from one of the lab sessions, where we discuss and derive the bias-variance tradeoff, is available at
It may be of relevance for the exercises this week and obviously project 1. Furthermore, the whiteboard notes for this week have been updated and you will find the derivation of the bias-variance tradeoff equations there as well, see https://github.com/CompPhysics/MachineLearning/blob/master/doc/HandWrittenNotes/2025/FYSSTKweek38.pdf
Finally, there was a typo in exercise 4a (this has been corrected now). There should only be a single target, as we should not resample targets.
These lines:
predictions = np.random.rand(bootstraps, n) * 10 + 10 targets = np.random.rand(bootstraps, n)
Should be:
predictions = np.random.rand(bootstraps, n) * 10 + 10
targets = np.random.rand(1, n)
Next week we will continue our discussion of the bias-variance tradeoff and resampling techniques like cross-validation and bootstrap. After that we will discuss our first classification problem, logistic regression. We will use that as a stepping stone towards neural networks (start week 40).
Best wishes to you all,
Morten et al