Exercises for Tuesday October 3 + student representatives + today's lecture
Please do exercises 23 - 26 for Tuesday next week.
We now have two student representatives (tillitsvalgte) for the course! Many thanks to Kirsten and Markus. Their contact information will be posted on the course webpage.
Today we covered the broad theme of interpretability versus predictability. The discussion is largely based on Leo Breiman's foundational paper "Statistical Modeling: The Two Cultures" (Statistical Science 16:199-231, 2001). It is certainly not on the syllabus, but I encourage everyone interested to read it. If you really want to dig deep into this theme, you can also read C. P. Snow's original book "The Two Cultures" from 1959.
Also, in today's lecture, I should have been more clear about the regression model being linear in w. We can see this clearly in equation (5.5), where the mean is Фw, a linear function applied to w. This would not be the case in a neural network, where a nonlinear transformation is applied after each layer in the network.