Beskjeder

Dear all, we hope you have passed a great weekend! Here are our tentative plans for week 40:

Plans for week 40

Lecture Monday September 30, 2024

1. Stochastic Gradient descent with examples and automatic differentiation. Continuation of the discussions from last week

2. If we get time, we start with the basics of Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model

Suggested readings and videos

Readings and Videos:

1. The lecture notes for week 40 (these notes), see for example the jupyter-notebook at https://gi...

Dear all and welcome to a new week with machine learning and much more. 

This week we continue our discussions of logistic regression as our first encounter on classification methods. As we discussed during the lecture last week, we use logistic regression in order to introduce classification problems as well as gradient methods in order to find the optimal parameters of our model. 

Important note:  Our lectures from Monday September 23 and for the rest of the semester will be at Store Fysiske Lesesal, where we met the first time. The audio equipment has now been installed.  

The plan this week (and we will continue with these topics next week as well) is:

Lecture Monday September 23

Material for the lecture on Monday September 23.

• Repetition of Logistic regression equations and clas...

Dear all, welcome back to a new exciting week with machine learning! Our plans this week are as follows, with lecture notes at for example https://github.com/CompPhysics/MachineLearning/blob/master/doc/pub/week38/ipynb/week38.ipynb:

Material for the lecture on Monday September 16.

• Logistic regression as our first encounter of classification methods. From binary cases to several categories.

• Start gradient and optimization methods

Suggested reading and videos

• Readings and Videos:

  • Hastie et al 4.1, 4.2 and 4.3 on logistic regression

  • Raschka et al, pages 53-76 on Logistic regression a...

For those interested, here's an interesting link to the Norwegian Mapping authority (Kartverket) from Jacob Hay (text in Norwegian).

////.  Mail from Jacob Hay:

Tenkte jeg skulle nevne hoydedata.no, hvor man kan laste ned DTM / DOM fra hele norge. (Dette er en gratis tjeneste fra kartverket) Man kan her laste ned data med opp til 1m oppl?sning, samt den kontrasten av overflate-modell eller terreng-modell. (aka. med eller uten tr?r og lignende st?y.) Bestilling av kartutsnitt skal v?re gratis for alle i Norge, men det kan ta noen timer ? prosessere f?r man f?r epost med nedlastingslenke. Finnes ogs? en del alternativer p? data.norge.no https://data.norge.no/search-all?q=dtm&theme=REGI

Dear all and welcome back to FYS-STK3155/4155. 

We hope you all had a great weekend. The plans for this week focus on

1) The lab sessions

    a) Discussion of expectation values, see also lecture material for this week. The exercises this week focus on this topics and can all be reused in project 1. Take also a look at Wessel van Wieringen's article at https://arxiv.org/abs/1509.09169. This is a good read if you are somewhat rusty on expectation values and more.

    b) Else, we will focus on work on project 1

2)  Lecture on Monday September 9

  a) we will focus on a  statistical interpretation of Ridge and Lasso regression

  b) and we will start discussing resampling techniques,such as the Bootstrap and cross validation and the magic of...

Dear all, project 1 is now available at https://github.com/CompPhysics/MachineLearning/tree/master/doc/Projects/2024/Project1

You will find the project files in different formats (all with the same content obviously), from plain html, via jupyter-notebook to PDF and latex.

We will discuss the project together with various exercises during the lab sessions.  Note well that the weekly exercises are aligned with the project and can be used for extra credits.

best wishes to you all and never hesitate to ask questions during the lab sessions.

Fahimeh, Ida, Karl Henrik, Mia, Morten, Odin, and Sigurd

Dear all,  here are the plans for the coming week:

• Material for the lecture on Monday September 2
•      Linear Regression, Ridge and Lasso regression and links with Statistics, Resampling methods, see the weekly lecture slides at for example (jupyter-notebook) https://github.com/CompPhysics/MachineLearning/blob/master/doc/pub/week36/ipynb/week36.ipynb
•      Recommended Reading: Goodfellow et al chapter 3  (till 3.11) on probability theory, see https://www.deeplearningbook.org/
•    Raschka et al, chapter 4 pages 105-134 and chapter 6 pages 171-185. Chapter 4 and 6 contain many useful hints which will be relevant for the various projects as well.

• Material for the active learning sessions on Tuesday and Wednesday
•      Summary from last week on discussion of SVD,...

Free access to textbook of Raschka et al

The textbook (highly recommended) Machine Learning with PyTorch and Scikit-Learn
by Sebastian Raschka, Yuxi (Hayden) Liu, Dr. Vahid Mirjalili can be downloaded for free (pdf and epub) from the university library of Oslo, go to 
https://bibsys-almaprimo.hosted.exlibrisgroup.com/primo-explore/search?vid=UIOLinks to an external site. and search for the text and log in with your UiO credentials.

Cheers and best

Dear all, first of all we hope you had an excellent weekend. we look much forward to welcome you back to this week's exercises and lectures. 

Important note: since the lecture hall we have been assigned for the Monday sessions is not yet ready with all AV equipment, we will use our back-up auditorium in the chemistry building, Auditorium 2 till approximately mid September. We are very sorry for this and hope it won't cause too many problems. 

This week we will discuss and work on the exercises for week 35 (all relevant for the start of project 1 next week).  The material needed for these exercises is covered by the first part of the weekly slides for week 35 at  https://compphysics.github.io/MachineLearning/doc/pub/week35/html/._week35-bs041.html

The slides 1-41 contain also several examples and derivations relevant for solving the three exercises we will work on this week d...

Dear all, if you are looking after team mates and would like us to make suggestions, please feel free to fill out the form at https://docs.google.com/forms/d/e/1FAIpQLSdmqZf4zQemIF03-TBJMr_ZB78aCbiAaPA6Szrt69_5BTcdQA/viewform?pli=1&edit_requested=true&pli=1 before the end of week 34 (the week of August 19-23).  We will come with suggestions by the end of the coming weekend.

Best wishes from all of us,
Fahimeh, Ida, Karl Henrik, Mia, Morten, Odin and Sigurd

The discord channel for fall 2024 is at https://discord.gg/XBKjd4ccGq

Dear all, lectures will be recorded and posted afterwards. The zoom link is Topic: FYS-STK3155/4155 lectures

https://msu.zoom.us/j/91706435521?pwd=Zll6dU1lRVpEbmlMWU9za1dyT0gvQT09

Meeting ID: 917 0643 5521
Passcode: 220382

Overview of first week

First of all a warm welcome to you all.

Our first lecture is Monday August 19, 1015am-12pm.

The sessions on Tuesdays and Wednesdays last four hours for each group (four in total) and will include lectures in a flipped mode (promoting active learning) and work on exercices and projects. The sessions will begin with lectures and questions and answers about the material to be covered every week. There are four groups, Tuesdays 815am-12pm and 1215pm-4pm and Wednesdays 815am-12pm and 1215pm-4pm. Please sign up as soon as possible for one of the groups. Max capacity per group is 30-40 participants. Please select the group which fits you best.

The first week we start with simple linear regression, a repetition of linear algebra and elements of statistics needed for the course.

• August 19: Presentation of the course, aims and content. Introduct...