Useful references for projects 2 and 3
Dear all, we are very impressed by both project 1 and the work you are doing on project 2. It is fantastic to be at the lab and discuss with you. Here we add three references which could be of interest when writing the report and also for further studiers.
The first reference is a preprint where the authors have tested different activation functions. It can be useful when you are writing your report. Furthermore, from arXiv you can fetch the bibtex code as well as the source file for the article by clicking on the other formats link (upper right corner).
The link to this article is at https://arxiv.org/abs/2109.14545
There are also two books on the mathematics of deep learning which are very interesting, one longer at
https://arxiv.org/abs/2310.20360 with codes at https://github.com/introdeeplearning/book (thx to August Femtehjell) and a shorter book at
https://arxiv.org/abs/2105.04026
These two books contain a discussion of the mathematics of deep learning and could be useful if you wish to dive deeper into the topics of deep learning. They can also serve as useful references when you write the report.
Best wishes to you all,
Morten