Beskjeder

Publisert 3. juni 2021 10:06

Today is the deadline for the project work. To deliver you project, please do the same as you did for your feedback, and make an MR with me added. Then, be sure to NOT make any changes to the branch after 23:59 today.

If you are or have been ill or otherwise unable to do work, please send me or the administration an email for an extension on the deadline.

If you have any questions, please feel free to ask me :) Good luck!

- Leif Harald

Publisert 25. mai 2021 13:20

I have published a page on pipelines here, with some links to interesting articles on the subject. I am sorry this page got published a bit late.

I will start giving feeback on the MRs today, and everyone should have gotten feedback on their MRs by Thursday 23:59 :)

There are still a couple of projects I have not gotten any MR from. If you want feedback, please make an MR and add me to it, or send me an email if you have problems making one :)

Also remember the project presentations on Thursday!

- Leif Harald

Publisert 18. mai 2021 13:32

Remember that on Thursday 20.05.21 the deadline for making a merge request (MR) in Gitlab for feedback is due. So, make an MR, and add me to it, and I will give you all some feedback and suggestions for improvements within the Thursday the week after (27.05.21).

This is not mandatory, so if you do not make an MR, you will simply not get any feedback :) However, it is of course recommended.

Also, remember that you will present your project on 27.05.21.

- Leif Harald

Publisert 10. mai 2021 21:27

I have released a new and improved version of Lore. The two main changes are as follows:

- Lore can now accept the standard database connection flags normally provided to psql, and will then execute the translated SQL-commands directly in the database (so no need to use psql for this anymore). This is now the default, so if you only want to write the SQL-commands to file (or standard out), add the "-w" or "--write" flag

- If you provide connection details, Lore will can use the information about tables, views and relations already stored in the database. So now you can use tables, views and relations already in the database in your implications, and in general incrementally build your database/knowledgebase

The new version can be downloaded here. I will update the Lore-page with description and examples over the next couple of days. I will also do a...

Publisert 6. mai 2021 12:10

The ogr2ogr-command is not available in the newest Red Hat versions installed on IFI. Thus, to use this program, one needs to login with an older version of Red Hat. This can be done with the following ssh-command:

ssh <username>@rh7login.ifi.uio.no

where <username> is your username. All other programs you need should still be available in this version of Red Hat (and all files, DBs, etc. are also present there).

If you encounter any difficulties, don't hesitate to ask :)

- Leif Harald

Publisert 29. apr. 2021 20:54

I have now published Veronika's slides to the schedule, and they can be downloaded here.

I have also sent out the project work to everyone, so you should all have gotten a mail with a project description (containing descriptions of datasets and focus questions to work with).

If anything is unclear, or you otherwise have any questions, please feel free to ask me :)

Good luck with the projects!

- Leif Harald

Publisert 27. apr. 2021 22:05

Weekly exercises on the use of the new programs Lore and TripleLore is published on the lecture's page. A solution is also published.

Good luck! :)

- Leif Harald

Publisert 20. apr. 2021 14:17

Because of the bugs in the currently used triplestore we will use a different system. I will therefore use this week's lecture to show how to use this new system, and how it differs in functionality from the old one.

Thus, this week's lecture on verification and cleaning will be moved to 06.05, and the lecture on pipelines originally scheduled on 06.05 will be moved to the following lecture on 20.05 (originally planned to be one of two lectures with project presentations from you students. As we are not that many students, I think a single lecture for project presentations will be enough.

The guest lecture next week is unaffected by these changes :)

- Leif Harald

Publisert 8. apr. 2021 14:29

The solution to the exercises on saturation published before easter is now available at the course's webpage here.

Publisert 29. mars 2021 22:12

The (Easter themed) exercises on saturation is now finally published on the lecture page. Note that there is a bug in KiWi affecting the second exercise, but a possible work-around is suggested in the note at the end of the exercise's text. The solutions to the exercises will be published on Thursday 08.04.

Happy Easter! :D

- Leif Harald

Publisert 15. mars 2021 21:00

The weekly exercises on Data Transformation is finally published at the lecture page. I will publish the solution as soon as it it ready. Good luck! :)

Publisert 1. mars 2021 09:28

There was a few errors in the original Makefile, which made it difficult to use on IFI-machines. I have therefore made some updates to the files, so if you are having problems, please download the latest Makefile linked to from the oblig text, and run "make setup" to get the newest versions of the programs. However, you do not need to do this if everything works fine :)

- Leif Harald

Publisert 25. feb. 2021 21:53

The mandatory assignment is now published here! The deadline is Thursday March 11. at 23:59. You have two attempts and can of course ask for an extension if you get sick or anything else happens.

Please feel free to ask if you have any questions, or if anything is unclear! Good luck!

- Leif Harald

Publisert 21. feb. 2021 21:24

The mandatory assignment ("oblig") is a bit delayed, and will be published a week later that previously mentioned. Thus, it will be published on Thursday 25.02.21. You will have two weeks to do the exercises, but can ask for extensions etc. as usual. You will also have two attempts.

The exercises will cover much of the curriculum we have looked at so far in the course (RDF, semantics, OTTR, SPARQL, etc.)

Please feel free to ask if you have any questions :)

- Leif Harald

Publisert 11. feb. 2021 13:56

The students of the course have set up a Slack-channel for use in the course, for discussion, Q&A and general talk. It is not mandatory to use this Slack and no important messages will only be posted there. But if you want to join it, the URL is

in5800v2021.slack.com

- Leif Harald

Publisert 8. feb. 2021 21:01

Toko will now make a proper table to display the results of SPARQL-queries. The newest version with this fix can be downloaded from the Wiki.

Publisert 8. feb. 2021 15:09

The weekly exercises on semantics and reasoning is now (finally) published at the wiki :)

Also note that there is a small change in the schedule: We will go through OTTR templates this week, and postpone mapping languages till next week. I think this makes more sense. See you all on Thursday!

Publisert 3. feb. 2021 09:33

USIT has now updated the connection limit and Toko now works fine on IFI-machines :)

- Leif Harald

Publisert 2. feb. 2021 21:27

If you try to execute the "init" mode with Toko on your personal database at IFI, you will currently get an exception stating that you have too many connections. This comes from a combination of two things: When one initializes a triplestore, the KiWi-library initializes also 10 connections to the database (for different purposes); 2. there is currently a connection limit set on your databases which is less than 10. I have contacted USIT and asked to raise the connection limit, so this will probably fix the issue :) Sorry for this!

However, if you are using a database set up on your own personal computer, everything should work fine.

- Leif Harald

Publisert 1. feb. 2021 19:39

I have now been told that Campuswire is not allowed to use for teaching at UiO, as Campuswire do not comply with GDPR. This means that we need to find a replacement for Q&A and discussion.

To this end, we will use Github were I have set up an empty repo. The idea is that we can (ab)use Github issues for questions and discussion. So, if you have a question or something you want to discuss, simply make an issue in the repo and I or fellow students can answer using comments on the issue. Once the question is answered, the issue can be marked as closed.

The repo I have set up is

https://github.uio.no/IN5800/questions

You need to log in (with your regular UiO-username and password) to be able to see it and post questions/issues. I do not yet know whether I have to give you special permissions to make issues, but please send me an email if you need access, and I will add you all :)

- Leif Harald

Publisert 31. jan. 2021 12:44

This week's exercises are now published at the wiki page.

Note that I have done some minor bug fixes to Toko since the lecture, so please download the newest version from the Toko wiki page before using it for the exercises :)

Publisert 22. jan. 2021 14:59

I have made a few exercises related to the "Data Structure" lecture. I have also updated the related Wiki-pages :)

Publisert 15. jan. 2021 15:42

The weekly exercises for the first week is now published on this week's Wiki-page.

Good luck, and please feel free to use Campuswire for questions/discussion :)

Publisert 12. jan. 2021 09:30

Welcome to IN5800, a new course on declarative data engineering!

Due to the current situation with the pandemic, we will have to have the first lecture digital via Zoom. Zoom-link is published on the schedule.

As noted on the course's main page, this course does not have an exam, but project work. I will give more details on this in the first lecture.

Looking forward to seeing you all! :)

- Leif Harald