TSD Operational Log - Page 4

We're experiencing storage instability on ESS affecting windows and linux hosts of projects that have been migrated to ESS.

Update 221208: We experienced a new incident between 09:20-10:30. 

We're working with third party service providers to resolve the instability.

Starting 15:10 there's been an issue with network traffic in TSD, affecting NFS among others.

We're actively working to fix it.

Update 16:25: The issue has been resolved.

We are experiencing instability with the storage system. We are investigating and have contacted the vendor for support.

We are working to fix it.

We are having issues with the data portal https://data.tsd.usit.no/ - we are working to fix it.

Some users get an error message: 500 Internal Server Error - Negative response from the server message. We are investigating the issue.

SCCM group will be installing a hotfix rollup for CM 2203 (KB14244456) on Wednesday 2022-09-07.

Software Center on all Windows VMs in TSD will be unavailable between 09:00 and 16:00.

Read more...

Starting 2022-09-05 15:00, we'll migrate approximately 1000 projects from the old to the new storage solution. Affected projects will have a downtime from 15:00 until 15:00 the next day, unless specified otherwise in the notification email. For more information about the migration see our FAQ.

Update: Not all projects were migrated by 15:00. The downtime for these projects has been extended.

The Software Center on all Windows VMs will be unavailable between 09:00 and 16:00.

/tjenester/it/aktuelt/planlagte-tjenesteavbrudd/2022/2022-08-31-sccm-oppgradering-tsd.html

As of 2022-08-15 10:30, TSD Self Service is experiencing technical difficulties. This issue affects various operations pertaining to performing updates.

We are working on a solution.

Project Database machine will receive a minor DB security upgrade.

Database Upgrade will disrupt login from 9AM till 10 AM  Friday 15.07.

Affected services: Selfeservice, File Transfer and Logging. We apologize for the inconvenience. We will work to make the process as smooth as possible.

We are doing network maintenance in TSD Monday-Tuesday 23/05/2022-24/05/2022.

No downtime is expected but interruptions may occur. 

The matlab license on Linux hosts expired. We are working to solve the problem as quickly as possible.

Consent and Publication internal portals are not available. Investigation is in progress ¡­

The Slurm controller on Colossus was unresponsive between approximately 01:00 and 09:15 on February 17th.

The issue has been resolved, but we advice users that had running jobs during this time frame to check their job logs for issues.

Resolved

We will be performing an upgrade of the Horizon view infrastructure on Thursday February 3rd at 12:00. We expect this to take no more than 2 hours. We will update this message and send out an email once the upgrade is complete. 

Login through view.tsd.usit.no will be down during the downtime. The project machines will not be affected, so any existing sessions you have will still be there when you log back on after the downtime.

Due to a software error, the Windows access of some users was extended past the period to which the project Administrator has approved. Now this is corrected. If you have lost your Windows machine access, please contact your project administrator to add you to the appropriate group. 

f4transkript is currently not available in TSD-projects.

We are working to solve the problem as quickly as possible.
Our apologies for the inconvenience.

We will be performing network maintenance on Monday 13/12/21 at 12:00, the downtime will last 10-15mins.

We do not expect any downtime, but there might be some interruptions. 

Between approximately 10:00 and 10:30, the module load command did not work on the submit hosts and Colossus nodes. Please resubmit any jobs that may have failed. This has been resolved.

We will be performing maintenance on view-ous.tsd.usit.no on Tue 16/11 12:00.

The downtime will last about an hour.