We were able to confirm when path inconsistencies in iRODS catalog are present and the reason for them. We also verified how those inconsistencies can be fixed without the need to correct each file individually.
Since a scan of the archive filesystem took from 20 to 30min each run and we had to execute lots of scans during today's debug, we didn't add the second controller to the library as part of this maintenance.
The allocations bellow are operational again: /pl/archive/calipso_zhu /pl/archive/ics /pl/archive/mfix /pl/archive/VertZoo
Posted Dec 02, 2020 - 12:25 MST
In progress
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Posted Dec 02, 2020 - 08:01 MST
Scheduled
Research Computing will perform regularly-scheduled planned maintenance Wednesday, 2 December 2020. December's activities include:
- Conduct a disruptive PetaLibrary Archive test in order to reproduce a condition where NFS shares freeze and result on path inconsistencies in iRODS catalog. - Add redundant tape library controller.
Maintenance is scheduled to take place between 08:00 and 12:00, though service will be restored as soon as all activities have concluded. During the maintenance period access to the following PetaLibrary Archive allocations will be affected: /pl/archive/calipso_zhu /pl/archive/ics /pl/archive/mfix /pl/archive/VertZoo
No other RC service will be impacted by the maintenance. If you have any questions or concerns, please contact rc-help@colorado.edu.