Difference between revisions of "CARC Storage Migration"

From SCECpedia
Jump to navigationJump to search
(Created page with "<pre> Dear SCEC CARC USER I'm sorry about our storage problems on USC CARC /project/scec_608 file system. Even though the storage from USC CARC center is on a RAID system, the...")
 
 
Line 1: Line 1:
 +
<pre>
 +
Dear
 +
You are currently using a significant amount of storage on the USC CARC filesystem at:
 +
/project/scec_608/xxx
 +
There are two important updates regarding this storage:
 +
1. File system errors
 +
CARC has reported errors on the /project storage system. Some of your files may have been lost or corrupted. Please review your data and regenerate any missing files if needed. If you would like a list of impacted files, let me know and I can provide it.
 +
2. Decommissioning of /project/scec_608
 +
The filesystem /project/scec_608 will be permanently removed on December 31, 2025. All files stored there will be deleted at that time.
 +
 +
SCEC can provide replacement storage on the new CARC filesystem for research use. Each researcher is allocated up to 1 TB by default, with additional storage available upon request and justification. If you would like storage reserved for you, please contact me. We will create a subdirectory for you on the new system and help guide you through the migration process.
 +
 +
Please make sure you retrieve or migrate any files you need before the end of this year. Let me know if you have any questions or if you’d like storage space set up on the new system.
 +
Best,
 +
 +
</pre>
 
<pre>
 
<pre>
 
Dear SCEC CARC USER
 
Dear SCEC CARC USER
Line 7: Line 23:
 
CARC has identified the list of files affected and posted the full list on CARC at:
 
CARC has identified the list of files affected and posted the full list on CARC at:
 
/project/scec_608/CORRUPT_20250620__project_scec_608.txt
 
/project/scec_608/CORRUPT_20250620__project_scec_608.txt
   
+
  </pre>
 
 
Dear SCEC CARC User,
 
  I am contacting you because you have files on the USC CARC filesystem under:
 
 
Input path: /project/scec_608/shuoma
 
Total files and subdirectories in /project/scec_608/shuoma: 64000
 
Total disk usage for /project/scec_608/shuoma: 4.2TB
 
 
There are two important updates regarding this storage:
 
File system errors
 
CARC has reported errors on the /project storage system. Some of your files may have been lost or corrupted. Please review your data and regenerate any missing files if needed. If you would like a list of files that were impacted, contact me and I can provide it.
 
Decommissioning of /project/scec_608
 
The filesystem /project/scec_608 will be permanently removed on December 31, 2025. All files stored there will be deleted at that time.
 
 
SCEC can provide limited replacement storage on the new CARC file system for research use. Quotas are capped at 1 TB per person. If you would like storage reserved for you, please contact me. We will create a subdirectory for you on the new filesystem, and you will be responsible for migrating the files you wish to keep.
 
 
Please ensure you retrieve or migrate any needed files before the end of this year. Let me know if you have questions or if you would like storage space allocated on the new system.
 

Latest revision as of 06:45, 21 August 2025

Dear 
You are currently using a significant amount of storage on the USC CARC filesystem at:
/project/scec_608/xxx
There are two important updates regarding this storage:
1. File system errors
CARC has reported errors on the /project storage system. Some of your files may have been lost or corrupted. Please review your data and regenerate any missing files if needed. If you would like a list of impacted files, let me know and I can provide it.
2. Decommissioning of /project/scec_608
The filesystem /project/scec_608 will be permanently removed on December 31, 2025. All files stored there will be deleted at that time.

SCEC can provide replacement storage on the new CARC filesystem for research use. Each researcher is allocated up to 1 TB by default, with additional storage available upon request and justification. If you would like storage reserved for you, please contact me. We will create a subdirectory for you on the new system and help guide you through the migration process.

Please make sure you retrieve or migrate any files you need before the end of this year. Let me know if you have any questions or if you’d like storage space set up on the new system.
Best,

Dear SCEC CARC USER
I'm sorry about our storage problems on USC CARC /project/scec_608 file system. Even though the storage from USC CARC center is on a RAID system, they had multi-drive failures and had data loss of about 3% on the data storage they rent to USC organizations. USC CARC has tried file recovery services, but that didn't help. SCEC has 200TB+ that we pay for and maintain so many SCEC people are affected.
 
The cause of the problem was too many disks failing at the same time on a RAID disk drive. The failures seem to be randomly distributed across files.
 
CARC has identified the list of files affected and posted the full list on CARC at:
/project/scec_608/CORRUPT_20250620__project_scec_608.txt