CVS/VPS (LAX): Storage Performance Degredation (Updated)

CVS/VPS (LAX): Storage Performance Degredation (Updated)

We are aware of service quality degradation in Storage on our CVS/VPS services and are currently investigating the cause.

02/11/2024: For the past 72 hours we have been working directly with our Storage systems vendor to address storage service quality degradation. Unfortunately during the troubleshooting process a catastrophic storage failure occured impacting several VM nodes in our Los Angeles Cluster. At the moment this issue is being investigated hoping to be able to recover the data, however, we are not certain that this path is possible.We sincerely apologize for this, unfortunately VPS in it's nature is a difficult system to maintain strong storage redundancy on, and for the past 6 months we have been working on ways to make that happen. Our tech support team will assist you in giving you the resources needed to rebuild your VMs, while we investigate this further and come to a conclusion in the next 3-4 hours.

02/11/2024 (8:05PM): We have attempted several other methods to recover the data unfortunately have failed. Right now we are waiting for another option by the storage systems vendor.

02/12/2024 (3:27PM PST): Data was recovered and systems should be back operational on all.

 

We apologize for the inconveniencethis have caused, our teams have worked tirelessly to correct this issue. We will be further investigating the cause of the issue and ensure safe checks are in place to avoid this reoccurrence.

 

03/25/2025 - Issues have been addressed, and solutions have been put in place.

 

  • Friday, 9th February, 2024
  • 18:25pm