Dear Clients,
We would like to inform you that the node: Panther (Germany) Â has been detected with one hard drive failure therefore the RAID array was in degraded state, we are working with onsite technician in Germany for immediate maintenance to replace the failed drive as soon as possible, this drive issue caused significant CPU spikes which maybe affecting the performance of your VPS.
We advice everyone to backup your data and take your VPS offline to avoid any data corruption and further stress to the remaining drive in the RAID array, we expect ETA of 24 hours for completion.
We recommend taking your VPS offine to speed up the RAID re-synching/re-building process and avoid stressing the failed array that's causing CPU spikes.
We apologise for the inconvenience this has caused you but we are doing our best to ensure safely fix the issue.
Â
Sincerely,
QuickWeb Hosting Team
Â
Update as at : 10:52PM NZDT : German on-site staff gave ETA of 3-4 hours for drive replacement, they need to briefly shutdown the machine for drive swap, note we are 12 hours ahead of Germany so this may happen between 1PM-3PM German time.
Update as at : 7:18AM NZDT : The drive was replaced 5 hours ago and unfortunately fsck is still running at this time, could be another hour more, sorry for the delay however this is important process to ensure consistency of file system.
Update as at 12:55PM NZDT : We are patiently repairing file system with fsck see http://bit.ly/wVujSo
Update as at 4:52PM Â NZDT: fsck is crawling, for those who cannot wait we can create a new VPS for you in another machine and just restore your data from your backups, open a ticket if you want this route.
Update as at 6:42PM NZDT: Unfortunately as the way  it stands seems like it the file systems is beyond repair :(  we are arranging new machine to be setuped by the DC so we can for the while create new VPS for everyone when ready, however if you want we can create a new VPS for you now in another working machine but this will give you a new IP.
Update as at 7:40PM NZDT: We were told by the DC staff that brand new Sandybridge server will be racked and ready within 4-5 hours, once that becomes available we will re-create your VPS there and assign you your existing IPs, we are still trying to recover the old machine's data so if ever we can successfully get the RAID file system rebuilt we can let you have your old files back, however this is best effort and we cannot promise full recovery.
Update as at 10:16PM 29 Feb : Good news and bad news! the good news, we managed to get the machine run on remaining healthy disk drives so this hopefully allows us to take most of the VPS servers back online so you can backup your data! Bad news is we cannot guarantee server will remain online for long hence we advice everyone to avoid running heavy i/o processes... once the new machine goes online we will try our best to migrate all VPS to new machines one by one.
Update as at 1:04AM 1 March : Unfortunately the file system is not very stable hence the server still go down after running for at least an hour, we will focus our efforts in migrating everyone on new machine rather than try to run these VPS on old box. There are corrupted VPS we will just replace this with new VPS and then mount old files inside new VPS.
Update as at 11:40AM 1 March: We are still migrating VPS, unfortunately there's heavily damaged system files on some VPS so cannot be moved and need to be freshly rebuilt... Roel is on live chat now hop in and he will assist you.
Update as at 2AM 2 March: All VPS should be restored now and operating on the new server, thank you for your patience.
יום שלישי, פברואר 28, 2012
