Please be informed that all IT services are back online.
The downtime was the result of a series of unfortunate events. An electricity glitch of the high speed network switch might has triggered a rebuilt of the whole disk cluster. While the disk cluster was being rebuilt, a patch update for the server cluster was automatically applied. As a result, a dead lock was created between the disk cluster and server cluster.
The server cluster update was reverted manually. The disk cluster rebuilt was restarted. It took around 10 hours to complete rebuilding the disk cluster. Another 3 hours were spent to manually apply the patch to each servers in the server cluster. All databases have been checked for data consistency. All systems are back online now.
Please accept my apology for the inconvenience caused.
Dr Terry NG
Director of IT