[Development] Maintenance mishap with a coincidence

[Tony Sarajärvi]

Hi

We had a maintenance break yesterday and we left snapshots on just in case we have to revert something.
Well…Coin in our CI created so much data, that due to the snapshot it filled its LUN, therefore bringing the CI to a halt.

I should have caught the event before it reached full storage capacity before it actually happened due to our warning systems. However, IT changed some email policy yesterday, so I never received any e-mails from work since yesterday afternoon. Bad luck 😃

I’m working on untangling the system. A moment please…

-Tony

Tony Sarajärvi
CI Tech Lead

The Qt Company
Tutkijantie 4
90590 Oulu, Finland
tony.sarajarvi at qt.io
+358 50 4821416
http://qt.io
[The Qt Company logo]<http://qt.io/>
[Facebook]<http://www.facebook.com/Qt>
[Twitter]<http://www.twitter.com/qtproject>
[LinkedIn]<https://www.linkedin.com/company/the-qt-company/>
[Google+]<https://plus.google.com/104580575722059274792>
[YouTube]<https://www.youtube.com/QtStudios>


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.qt-project.org/pipermail/development/attachments/20201006/7c5d1474/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 7283 bytes
Desc: image001.png
URL: <http://lists.qt-project.org/pipermail/development/attachments/20201006/7c5d1474/attachment-0006.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 781 bytes
Desc: image002.png
URL: <http://lists.qt-project.org/pipermail/development/attachments/20201006/7c5d1474/attachment-0007.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 940 bytes
Desc: image003.png
URL: <http://lists.qt-project.org/pipermail/development/attachments/20201006/7c5d1474/attachment-0008.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 869 bytes
Desc: image004.png
URL: <http://lists.qt-project.org/pipermail/development/attachments/20201006/7c5d1474/attachment-0009.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.png
Type: image/png
Size: 1008 bytes
Desc: image005.png
URL: <http://lists.qt-project.org/pipermail/development/attachments/20201006/7c5d1474/attachment-0010.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image006.png
Type: image/png
Size: 832 bytes
Desc: image006.png
URL: <http://lists.qt-project.org/pipermail/development/attachments/20201006/7c5d1474/attachment-0011.png>