[Development] CI stability

Lars Knoll lars.knoll at qt.io
Fri Feb 10 10:47:20 CET 2017


> On 09 Feb 2017, at 18:42, Thiago Macieira <thiago.macieira at intel.com> wrote:
> 
> On quarta-feira, 8 de fevereiro de 2017 09:46:36 PST Lars Knoll wrote:
>> The second larger issue are flaky tests, ie. tests that fail randomly from
>> time to time. These tests are causing huge issues in CI, and especially
>> make qt5.git integrations that are required for releasing and to get
>> updated packages very painful. The flakiness of the tests and also the
>> flakiness in the CI system itself (which is a separate item for the team
>> working on the CI) is one of the main reasons why releases are getting
>> delayed.
> 
> Could we somehow fix the CI so that operations that take a couple of 
> microseconds on a developer machines don't take 10000x more in the CI? I 
> understand slow machines, but 4 or 5 orders of magnitude is not something we 
> can account for.

We’ve tried. The main issue we’re seeing is that Windows machines are sometimes randomly hanging for extended time periods. So far we haven’t been able to figure out why.

I hope that the scheduled changes in CI (moving to running on local disks instead of a SAN, and changing the virtualisation platform) will help, but we don’t yet know for sure.

Cheers,
Lars



More information about the Development mailing list