[Ci-reports] fail on QtQA_master_Integration #695
Qt Continuous Integration System
ci-noreply at qt-project.org
Fri Jun 5 11:54:34 CEST 2015
Autotest `scripts @ /work/build/qt/qtqa/scripts' failed :(
The test was determined to be flaky, meaning results were not consistent across multiple runs. This might make the problem difficult to reproduce. Also, flaky failures might or might not be related to any recent changes in the source code.
+ perl /work/build/qt/qtqa/scripts/setup.pl --install
Checking perl modules ...
Capture::Tiny - OK
YAML - OK
HTTP::Headers - OK
List::Compare - OK
List::MoreUtils - OK
File::HomeDir - OK
Proc::Reliable - OK
Const::Fast - OK
Text::ParseWords - OK
Data::Compare - OK
LWP::UserAgent::Determined - OK
Timer::Simple - OK
QMake::Project - OK
File::Which - OK
Sub::Override - OK
Test::Perl::Critic - OK
Text::Wrap - OK
Lingua::EN::Inflect - OK
File::Find::Rule - OK
Tie::Sysctl - OK
Readonly - OK
Test::Warn - OK
Params::Validate - OK
AnyEvent::Watchdog - OK
Log::Dispatch - OK
IO::Prompt - OK
IO::CaptureOutput - OK
Win32::Status - OK
Inline::C - OK
Time::Piece - OK
Coro::AnyEvent - OK
Lingua::EN::Numbers - OK
Test::NoWarnings - OK
Class::Factory::Util - OK
IO::Uncompress::AnyInflate - OK
AnyEvent::Util - OK
Mail::Sender - OK
autodie - OK
IO::Interactive - OK
AnyEvent - OK
Test::Exception - OK
parent - OK
Test::Exit - OK
Env::Path - OK
AnyEvent::HTTP - OK
BSD::Resource - OK
File::Fetch - OK
Test::More - OK
Text::Diff - OK
Perl::Critic - OK
File::Copy::Recursive - OK
Tie::IxHash - OK
Data::Alias - OK
XML::Simple - OK
File::chdir - OK
Encode::Locale - OK
Text::Trim - OK
Class::Data::Inheritable - OK
File::Slurp - OK
Time::Out - OK
IO::Compress::Gzip - OK
App::cpanminus - OK
ReleaseAction - OK
Template - OK
AnyEvent::HTTPD - OK
Tie::Persistent - OK
YAML::Node - OK
JSON - OK
Config::Tiny - OK
It looks like your CPAN setup is complete :)
+ prove -I /work/build/qt/qtqa/scripts/lib/perl5 --merge --state=save -I /work/build/qt/qtqa/scripts/lib/perl5 --recurse /work/build/qt/qtqa/scripts
/work/build/qt/qtqa/scripts/generic/t/01-coveragerunner_testcocoon.t ...................... ok
/work/build/qt/qtqa/scripts/generic/t/01-testrunner-testcocoon.t .......................... ok
/work/build/qt/qtqa/scripts/generic/t/01-xml2html_testcocoon.t ............................ ok
/work/build/qt/qtqa/scripts/generic/t/10-testrunner.t .....................................
Dubious, test returned 16 (wstat 4096, 0x1000)
Failed 16/99 subtests
(less 1 skipped subtest: 82 okay)
/work/build/qt/qtqa/scripts/generic/t/15-testrunner-capture-logs.t ........................ ok
/work/build/qt/qtqa/scripts/generic/t/16-testrunner-capture-logs-race.t ................... ok
/work/build/qt/qtqa/scripts/generic/t/20-testrunner-core.t ................................ skipped: you must make /cores directory writable to run this test on mac
/work/build/qt/qtqa/scripts/generic/t/21-testrunner-flaky.t ............................... ok
/work/build/qt/qtqa/scripts/generic/t/22-testrunner-sync-output.t ......................... ok
/work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t ....................... ok
/work/build/qt/qtqa/scripts/generic/t/30-parse_build_log.t ................................ ok
/work/build/qt/qtqa/scripts/generic/t/40-testplanner.t .................................... ok
/work/build/qt/qtqa/scripts/generic/t/41-print_calling_makefile.t ......................... skipped: This test is relevant only on Win32 and nmake
/work/build/qt/qtqa/scripts/generic/t/50-testscheduler.t .................................. ok
/work/build/qt/qtqa/scripts/git/t/10-git-qtqa-combine.t ................................... ok
/work/build/qt/qtqa/scripts/jenkins/t/05-qt-jenkins-integrator.t .......................... ok
/work/build/qt/qtqa/scripts/jenkins/t/10-summarize-jenkins-build.t ........................ ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/Reliable/t/01-QtQA-Proc-Reliable-Win32.t .. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/10-reliable.t ........................... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/20-reliable-strategies.t ................ ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Test/t/10-test-more-create_mock_command.t ...... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-Gerrit.t .................................. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-TestScript.t .............................. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/20-TestScript-autodocs.t ..................... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/30-TestScript-reliable-exe.t ................. ok
/work/build/qt/qtqa/scripts/t/10-perl-syntax-check.t ...................................... ok
/work/build/qt/qtqa/scripts/t/20-perl-critic-check.t ...................................... ok
/work/build/qt/qtqa/scripts/t/90-licenses.t ............................................... ok
Test Summary Report
-------------------
/work/build/qt/qtqa/scripts/generic/t/10-testrunner.t (Wstat: 4096 Tests: 99 Failed: 16)
Failed tests: 30, 32-33, 36, 38-39, 41, 43-44, 47, 67
69, 71, 73, 75, 77
Non-zero exit status: 16
/work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t (Wstat: 0 Tests: 22 Failed: 0)
TODO passed: 1-8, 10-13, 15-16, 18, 20-22
Files=28, Tests=1372, 243 wallclock secs ( 0.30 usr 0.06 sys + 155.69 cusr 11.49 csys = 167.54 CPU)
Result: FAIL
I'm going to run only the failed tests again:
+ prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose
# Failed test 'verbose success error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [-e] [use Data::Dumper; print Data::Dumper->new( \@ARGV )->Indent( 0 )->Dump( ); exit 0] [hello]
# QtQA::App::TestRunner: end perl: 0.017367 seconds, exit code 0
# '
# doesn't match '(?msx-i:
# \A
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*)\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ exit\ code\ 0\n
# \z
# )'
# Failed test 'label defaults to command name (begin)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 282.
# got: 'perl @ /work/build/qt/qtqa/scripts'
# expected: 'perl'
# Failed test at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 284.
# Failed test 'verbose fail error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin failure test @ /work/build/qt/qtqa/scripts: [perl] [-e] [use Data::Dumper; print Data::Dumper->new( \@ARGV )->Indent( 0 )->Dump( ); exit 3] [hello]
# QtQA::App::TestRunner: end failure test: 0.016801 seconds, exit code 3
# '
# doesn't match '(?msx-i:
# \A
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*)\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ exit\ code\ 3\n
# \z
# )'
# Failed test 'explicitly setting label works as expected (begin)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 294.
# got: 'failure test @ /work/build/qt/qtqa/scripts'
# expected: 'failure test'
# Failed test at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 296.
# Failed test 'verbose hanging error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin mytestcase__mytestfunc @ /work/build/qt/qtqa/scripts: [perl] [-e] [use Data::Dumper; print Data::Dumper->new( \@ARGV )->Indent( 0 )->Dump( ); while (1) { sleep(1000) }] [hello]
# QtQA::App::TestRunner: Timed out after 2 seconds
# QtQA::App::TestRunner: Process exited due to signal 15
# QtQA::App::TestRunner: end mytestcase__mytestfunc: 2 seconds, signal 15
# '
# doesn't match '(?msx-i:
# \A
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*)\n
# (?msx-i:
# QtQA::App::TestRunner:\ Timed\ out\ after\ \d+\ seconds?\n
# (?-xism:QtQA::App::TestRunner: Process exited due to signal 15\n)
# )
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\n # note, exit status is undefined (thus untested) on hang
# )'
# Failed test ': is stripped from label (begin)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 306.
# got: 'mytestcase__mytestfunc @ /work/build/qt/qtqa/scripts'
# expected: 'mytestcase__mytestfunc'
# Failed test at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 308.
# Failed test 'timeout warning error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [-e] [use Data::Dumper; print Data::Dumper->new( \@ARGV )->Indent( 0 )->Dump( ); sleep(4); exit 0] [hello]
# QtQA::App::TestRunner: warning: test duration (4 seconds) is dangerously close to maximum permitted time (5 seconds)
# QtQA::App::TestRunner: warning: Either modify the test to reduce its runtime, or use a higher timeout.
# QtQA::App::TestRunner: end perl: 4 seconds, exit code 0
# '
# doesn't match '(?msx-i:
# \A
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*)\n
# (?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ warning\:\ test\ duration\ \(4\ seconds\)\ is\ dangerously\ close\ to\ maximum\ permitted\ time\ \(5\ seconds\)\n
# QtQA\:\:App\:\:TestRunner\:\ warning\:\ Either\ modify\ the\ test\ to\ reduce\ its\ runtime\,\ or\ use\ a\ higher\ timeout\.\n
# )
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\n
# \z
# )'
# Failed test 'crash windows cmd metacharacters error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl] [hello %there%] [how ^are "you' today]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.231082 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Failed test 'crash posix sh metacharacters error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl] [hello |there] [how $are "you' !today]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.20159 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Failed test 'crash whitespace error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl] [hello there] [ ]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.20029 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Failed test 'crash no args error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.201419 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Failed test 'crash trivial error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl] [hello]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.200728 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Failed test 'crash non-ascii error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl] [早上好] [你好马？]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.193056 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Looks like you failed 16 tests of 99.
/work/build/qt/qtqa/scripts/generic/t/10-testrunner.t ..
ok 1 - fails with no args exits non-zero
ok 2 - fails with no args output looks correct (exact match)
ok 3 - fails with no args error looks correct (regex match)
ok 4 - --help parsed OK exits non-zero
ok 5 - --help parsed OK output looks correct (regex match)
ok 6 - --help parsed OK error looks correct (exact match)
ok 7 - -- stops argument processing exits non-zero
ok 8 - -- stops argument processing output looks correct (exact match)
ok 9 - -- stops argument processing error looks correct (regex match)
ok 10 - successful windows cmd metacharacters exits zero
ok 11 - successful windows cmd metacharacters output looks correct (exact match)
ok 12 - successful windows cmd metacharacters error looks correct (exact match)
ok 13 - successful posix sh metacharacters exits zero
ok 14 - successful posix sh metacharacters output looks correct (exact match)
ok 15 - successful posix sh metacharacters error looks correct (exact match)
ok 16 - successful whitespace exits zero
ok 17 - successful whitespace output looks correct (exact match)
ok 18 - successful whitespace error looks correct (exact match)
ok 19 - successful no args exits zero
ok 20 - successful no args output looks correct (exact match)
ok 21 - successful no args error looks correct (exact match)
ok 22 - successful trivial exits zero
ok 23 - successful trivial output looks correct (exact match)
ok 24 - successful trivial error looks correct (exact match)
ok 25 - successful non-ascii exits zero
ok 26 - successful non-ascii output looks correct (exact match)
ok 27 - successful non-ascii error looks correct (exact match)
ok 28 - verbose success exits zero
ok 29 - verbose success output looks correct (exact match)
not ok 30 - verbose success error looks correct (regex match)
ok 31
not ok 32 - label defaults to command name (begin)
not ok 33
ok 34 - verbose fail exits non-zero
ok 35 - verbose fail output looks correct (exact match)
not ok 36 - verbose fail error looks correct (regex match)
ok 37
not ok 38 - explicitly setting label works as expected (begin)
not ok 39
ok 40 - verbose hanging exits non-zero
not ok 41 - verbose hanging error looks correct (regex match)
ok 42
not ok 43 - : is stripped from label (begin)
not ok 44
ok 45 - timeout warning exits zero
ok 46 - timeout warning output looks correct (exact match)
not ok 47 - timeout warning error looks correct (regex match)
ok 48 - failure windows cmd metacharacters exits non-zero
ok 49 - failure windows cmd metacharacters output looks correct (exact match)
ok 50 - failure windows cmd metacharacters error looks correct (exact match)
ok 51 - failure posix sh metacharacters exits non-zero
ok 52 - failure posix sh metacharacters output looks correct (exact match)
ok 53 - failure posix sh metacharacters error looks correct (exact match)
ok 54 - failure whitespace exits non-zero
ok 55 - failure whitespace output looks correct (exact match)
ok 56 - failure whitespace error looks correct (exact match)
ok 57 - failure no args exits non-zero
ok 58 - failure no args output looks correct (exact match)
ok 59 - failure no args error looks correct (exact match)
ok 60 - failure trivial exits non-zero
ok 61 - failure trivial output looks correct (exact match)
ok 62 - failure trivial error looks correct (exact match)
ok 63 - failure non-ascii exits non-zero
ok 64 - failure non-ascii output looks correct (exact match)
ok 65 - failure non-ascii error looks correct (exact match)
ok 66 - crash windows cmd metacharacters exits non-zero
not ok 67 - crash windows cmd metacharacters error looks correct (regex match)
ok 68 - crash posix sh metacharacters exits non-zero
not ok 69 - crash posix sh metacharacters error looks correct (regex match)
ok 70 - crash whitespace exits non-zero
not ok 71 - crash whitespace error looks correct (regex match)
ok 72 - crash no args exits non-zero
not ok 73 - crash no args error looks correct (regex match)
ok 74 - crash trivial exits non-zero
not ok 75 - crash trivial error looks correct (regex match)
ok 76 - crash non-ascii exits non-zero
not ok 77 - crash non-ascii error looks correct (regex match)
ok 78 # skip divide by zero is unpredictable on mac
ok 79 - hanging windows cmd metacharacters exits non-zero
ok 80 - hanging windows cmd metacharacters error looks correct (regex match)
ok 81 - hanging posix sh metacharacters exits non-zero
ok 82 - hanging posix sh metacharacters error looks correct (regex match)
ok 83 - hanging whitespace exits non-zero
ok 84 - hanging whitespace error looks correct (regex match)
ok 85 - hanging no args exits non-zero
ok 86 - hanging no args error looks correct (regex match)
ok 87 - hanging trivial exits non-zero
ok 88 - hanging trivial error looks correct (regex match)
ok 89 - hanging non-ascii exits non-zero
ok 90 - hanging non-ascii error looks correct (regex match)
ok 91 - cwd as expected with no chdir exits zero
ok 92 - cwd as expected with no chdir output looks correct (exact match)
ok 93 - cwd as expected with no chdir error looks correct (exact match)
ok 94 - cwd as expected with --chdir exits zero
ok 95 - cwd as expected with --chdir output looks correct (exact match)
ok 96 - cwd as expected with --chdir error looks correct (exact match)
ok 97 - cwd as expected with -C exits zero
ok 98 - cwd as expected with -C output looks correct (exact match)
ok 99 - cwd as expected with -C error looks correct (exact match)
1..99
Dubious, test returned 16 (wstat 4096, 0x1000)
Failed 16/99 subtests
(less 1 skipped subtest: 82 okay)
Test Summary Report
-------------------
/work/build/qt/qtqa/scripts/generic/t/10-testrunner.t (Wstat: 4096 Tests: 99 Failed: 16)
Failed tests: 30, 32-33, 36, 38-39, 41, 43-44, 47, 67
69, 71, 73, 75, 77
Non-zero exit status: 16
Files=1, Tests=99, 24 wallclock secs ( 0.03 usr 0.01 sys + 4.46 cusr 0.51 csys = 5.01 CPU)
Result: FAIL
prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose exited with value 1
QtQA::App::TestRunner: test failed, running again to see if it is flaky...
+ perl /work/build/qt/qtqa/scripts/setup.pl --install
Checking perl modules ...
Capture::Tiny - OK
YAML - OK
HTTP::Headers - OK
List::Compare - OK
List::MoreUtils - OK
File::HomeDir - OK
Proc::Reliable - OK
Const::Fast - OK
Text::ParseWords - OK
Data::Compare - OK
LWP::UserAgent::Determined - OK
Timer::Simple - OK
QMake::Project - OK
File::Which - OK
Sub::Override - OK
Test::Perl::Critic - OK
Text::Wrap - OK
Lingua::EN::Inflect - OK
File::Find::Rule - OK
Tie::Sysctl - OK
Readonly - OK
Test::Warn - OK
Params::Validate - OK
AnyEvent::Watchdog - OK
Log::Dispatch - OK
IO::Prompt - OK
IO::CaptureOutput - OK
Win32::Status - OK
Inline::C - OK
Time::Piece - OK
Coro::AnyEvent - OK
Lingua::EN::Numbers - OK
Test::NoWarnings - OK
Class::Factory::Util - OK
IO::Uncompress::AnyInflate - OK
AnyEvent::Util - OK
Mail::Sender - OK
autodie - OK
IO::Interactive - OK
AnyEvent - OK
Test::Exception - OK
parent - OK
Test::Exit - OK
Env::Path - OK
AnyEvent::HTTP - OK
BSD::Resource - OK
File::Fetch - OK
Test::More - OK
Text::Diff - OK
Perl::Critic - OK
File::Copy::Recursive - OK
Tie::IxHash - OK
Data::Alias - OK
XML::Simple - OK
File::chdir - OK
Encode::Locale - OK
Text::Trim - OK
Class::Data::Inheritable - OK
File::Slurp - OK
Time::Out - OK
IO::Compress::Gzip - OK
App::cpanminus - OK
ReleaseAction - OK
Template - OK
AnyEvent::HTTPD - OK
Tie::Persistent - OK
YAML::Node - OK
JSON - OK
Config::Tiny - OK
It looks like your CPAN setup is complete :)
+ prove -I /work/build/qt/qtqa/scripts/lib/perl5 --merge --state=save -I /work/build/qt/qtqa/scripts/lib/perl5 --recurse /work/build/qt/qtqa/scripts
/work/build/qt/qtqa/scripts/generic/t/01-coveragerunner_testcocoon.t ...................... ok
/work/build/qt/qtqa/scripts/generic/t/01-testrunner-testcocoon.t .......................... ok
/work/build/qt/qtqa/scripts/generic/t/01-xml2html_testcocoon.t ............................ ok
/work/build/qt/qtqa/scripts/generic/t/10-testrunner.t .....................................
Dubious, test returned 16 (wstat 4096, 0x1000)
Failed 16/99 subtests
(less 1 skipped subtest: 82 okay)
/work/build/qt/qtqa/scripts/generic/t/15-testrunner-capture-logs.t ........................ ok
/work/build/qt/qtqa/scripts/generic/t/16-testrunner-capture-logs-race.t ................... ok
/work/build/qt/qtqa/scripts/generic/t/20-testrunner-core.t ................................ skipped: you must make /cores directory writable to run this test on mac
/work/build/qt/qtqa/scripts/generic/t/21-testrunner-flaky.t ............................... ok
/work/build/qt/qtqa/scripts/generic/t/22-testrunner-sync-output.t ......................... ok
/work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t ....................... ok
/work/build/qt/qtqa/scripts/generic/t/30-parse_build_log.t ................................ ok
/work/build/qt/qtqa/scripts/generic/t/40-testplanner.t .................................... ok
/work/build/qt/qtqa/scripts/generic/t/41-print_calling_makefile.t ......................... skipped: This test is relevant only on Win32 and nmake
/work/build/qt/qtqa/scripts/generic/t/50-testscheduler.t .................................. ok
/work/build/qt/qtqa/scripts/git/t/10-git-qtqa-combine.t ................................... ok
/work/build/qt/qtqa/scripts/jenkins/t/05-qt-jenkins-integrator.t .......................... ok
/work/build/qt/qtqa/scripts/jenkins/t/10-summarize-jenkins-build.t ........................ ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/Reliable/t/01-QtQA-Proc-Reliable-Win32.t .. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/10-reliable.t ........................... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/20-reliable-strategies.t ................ ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/Test/t/10-test-more-create_mock_command.t ...... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-Gerrit.t .................................. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-TestScript.t .............................. ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/20-TestScript-autodocs.t ..................... ok
/work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/30-TestScript-reliable-exe.t ................. ok
/work/build/qt/qtqa/scripts/t/10-perl-syntax-check.t ...................................... ok
/work/build/qt/qtqa/scripts/t/20-perl-critic-check.t ...................................... ok
/work/build/qt/qtqa/scripts/t/90-licenses.t ............................................... ok
Test Summary Report
-------------------
/work/build/qt/qtqa/scripts/generic/t/10-testrunner.t (Wstat: 4096 Tests: 99 Failed: 16)
Failed tests: 30, 32-33, 36, 38-39, 41, 43-44, 47, 67
69, 71, 73, 75, 77
Non-zero exit status: 16
/work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t (Wstat: 0 Tests: 22 Failed: 0)
TODO passed: 1-8, 10-13, 15-16, 18, 20-22
Files=28, Tests=1372, 238 wallclock secs ( 0.29 usr 0.06 sys + 153.04 cusr 10.87 csys = 164.26 CPU)
Result: FAIL
I'm going to run only the failed tests again:
+ prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose
# Failed test 'verbose success error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [-e] [use Data::Dumper; print Data::Dumper->new( \@ARGV )->Indent( 0 )->Dump( ); exit 0] [hello]
# QtQA::App::TestRunner: end perl: 0.016555 seconds, exit code 0
# '
# doesn't match '(?msx-i:
# \A
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*)\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ exit\ code\ 0\n
# \z
# )'
# Failed test 'label defaults to command name (begin)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 282.
# got: 'perl @ /work/build/qt/qtqa/scripts'
# expected: 'perl'
# Failed test at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 284.
# Failed test 'verbose fail error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin failure test @ /work/build/qt/qtqa/scripts: [perl] [-e] [use Data::Dumper; print Data::Dumper->new( \@ARGV )->Indent( 0 )->Dump( ); exit 3] [hello]
# QtQA::App::TestRunner: end failure test: 0.016819 seconds, exit code 3
# '
# doesn't match '(?msx-i:
# \A
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*)\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ exit\ code\ 3\n
# \z
# )'
# Failed test 'explicitly setting label works as expected (begin)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 294.
# got: 'failure test @ /work/build/qt/qtqa/scripts'
# expected: 'failure test'
# Failed test at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 296.
# Failed test 'verbose hanging error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin mytestcase__mytestfunc @ /work/build/qt/qtqa/scripts: [perl] [-e] [use Data::Dumper; print Data::Dumper->new( \@ARGV )->Indent( 0 )->Dump( ); while (1) { sleep(1000) }] [hello]
# QtQA::App::TestRunner: Timed out after 2 seconds
# QtQA::App::TestRunner: Process exited due to signal 15
# QtQA::App::TestRunner: end mytestcase__mytestfunc: 2 seconds, signal 15
# '
# doesn't match '(?msx-i:
# \A
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*)\n
# (?msx-i:
# QtQA::App::TestRunner:\ Timed\ out\ after\ \d+\ seconds?\n
# (?-xism:QtQA::App::TestRunner: Process exited due to signal 15\n)
# )
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\n # note, exit status is undefined (thus untested) on hang
# )'
# Failed test ': is stripped from label (begin)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 306.
# got: 'mytestcase__mytestfunc @ /work/build/qt/qtqa/scripts'
# expected: 'mytestcase__mytestfunc'
# Failed test at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 308.
# Failed test 'timeout warning error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [-e] [use Data::Dumper; print Data::Dumper->new( \@ARGV )->Indent( 0 )->Dump( ); sleep(4); exit 0] [hello]
# QtQA::App::TestRunner: warning: test duration (4 seconds) is dangerously close to maximum permitted time (5 seconds)
# QtQA::App::TestRunner: warning: Either modify the test to reduce its runtime, or use a higher timeout.
# QtQA::App::TestRunner: end perl: 4 seconds, exit code 0
# '
# doesn't match '(?msx-i:
# \A
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*)\n
# (?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ warning\:\ test\ duration\ \(4\ seconds\)\ is\ dangerously\ close\ to\ maximum\ permitted\ time\ \(5\ seconds\)\n
# QtQA\:\:App\:\:TestRunner\:\ warning\:\ Either\ modify\ the\ test\ to\ reduce\ its\ runtime\,\ or\ use\ a\ higher\ timeout\.\n
# )
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\n
# \z
# )'
# Failed test 'crash windows cmd metacharacters error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl] [hello %there%] [how ^are "you' today]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.237751 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Failed test 'crash posix sh metacharacters error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl] [hello |there] [how $are "you' !today]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.193703 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Failed test 'crash whitespace error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl] [hello there] [ ]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.200375 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Failed test 'crash no args error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.200433 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Failed test 'crash trivial error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl] [hello]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.193331 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Failed test 'crash non-ascii error looks correct (regex match)'
# at /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t line 206.
# 'QtQA::App::TestRunner: begin perl @ /work/build/qt/qtqa/scripts: [perl] [/work/build/qt/qtqa/scripts/generic/t/helpers/dereference_bad_pointer.pl] [早上好] [你好马？]
# QtQA::App::TestRunner: Process exited due to signal 11
# QtQA::App::TestRunner: end perl: 0.199653 seconds, signal 11
# '
# doesn't match '(?-xism:(?msx-i:\A (?-xism:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?msx-i:
# QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ due\ to\ signal\ 11(?:;\ dumped\ core)?\n
# (?-xism:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>.*?)\s\@[^:]+\:\ [^\n]*)\,\ signal\ 11\n
# \z))'
# Looks like you failed 16 tests of 99.
/work/build/qt/qtqa/scripts/generic/t/10-testrunner.t ..
ok 1 - fails with no args exits non-zero
ok 2 - fails with no args output looks correct (exact match)
ok 3 - fails with no args error looks correct (regex match)
ok 4 - --help parsed OK exits non-zero
ok 5 - --help parsed OK output looks correct (regex match)
ok 6 - --help parsed OK error looks correct (exact match)
ok 7 - -- stops argument processing exits non-zero
ok 8 - -- stops argument processing output looks correct (exact match)
ok 9 - -- stops argument processing error looks correct (regex match)
ok 10 - successful windows cmd metacharacters exits zero
ok 11 - successful windows cmd metacharacters output looks correct (exact match)
ok 12 - successful windows cmd metacharacters error looks correct (exact match)
ok 13 - successful posix sh metacharacters exits zero
ok 14 - successful posix sh metacharacters output looks correct (exact match)
ok 15 - successful posix sh metacharacters error looks correct (exact match)
ok 16 - successful whitespace exits zero
ok 17 - successful whitespace output looks correct (exact match)
ok 18 - successful whitespace error looks correct (exact match)
ok 19 - successful no args exits zero
ok 20 - successful no args output looks correct (exact match)
ok 21 - successful no args error looks correct (exact match)
ok 22 - successful trivial exits zero
ok 23 - successful trivial output looks correct (exact match)
ok 24 - successful trivial error looks correct (exact match)
ok 25 - successful non-ascii exits zero
ok 26 - successful non-ascii output looks correct (exact match)
ok 27 - successful non-ascii error looks correct (exact match)
ok 28 - verbose success exits zero
ok 29 - verbose success output looks correct (exact match)
not ok 30 - verbose success error looks correct (regex match)
ok 31
not ok 32 - label defaults to command name (begin)
not ok 33
ok 34 - verbose fail exits non-zero
ok 35 - verbose fail output looks correct (exact match)
not ok 36 - verbose fail error looks correct (regex match)
ok 37
not ok 38 - explicitly setting label works as expected (begin)
not ok 39
ok 40 - verbose hanging exits non-zero
not ok 41 - verbose hanging error looks correct (regex match)
ok 42
not ok 43 - : is stripped from label (begin)
not ok 44
ok 45 - timeout warning exits zero
ok 46 - timeout warning output looks correct (exact match)
not ok 47 - timeout warning error looks correct (regex match)
ok 48 - failure windows cmd metacharacters exits non-zero
ok 49 - failure windows cmd metacharacters output looks correct (exact match)
ok 50 - failure windows cmd metacharacters error looks correct (exact match)
ok 51 - failure posix sh metacharacters exits non-zero
ok 52 - failure posix sh metacharacters output looks correct (exact match)
ok 53 - failure posix sh metacharacters error looks correct (exact match)
ok 54 - failure whitespace exits non-zero
ok 55 - failure whitespace output looks correct (exact match)
ok 56 - failure whitespace error looks correct (exact match)
ok 57 - failure no args exits non-zero
ok 58 - failure no args output looks correct (exact match)
ok 59 - failure no args error looks correct (exact match)
ok 60 - failure trivial exits non-zero
ok 61 - failure trivial output looks correct (exact match)
ok 62 - failure trivial error looks correct (exact match)
ok 63 - failure non-ascii exits non-zero
ok 64 - failure non-ascii output looks correct (exact match)
ok 65 - failure non-ascii error looks correct (exact match)
ok 66 - crash windows cmd metacharacters exits non-zero
not ok 67 - crash windows cmd metacharacters error looks correct (regex match)
ok 68 - crash posix sh metacharacters exits non-zero
not ok 69 - crash posix sh metacharacters error looks correct (regex match)
ok 70 - crash whitespace exits non-zero
not ok 71 - crash whitespace error looks correct (regex match)
ok 72 - crash no args exits non-zero
not ok 73 - crash no args error looks correct (regex match)
ok 74 - crash trivial exits non-zero
not ok 75 - crash trivial error looks correct (regex match)
ok 76 - crash non-ascii exits non-zero
not ok 77 - crash non-ascii error looks correct (regex match)
ok 78 # skip divide by zero is unpredictable on mac
ok 79 - hanging windows cmd metacharacters exits non-zero
ok 80 - hanging windows cmd metacharacters error looks correct (regex match)
ok 81 - hanging posix sh metacharacters exits non-zero
ok 82 - hanging posix sh metacharacters error looks correct (regex match)
ok 83 - hanging whitespace exits non-zero
ok 84 - hanging whitespace error looks correct (regex match)
ok 85 - hanging no args exits non-zero
ok 86 - hanging no args error looks correct (regex match)
ok 87 - hanging trivial exits non-zero
ok 88 - hanging trivial error looks correct (regex match)
ok 89 - hanging non-ascii exits non-zero
ok 90 - hanging non-ascii error looks correct (regex match)
ok 91 - cwd as expected with no chdir exits zero
ok 92 - cwd as expected with no chdir output looks correct (exact match)
ok 93 - cwd as expected with no chdir error looks correct (exact match)
ok 94 - cwd as expected with --chdir exits zero
ok 95 - cwd as expected with --chdir output looks correct (exact match)
ok 96 - cwd as expected with --chdir error looks correct (exact match)
ok 97 - cwd as expected with -C exits zero
ok 98 - cwd as expected with -C output looks correct (exact match)
ok 99 - cwd as expected with -C error looks correct (exact match)
1..99
Dubious, test returned 16 (wstat 4096, 0x1000)
Failed 16/99 subtests
(less 1 skipped subtest: 82 okay)
Test Summary Report
-------------------
/work/build/qt/qtqa/scripts/generic/t/10-testrunner.t (Wstat: 4096 Tests: 99 Failed: 16)
Failed tests: 30, 32-33, 36, 38-39, 41, 43-44, 47, 67
69, 71, 73, 75, 77
Non-zero exit status: 16
Files=1, Tests=99, 24 wallclock secs ( 0.03 usr 0.01 sys + 4.45 cusr 0.51 csys = 5.00 CPU)
Result: FAIL
prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose exited with value 1
QtQA::App::TestRunner: test failed on first and second attempts, but with different behavior each time:
QtQA::App::TestRunner: first attempt: exited with exit code 2
QtQA::App::TestRunner: second attempt: exited with exit code 1
QtQA::App::TestRunner: the test seems to be flaky, please fix this
QtQA::App::TestRunner: this flaky test is being treated as a FAIL
QtQA::App::TestRunner: end scripts: 537 seconds, exit code 1
Build log: http://testresults.qt.io/ci/QtQA_master_Integration/build_00695/macx-clang_developer-build_OSX_10.9/log.txt.gz
Tested changes (refs/builds/master_1433496689):
http://codereview.qt-project.org/110457 [PS2] - Add path for test executable to log files
More information about the Ci-reports
mailing list