[Ci-reports] fail on ssh://codereview.qt-project.org:29418/qt/qtqa#master

Qt Continuous Integration System ci-noreply at qt-project.org
Wed Sep 4 11:06:09 CEST 2013 

Autotest `scripts' failed :(

The test was determined to be flaky, meaning results were not consistent across multiple runs.  This might make the problem difficult to reproduce.  Also, flaky failures might or might not be related to any recent changes in the source code.

  + perl /work/build/qt/qtqa/scripts/setup.pl --install
  
  Checking perl modules ...
  Capture::Tiny - OK
  YAML - OK
  HTTP::Headers - OK
  List::Compare - OK
  List::MoreUtils - OK
  File::HomeDir - OK
  Proc::Reliable - OK
  Const::Fast - OK
  Text::ParseWords - OK
  Data::Compare - OK
  LWP::UserAgent::Determined - OK
  Timer::Simple - OK
  QMake::Project - OK
  File::Which - OK
  Sub::Override - OK
  Test::Perl::Critic - OK
  Text::Wrap - OK
  Lingua::EN::Inflect - OK
  File::Find::Rule - OK
  Tie::Sysctl - OK
  Readonly - OK
  Test::Warn - OK
  Params::Validate - OK
  AnyEvent::Watchdog - OK
  Log::Dispatch - OK
  IO::Prompt - OK
  IO::CaptureOutput - OK
  Win32::Status - OK
  Inline::C - OK
  Time::Piece - OK
  Coro::AnyEvent - OK
  Lingua::EN::Numbers - OK
  Test::NoWarnings - OK
  Class::Factory::Util - OK
  IO::Uncompress::AnyInflate - OK
  AnyEvent::Util - OK
  autodie - OK
  Mail::Sender - OK
  IO::Interactive - OK
  AnyEvent - OK
  Test::Exception - OK
  parent - OK
  Test::Exit - OK
  Env::Path - OK
  AnyEvent::HTTP - OK
  BSD::Resource - OK
  File::Fetch - OK
  Test::More - OK
  Text::Diff - OK
  Perl::Critic - OK
  File::Copy::Recursive - OK
  Tie::IxHash - OK
  Data::Alias - OK
  XML::Simple - OK
  File::chdir - OK
  Encode::Locale - OK
  Text::Trim - OK
  Class::Data::Inheritable - OK
  File::Slurp - OK
  IO::Compress::Gzip - OK
  App::cpanminus - OK
  ReleaseAction - OK
  Template - OK
  AnyEvent::HTTPD - OK
  Tie::Persistent - OK
  YAML::Node - OK
  JSON - OK
  Config::Tiny - OK
  
  It looks like your CPAN setup is complete :)
  + prove -I /work/build/qt/qtqa/scripts/lib/perl5 --merge --state=save -I /work/build/qt/qtqa/scripts/lib/perl5 --recurse /work/build/qt/qtqa/scripts
  /work/build/qt/qtqa/scripts/generic/t/01-coveragerunner_testcocoon.t ...................... ok
  /work/build/qt/qtqa/scripts/generic/t/01-testrunner-testcocoon.t .......................... ok
  /work/build/qt/qtqa/scripts/generic/t/01-xml2html_testcocoon.t ............................ ok
  /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t ..................................... ok
  /work/build/qt/qtqa/scripts/generic/t/15-testrunner-capture-logs.t ........................ ok
  /work/build/qt/qtqa/scripts/generic/t/16-testrunner-capture-logs-race.t ................... ok
  /work/build/qt/qtqa/scripts/generic/t/20-testrunner-core.t ................................ ok
  /work/build/qt/qtqa/scripts/generic/t/21-testrunner-flaky.t ............................... ok
  /work/build/qt/qtqa/scripts/generic/t/22-testrunner-sync-output.t ......................... ok
  /work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t ....................... ok
  /work/build/qt/qtqa/scripts/generic/t/30-parse_build_log.t ................................ ok
  /work/build/qt/qtqa/scripts/generic/t/40-testplanner.t .................................... ok
  /work/build/qt/qtqa/scripts/generic/t/41-print_calling_makefile.t ......................... skipped: This test is relevant only on Win32 and nmake
  /work/build/qt/qtqa/scripts/generic/t/50-testscheduler.t .................................. ok
  /work/build/qt/qtqa/scripts/git/t/10-git-qtqa-combine.t ................................... ok
  /work/build/qt/qtqa/scripts/jenkins/t/05-qt-jenkins-integrator.t .......................... ok
  /work/build/qt/qtqa/scripts/jenkins/t/10-summarize-jenkins-build.t ........................ ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/Reliable/t/01-QtQA-Proc-Reliable-Win32.t .. ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/10-reliable.t ........................... ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/20-reliable-strategies.t ................ ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/Test/t/10-test-more-create_mock_command.t ...... ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-Gerrit.t .................................. ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-TestScript.t .............................. ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/20-TestScript-autodocs.t ..................... ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/30-TestScript-reliable-exe.t ................. ok
  /work/build/qt/qtqa/scripts/t/10-perl-syntax-check.t ...................................... ok
  /work/build/qt/qtqa/scripts/t/20-perl-critic-check.t ...................................... ok
  /work/build/qt/qtqa/scripts/t/90-licenses.t ...............................................
  Dubious, test returned 1 (wstat 256, 0x100)
  Failed 1/3 subtests
  
  Test Summary Report
  -------------------
  /work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t                     (Wstat: 0 Tests: 22 Failed: 0)
    TODO passed:   1-8, 10-13, 15-16, 18, 20-22
  /work/build/qt/qtqa/scripts/t/90-licenses.t                                             (Wstat: 256 Tests: 3 Failed: 1)
    Failed test:  3
    Non-zero exit status: 1
  Files=28, Tests=1400, 243 wallclock secs ( 0.27 usr  0.06 sys + 164.03 cusr 20.90 csys = 185.26 CPU)
  Result: FAIL
  
  
  I'm going to run only the failed tests again:
  + prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose
  # testing tst_licenses.pl under /work/build/qt/qtqa/scripts/test_pl_tmp/90-licenses.t-m0IQUD
  
  #   Failed test 'tst_licenses.pl output matches expected'
  #   at /work/build/qt/qtqa/scripts/t/90-licenses.t line 112.
  # --- expected output of tst_licenses.pl
  # +++ actual output of tst_licenses.pl
  # @@ -1,3 +1,4 @@
  # +Possible attempt to put comments in qw() list at /work/build/qt/qtqa/tests/prebuild/license/tst_licenses.pl line 79.
  #  1..12
  #  not ok x - QT_BEGIN_LICENSE does not follow Copyright block in bad/missing-license-info.qdoc, line 8
  #  not ok x - Mismatch in license text in bad/multiple-header-one-wrong.s
  # Looks like you failed 1 test of 3.
  /work/build/qt/qtqa/scripts/t/90-licenses.t ..
  ok 1 - tst_licenses.pl exists
  ok 2 - license-testdata exists
  not ok 3 - tst_licenses.pl output matches expected
  1..3
  Dubious, test returned 1 (wstat 256, 0x100)
  Failed 1/3 subtests
  
  Test Summary Report
  -------------------
  /work/build/qt/qtqa/scripts/t/90-licenses.t (Wstat: 256 Tests: 3 Failed: 1)
    Failed test:  3
    Non-zero exit status: 1
  Files=1, Tests=3,  0 wallclock secs ( 0.02 usr  0.00 sys +  0.13 cusr  0.01 csys =  0.16 CPU)
  Result: FAIL
  prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose exited with value 1
  QtQA::App::TestRunner: test failed, running again to see if it is flaky...
  + perl /work/build/qt/qtqa/scripts/setup.pl --install
  
  Checking perl modules ...
  Capture::Tiny - OK
  YAML - OK
  HTTP::Headers - OK
  List::Compare - OK
  List::MoreUtils - OK
  File::HomeDir - OK
  Proc::Reliable - OK
  Const::Fast - OK
  Text::ParseWords - OK
  Data::Compare - OK
  LWP::UserAgent::Determined - OK
  Timer::Simple - OK
  QMake::Project - OK
  File::Which - OK
  Sub::Override - OK
  Test::Perl::Critic - OK
  Text::Wrap - OK
  Lingua::EN::Inflect - OK
  File::Find::Rule - OK
  Tie::Sysctl - OK
  Readonly - OK
  Test::Warn - OK
  Params::Validate - OK
  AnyEvent::Watchdog - OK
  Log::Dispatch - OK
  IO::Prompt - OK
  IO::CaptureOutput - OK
  Win32::Status - OK
  Inline::C - OK
  Time::Piece - OK
  Coro::AnyEvent - OK
  Lingua::EN::Numbers - OK
  Test::NoWarnings - OK
  Class::Factory::Util - OK
  IO::Uncompress::AnyInflate - OK
  AnyEvent::Util - OK
  autodie - OK
  Mail::Sender - OK
  IO::Interactive - OK
  AnyEvent - OK
  Test::Exception - OK
  parent - OK
  Test::Exit - OK
  Env::Path - OK
  AnyEvent::HTTP - OK
  BSD::Resource - OK
  File::Fetch - OK
  Test::More - OK
  Text::Diff - OK
  Perl::Critic - OK
  File::Copy::Recursive - OK
  Tie::IxHash - OK
  Data::Alias - OK
  XML::Simple - OK
  File::chdir - OK
  Encode::Locale - OK
  Text::Trim - OK
  Class::Data::Inheritable - OK
  File::Slurp - OK
  IO::Compress::Gzip - OK
  App::cpanminus - OK
  ReleaseAction - OK
  Template - OK
  AnyEvent::HTTPD - OK
  Tie::Persistent - OK
  YAML::Node - OK
  JSON - OK
  Config::Tiny - OK
  
  It looks like your CPAN setup is complete :)
  + prove -I /work/build/qt/qtqa/scripts/lib/perl5 --merge --state=save -I /work/build/qt/qtqa/scripts/lib/perl5 --recurse /work/build/qt/qtqa/scripts
  /work/build/qt/qtqa/scripts/generic/t/01-coveragerunner_testcocoon.t ...................... ok
  /work/build/qt/qtqa/scripts/generic/t/01-testrunner-testcocoon.t .......................... ok
  /work/build/qt/qtqa/scripts/generic/t/01-xml2html_testcocoon.t ............................ ok
  /work/build/qt/qtqa/scripts/generic/t/10-testrunner.t ..................................... ok
  /work/build/qt/qtqa/scripts/generic/t/15-testrunner-capture-logs.t ........................ ok
  /work/build/qt/qtqa/scripts/generic/t/16-testrunner-capture-logs-race.t ................... ok
  /work/build/qt/qtqa/scripts/generic/t/20-testrunner-core.t ................................ ok
  /work/build/qt/qtqa/scripts/generic/t/21-testrunner-flaky.t ............................... ok
  /work/build/qt/qtqa/scripts/generic/t/22-testrunner-sync-output.t ......................... ok
  /work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t ....................... ok
  /work/build/qt/qtqa/scripts/generic/t/30-parse_build_log.t ................................ ok
  /work/build/qt/qtqa/scripts/generic/t/40-testplanner.t .................................... ok
  /work/build/qt/qtqa/scripts/generic/t/41-print_calling_makefile.t ......................... skipped: This test is relevant only on Win32 and nmake
  /work/build/qt/qtqa/scripts/generic/t/50-testscheduler.t .................................. ok
  /work/build/qt/qtqa/scripts/git/t/10-git-qtqa-combine.t ................................... ok
  /work/build/qt/qtqa/scripts/jenkins/t/05-qt-jenkins-integrator.t .......................... ok
  /work/build/qt/qtqa/scripts/jenkins/t/10-summarize-jenkins-build.t ........................ ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/Reliable/t/01-QtQA-Proc-Reliable-Win32.t .. ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/10-reliable.t ........................... ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/Proc/t/20-reliable-strategies.t ................ ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/Test/t/10-test-more-create_mock_command.t ...... ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-Gerrit.t .................................. ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/10-TestScript.t .............................. ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/20-TestScript-autodocs.t ..................... ok
  /work/build/qt/qtqa/scripts/lib/perl5/QtQA/t/30-TestScript-reliable-exe.t ................. ok
  /work/build/qt/qtqa/scripts/t/10-perl-syntax-check.t ...................................... ok
  /work/build/qt/qtqa/scripts/t/20-perl-critic-check.t ...................................... ok
  /work/build/qt/qtqa/scripts/t/90-licenses.t ...............................................
  Dubious, test returned 1 (wstat 256, 0x100)
  Failed 1/3 subtests
  
  Test Summary Report
  -------------------
  /work/build/qt/qtqa/scripts/generic/t/23-testrunner-crashreporter.t                     (Wstat: 0 Tests: 22 Failed: 0)
    TODO passed:   1-8, 10-13, 15-16, 18, 20-22
  /work/build/qt/qtqa/scripts/t/90-licenses.t                                             (Wstat: 256 Tests: 3 Failed: 1)
    Failed test:  3
    Non-zero exit status: 1
  Files=28, Tests=1400, 237 wallclock secs ( 0.26 usr  0.06 sys + 154.96 cusr 18.22 csys = 173.50 CPU)
  Result: FAIL
  
  
  I'm going to run only the failed tests again:
  + prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose
  # testing tst_licenses.pl under /work/build/qt/qtqa/scripts/test_pl_tmp/90-licenses.t-5bgEwI
  
  #   Failed test 'tst_licenses.pl output matches expected'
  #   at /work/build/qt/qtqa/scripts/t/90-licenses.t line 112.
  # --- expected output of tst_licenses.pl
  # +++ actual output of tst_licenses.pl
  # @@ -1,3 +1,4 @@
  # +Possible attempt to put comments in qw() list at /work/build/qt/qtqa/tests/prebuild/license/tst_licenses.pl line 79.
  #  1..12
  #  not ok x - QT_BEGIN_LICENSE does not follow Copyright block in bad/missing-license-info.qdoc, line 8
  #  not ok x - Mismatch in license text in bad/multiple-header-one-wrong.s
  # Looks like you failed 1 test of 3.
  /work/build/qt/qtqa/scripts/t/90-licenses.t ..
  ok 1 - tst_licenses.pl exists
  ok 2 - license-testdata exists
  not ok 3 - tst_licenses.pl output matches expected
  1..3
  Dubious, test returned 1 (wstat 256, 0x100)
  Failed 1/3 subtests
  
  Test Summary Report
  -------------------
  /work/build/qt/qtqa/scripts/t/90-licenses.t (Wstat: 256 Tests: 3 Failed: 1)
    Failed test:  3
    Non-zero exit status: 1
  Files=1, Tests=3,  0 wallclock secs ( 0.02 usr  0.00 sys +  0.12 cusr  0.01 csys =  0.15 CPU)
  Result: FAIL
  prove -I /work/build/qt/qtqa/scripts/lib/perl5 --state=failed,save --verbose exited with value 1
  QtQA::App::TestRunner: test failed on first and second attempts, but with different behavior each time:
  QtQA::App::TestRunner:   first attempt:  exited with exit code 2
  QtQA::App::TestRunner:   second attempt: exited with exit code 1
  QtQA::App::TestRunner: the test seems to be flaky, please fix this
  QtQA::App::TestRunner: this flaky test is being treated as a FAIL
  QtQA::App::TestRunner: end scripts: 485 seconds, exit code 1

  Build log: http://testresults.qt-project.org/ci/QtQA_master_Integration/build_00548/macx-clang_developer-build_OSX_10.8/log.txt.gz

  Tested changes (refs/builds/master_1378284693):
    http://codereview.qt-project.org/64576 [PS2] - qtqa: skip QtWebEngine's license check

More information about the Ci-reports mailing list