[Ci-reports] fail on Qt5_5.4_Integration #335

Qt Continuous Integration System ci-noreply at qt-project.org
Mon Mar 23 09:38:27 CET 2015


Autotest `scripts' failed :(

  + perl C:\work\build\qtqa\scripts\setup.pl --install
  
  Checking perl modules ...
  Capture::Tiny - OK
  YAML - OK
  IO::CaptureOutput - OK
  Win32::Status - OK
  Inline::C - OK
  Time::Piece - OK
  Coro::AnyEvent - OK
  Lingua::EN::Numbers - OK
  Test::NoWarnings - OK
  Class::Factory::Util - OK
  IO::Uncompress::AnyInflate - OK
  AnyEvent::Util - OK
  HTTP::Headers - OK
  autodie - OK
  List::Compare - OK
  List::MoreUtils - OK
  AnyEvent - OK
  Test::Exception - OK
  parent - OK
  File::HomeDir - OK
  Test::Exit - OK
  Env::Path - OK
  AnyEvent::HTTP - OK
  File::Fetch - OK
  Const::Fast - OK
  Test::More - OK
  Text::Diff - OK
  Data::Compare - OK
  Perl::Critic - OK
  Text::ParseWords - OK
  LWP::UserAgent::Determined - OK
  File::Copy::Recursive - OK
  QMake::Project - OK
  Timer::Simple - OK
  Tie::IxHash - OK
  File::Which - OK
  XML::Simple - OK
  File::chdir - OK
  Win32::Job - OK
  Sub::Override - OK
  Text::Trim - OK
  Test::Perl::Critic - OK
  Lingua::EN::Inflect - OK
  Text::Wrap - OK
  Class::Data::Inheritable - OK
  File::Slurp - OK
  File::Find::Rule - OK
  Time::Out - OK
  ReleaseAction - OK
  App::cpanminus - OK
  Template - OK
  Readonly - OK
  Win32::Process::Info - OK
  Params::Validate - OK
  Test::Warn - OK
  Win32::Process - OK
  YAML::Node - OK
  JSON - OK
  Config::Tiny - OK
  IO::Prompt - OK
  
  It looks like your CPAN setup is complete :)
  + prove -I C:/work/build/qtqa/scripts/lib/perl5 --merge --state=save -I C:/work/build/qtqa/scripts/lib/perl5 --recurse C:/work/build/qtqa/scripts
  C:/work/build/qtqa/scripts/generic/t/01-coveragerunner_testcocoon.t ...................... ok
  C:/work/build/qtqa/scripts/generic/t/01-testrunner-testcocoon.t .......................... ok
  C:/work/build/qtqa/scripts/generic/t/01-xml2html_testcocoon.t ............................ ok
  C:/work/build/qtqa/scripts/generic/t/10-testrunner.t .....................................
  Dubious, test returned 12 (wstat 3072, 0xc00)
  Failed 12/105 subtests
  C:/work/build/qtqa/scripts/generic/t/15-testrunner-capture-logs.t ........................
  Dubious, test returned 3 (wstat 768, 0x300)
  Failed 3/140 subtests
  	(less 1 skipped subtest: 136 okay)
  C:/work/build/qtqa/scripts/generic/t/16-testrunner-capture-logs-race.t ................... ok
  C:/work/build/qtqa/scripts/generic/t/20-testrunner-core.t ................................ skipped: test is not relevant on MSWin32
  C:/work/build/qtqa/scripts/generic/t/21-testrunner-flaky.t ............................... ok
  C:/work/build/qtqa/scripts/generic/t/22-testrunner-sync-output.t ......................... ok
  C:/work/build/qtqa/scripts/generic/t/23-testrunner-crashreporter.t ....................... skipped: test is not relevant on MSWin32
  C:/work/build/qtqa/scripts/generic/t/30-parse_build_log.t ................................ ok
  C:/work/build/qtqa/scripts/generic/t/40-testplanner.t .................................... ok
  C:/work/build/qtqa/scripts/generic/t/41-print_calling_makefile.t ......................... ok
  C:/work/build/qtqa/scripts/generic/t/50-testscheduler.t .................................. ok
  C:/work/build/qtqa/scripts/git/t/10-git-qtqa-combine.t ................................... skipped: git-qtqa-combine is not supported on MSWin32
  C:/work/build/qtqa/scripts/jenkins/t/05-qt-jenkins-integrator.t .......................... skipped: QtQA::GerritJenkinsIntegrator is not supported on MSWin32
  C:/work/build/qtqa/scripts/jenkins/t/10-summarize-jenkins-build.t ........................ ok
  C:/work/build/qtqa/scripts/lib/perl5/QtQA/Proc/Reliable/t/01-QtQA-Proc-Reliable-Win32.t .. ok
  C:/work/build/qtqa/scripts/lib/perl5/QtQA/Proc/t/10-reliable.t ........................... ok
  C:/work/build/qtqa/scripts/lib/perl5/QtQA/Proc/t/20-reliable-strategies.t ................ ok
  C:/work/build/qtqa/scripts/lib/perl5/QtQA/Test/t/10-test-more-create_mock_command.t ...... ok
  C:/work/build/qtqa/scripts/lib/perl5/QtQA/t/10-Gerrit.t .................................. ok
  C:/work/build/qtqa/scripts/lib/perl5/QtQA/t/10-TestScript.t .............................. ok
  C:/work/build/qtqa/scripts/lib/perl5/QtQA/t/20-TestScript-autodocs.t ..................... ok
  C:/work/build/qtqa/scripts/lib/perl5/QtQA/t/30-TestScript-reliable-exe.t ................. ok
  C:/work/build/qtqa/scripts/t/10-perl-syntax-check.t ...................................... ok
  C:/work/build/qtqa/scripts/t/20-perl-critic-check.t ...................................... ok
  C:/work/build/qtqa/scripts/t/90-licenses.t ............................................... ok
  
  Test Summary Report
  -------------------
  C:/work/build/qtqa/scripts/generic/t/10-testrunner.t                                   (Wstat: 3072 Tests: 105 Failed: 12)
    Failed tests:  62, 64, 66, 68, 70, 72, 74, 76, 78, 80
                  82, 84
    Non-zero exit status: 12
  C:/work/build/qtqa/scripts/generic/t/15-testrunner-capture-logs.t                      (Wstat: 768 Tests: 140 Failed: 3)
    Failed tests:  134, 138, 140
    Non-zero exit status: 3
  Files=28, Tests=1082, 470 wallclock secs ( 0.45 usr +  0.11 sys =  0.56 CPU)
  Result: FAIL
  
  
  I'm going to run only the failed tests again:
  + prove -I C:/work/build/qtqa/scripts/lib/perl5 --state=failed,save --verbose
  
  #   Failed test 'crash windows cmd metacharacters error looks correct (regex match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #                   'QtQA::App::TestRunner: begin perl: [perl] [C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl] [hello %there%] [how] [^are] [you' today]
  # 'dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\Crash_32e2
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl line 0
  # INIT failed--call queue aborted.
  # QtQA::App::TestRunner: end perl: 1 seconds, exit code 1
  # '
  #     doesn't match '(?^:(?^msx:\A (?^:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?^msx:
  #               QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ with\ exit\ code\ 0xC0000005\ \(STATUS_ACCESS_VIOLATION\)\n
  #               (?^:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>[^:]+)\:\ [^\n]*)\,\ exit\ code\ 3221225477\n
  #             \z))'
  
  #   Failed test 'crash posix sh metacharacters error looks correct (regex match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #                   'QtQA::App::TestRunner: begin perl: [perl] [C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl] [hello |there] [how] [$are] [you' !today]
  # 'dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\Crash_32e2
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl line 0
  # INIT failed--call queue aborted.
  # QtQA::App::TestRunner: end perl: 1 seconds, exit code 1
  # '
  #     doesn't match '(?^:(?^msx:\A (?^:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?^msx:
  #               QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ with\ exit\ code\ 0xC0000005\ \(STATUS_ACCESS_VIOLATION\)\n
  #               (?^:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>[^:]+)\:\ [^\n]*)\,\ exit\ code\ 3221225477\n
  #             \z))'
  
  #   Failed test 'crash whitespace error looks correct (regex match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #                   'QtQA::App::TestRunner: begin perl: [perl] [C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl] [hello there] [ ]
  # 'dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\Crash_32e2
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl line 0
  # INIT failed--call queue aborted.
  # QtQA::App::TestRunner: end perl: 1 seconds, exit code 1
  # '
  #     doesn't match '(?^:(?^msx:\A (?^:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?^msx:
  #               QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ with\ exit\ code\ 0xC0000005\ \(STATUS_ACCESS_VIOLATION\)\n
  #               (?^:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>[^:]+)\:\ [^\n]*)\,\ exit\ code\ 3221225477\n
  #             \z))'
  
  #   Failed test 'crash no args error looks correct (regex match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #                   'QtQA::App::TestRunner: begin perl: [perl] [C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl]
  # 'dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\Crash_32e2
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl line 0
  # INIT failed--call queue aborted.
  # QtQA::App::TestRunner: end perl: 1 seconds, exit code 1
  # '
  #     doesn't match '(?^:(?^msx:\A (?^:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?^msx:
  #               QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ with\ exit\ code\ 0xC0000005\ \(STATUS_ACCESS_VIOLATION\)\n
  #               (?^:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>[^:]+)\:\ [^\n]*)\,\ exit\ code\ 3221225477\n
  #             \z))'
  
  #   Failed test 'crash trivial error looks correct (regex match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #                   'QtQA::App::TestRunner: begin perl: [perl] [C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl] [hello]
  # 'dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\Crash_32e2
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl line 0
  # INIT failed--call queue aborted.
  # QtQA::App::TestRunner: end perl: 1 seconds, exit code 1
  # '
  #     doesn't match '(?^:(?^msx:\A (?^:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?^msx:
  #               QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ with\ exit\ code\ 0xC0000005\ \(STATUS_ACCESS_VIOLATION\)\n
  #               (?^:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>[^:]+)\:\ [^\n]*)\,\ exit\ code\ 3221225477\n
  #             \z))'
  
  #   Failed test 'crash non-ascii error looks correct (regex match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #                   'QtQA::App::TestRunner: begin perl: [perl] [C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl] [早上好] [你好马?]
  # 'dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\Crash_32e2
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl line 0
  # INIT failed--call queue aborted.
  # QtQA::App::TestRunner: end perl: 1 seconds, exit code 1
  # '
  #     doesn't match '(?^:(?^msx:\A (?^:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?^msx:
  #               QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ with\ exit\ code\ 0xC0000005\ \(STATUS_ACCESS_VIOLATION\)\n
  #               (?^:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>[^:]+)\:\ [^\n]*)\,\ exit\ code\ 3221225477\n
  #             \z))'
  
  #   Failed test 'divide by zero windows cmd metacharacters error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  
  #   Failed test 'divide by zero posix sh metacharacters error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  
  #   Failed test 'divide by zero whitespace error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  
  #   Failed test 'divide by zero no args error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  
  #   Failed test 'divide by zero trivial error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  
  #   Failed test 'divide by zero non-ascii error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  # Looks like you failed 12 tests of 105.
  C:/work/build/qtqa/scripts/generic/t/10-testrunner.t ...............
  ok 1 - fails with no args exits non-zero
  ok 2 - fails with no args output looks correct (exact match)
  ok 3 - fails with no args error looks correct (regex match)
  ok 4 - --help parsed OK exits non-zero
  ok 5 - --help parsed OK output looks correct (regex match)
  ok 6 - --help parsed OK error looks correct (exact match)
  ok 7 - -- stops argument processing exits non-zero
  ok 8 - -- stops argument processing output looks correct (exact match)
  ok 9 - -- stops argument processing error looks correct (regex match)
  not ok 10 # TODO & SKIP handling of shell metacharacters not yet defined on Windows
  not ok 11 # TODO & SKIP handling of shell metacharacters not yet defined on Windows
  ok 12 - successful whitespace exits zero
  ok 13 - successful whitespace output looks correct (exact match)
  ok 14 - successful whitespace error looks correct (exact match)
  ok 15 - successful no args exits zero
  ok 16 - successful no args output looks correct (exact match)
  ok 17 - successful no args error looks correct (exact match)
  ok 18 - successful trivial exits zero
  ok 19 - successful trivial output looks correct (exact match)
  ok 20 - successful trivial error looks correct (exact match)
  ok 21 - successful non-ascii exits zero
  ok 22 - successful non-ascii output looks correct (exact match)
  ok 23 - successful non-ascii error looks correct (exact match)
  ok 24 - verbose success exits zero
  ok 25 - verbose success output looks correct (exact match)
  ok 26 - verbose success error looks correct (regex match)
  ok 27
  ok 28 - label defaults to command name (begin)
  ok 29
  ok 30 - label defaults to command name (end)
  ok 31 - verbose fail exits non-zero
  ok 32 - verbose fail output looks correct (exact match)
  ok 33 - verbose fail error looks correct (regex match)
  ok 34
  ok 35 - explicitly setting label works as expected (begin)
  ok 36
  ok 37 - explicitly setting label works as expected (end)
  ok 38 - verbose hanging exits non-zero
  ok 39 - verbose hanging error looks correct (regex match)
  ok 40
  ok 41 - : is stripped from label (begin)
  ok 42
  ok 43 - : is stripped from label (end)
  ok 44 - timeout warning exits zero
  ok 45 - timeout warning output looks correct (exact match)
  ok 46 - timeout warning error looks correct (regex match)
  not ok 47 # TODO & SKIP handling of shell metacharacters not yet defined on Windows
  not ok 48 # TODO & SKIP handling of shell metacharacters not yet defined on Windows
  ok 49 - failure whitespace exits non-zero
  ok 50 - failure whitespace output looks correct (exact match)
  ok 51 - failure whitespace error looks correct (exact match)
  ok 52 - failure no args exits non-zero
  ok 53 - failure no args output looks correct (exact match)
  ok 54 - failure no args error looks correct (exact match)
  ok 55 - failure trivial exits non-zero
  ok 56 - failure trivial output looks correct (exact match)
  ok 57 - failure trivial error looks correct (exact match)
  ok 58 - failure non-ascii exits non-zero
  ok 59 - failure non-ascii output looks correct (exact match)
  ok 60 - failure non-ascii error looks correct (exact match)
  ok 61 - crash windows cmd metacharacters exits non-zero
  not ok 62 - crash windows cmd metacharacters error looks correct (regex match)
  ok 63 - crash posix sh metacharacters exits non-zero
  not ok 64 - crash posix sh metacharacters error looks correct (regex match)
  ok 65 - crash whitespace exits non-zero
  not ok 66 - crash whitespace error looks correct (regex match)
  ok 67 - crash no args exits non-zero
  not ok 68 - crash no args error looks correct (regex match)
  ok 69 - crash trivial exits non-zero
  not ok 70 - crash trivial error looks correct (regex match)
  ok 71 - crash non-ascii exits non-zero
  not ok 72 - crash non-ascii error looks correct (regex match)
  ok 73 - divide by zero windows cmd metacharacters exits non-zero
  not ok 74 - divide by zero windows cmd metacharacters error looks correct (exact match)
  ok 75 - divide by zero posix sh metacharacters exits non-zero
  not ok 76 - divide by zero posix sh metacharacters error looks correct (exact match)
  ok 77 - divide by zero whitespace exits non-zero
  not ok 78 - divide by zero whitespace error looks correct (exact match)
  ok 79 - divide by zero no args exits non-zero
  not ok 80 - divide by zero no args error looks correct (exact match)
  ok 81 - divide by zero trivial exits non-zero
  not ok 82 - divide by zero trivial error looks correct (exact match)
  ok 83 - divide by zero non-ascii exits non-zero
  not ok 84 - divide by zero non-ascii error looks correct (exact match)
  ok 85 - hanging windows cmd metacharacters exits non-zero
  ok 86 - hanging windows cmd metacharacters error looks correct (regex match)
  ok 87 - hanging posix sh metacharacters exits non-zero
  ok 88 - hanging posix sh metacharacters error looks correct (regex match)
  ok 89 - hanging whitespace exits non-zero
  ok 90 - hanging whitespace error looks correct (regex match)
  ok 91 - hanging no args exits non-zero
  ok 92 - hanging no args error looks correct (regex match)
  ok 93 - hanging trivial exits non-zero
  ok 94 - hanging trivial error looks correct (regex match)
  ok 95 - hanging non-ascii exits non-zero
  ok 96 - hanging non-ascii error looks correct (regex match)
  ok 97 - cwd as expected with no chdir exits zero
  ok 98 - cwd as expected with no chdir output looks correct (exact match)
  ok 99 - cwd as expected with no chdir error looks correct (exact match)
  ok 100 - cwd as expected with --chdir exits zero
  ok 101 - cwd as expected with --chdir output looks correct (exact match)
  ok 102 - cwd as expected with --chdir error looks correct (exact match)
  ok 103 - cwd as expected with -C exits zero
  ok 104 - cwd as expected with -C output looks correct (exact match)
  ok 105 - cwd as expected with -C error looks correct (exact match)
  1..105
  Dubious, test returned 12 (wstat 3072, 0xc00)
  Failed 12/105 subtests
  
  #   Failed test 'capture error crashing C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.LUlf5F/perl-00.txt logtext is as expected (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/15-testrunner-capture-logs.t line 192.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  (... 420 lines omitted; there are too many errors!)
  
  #   Failed test 'crash trivial error looks correct (regex match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #                   'QtQA::App::TestRunner: begin perl: [perl] [C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl] [hello]
  # 'dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\Crash_32e2
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl line 0
  # INIT failed--call queue aborted.
  # QtQA::App::TestRunner: end perl: 1 seconds, exit code 1
  # '
  #     doesn't match '(?^:(?^msx:\A (?^:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?^msx:
  #               QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ with\ exit\ code\ 0xC0000005\ \(STATUS_ACCESS_VIOLATION\)\n
  #               (?^:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>[^:]+)\:\ [^\n]*)\,\ exit\ code\ 3221225477\n
  #             \z))'
  
  #   Failed test 'crash non-ascii error looks correct (regex match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #                   'QtQA::App::TestRunner: begin perl: [perl] [C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl] [早上好] [你好马?]
  # 'dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\Crash_32e2
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl line 0
  # INIT failed--call queue aborted.
  # QtQA::App::TestRunner: end perl: 1 seconds, exit code 1
  # '
  #     doesn't match '(?^:(?^msx:\A (?^:QtQA\:\:App\:\:TestRunner\:\ begin\ (?<label>[^:]+)\:\ \[perl\][^\n]*) \n)(?^msx:
  #               QtQA\:\:App\:\:TestRunner\:\ Process\ exited\ with\ exit\ code\ 0xC0000005\ \(STATUS_ACCESS_VIOLATION\)\n
  #               (?^:QtQA\:\:App\:\:TestRunner\:\ end\ (?<label>[^:]+)\:\ [^\n]*)\,\ exit\ code\ 3221225477\n
  #             \z))'
  
  #   Failed test 'divide by zero windows cmd metacharacters error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  
  #   Failed test 'divide by zero posix sh metacharacters error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  
  #   Failed test 'divide by zero whitespace error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  
  #   Failed test 'divide by zero no args error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  
  #   Failed test 'divide by zero trivial error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  
  #   Failed test 'divide by zero non-ascii error looks correct (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/10-testrunner.t line 206.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\DivideByZero_e529
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\divide_by_zero.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000094 (STATUS_INTEGER_DIVIDE_BY_ZERO)
  # '
  # Looks like you failed 12 tests of 105.
  C:/work/build/qtqa/scripts/generic/t/10-testrunner.t ...............
  ok 1 - fails with no args exits non-zero
  ok 2 - fails with no args output looks correct (exact match)
  ok 3 - fails with no args error looks correct (regex match)
  ok 4 - --help parsed OK exits non-zero
  ok 5 - --help parsed OK output looks correct (regex match)
  ok 6 - --help parsed OK error looks correct (exact match)
  ok 7 - -- stops argument processing exits non-zero
  ok 8 - -- stops argument processing output looks correct (exact match)
  ok 9 - -- stops argument processing error looks correct (regex match)
  not ok 10 # TODO & SKIP handling of shell metacharacters not yet defined on Windows
  not ok 11 # TODO & SKIP handling of shell metacharacters not yet defined on Windows
  ok 12 - successful whitespace exits zero
  ok 13 - successful whitespace output looks correct (exact match)
  ok 14 - successful whitespace error looks correct (exact match)
  ok 15 - successful no args exits zero
  ok 16 - successful no args output looks correct (exact match)
  ok 17 - successful no args error looks correct (exact match)
  ok 18 - successful trivial exits zero
  ok 19 - successful trivial output looks correct (exact match)
  ok 20 - successful trivial error looks correct (exact match)
  ok 21 - successful non-ascii exits zero
  ok 22 - successful non-ascii output looks correct (exact match)
  ok 23 - successful non-ascii error looks correct (exact match)
  ok 24 - verbose success exits zero
  ok 25 - verbose success output looks correct (exact match)
  ok 26 - verbose success error looks correct (regex match)
  ok 27
  ok 28 - label defaults to command name (begin)
  ok 29
  ok 30 - label defaults to command name (end)
  ok 31 - verbose fail exits non-zero
  ok 32 - verbose fail output looks correct (exact match)
  ok 33 - verbose fail error looks correct (regex match)
  ok 34
  ok 35 - explicitly setting label works as expected (begin)
  ok 36
  ok 37 - explicitly setting label works as expected (end)
  ok 38 - verbose hanging exits non-zero
  ok 39 - verbose hanging error looks correct (regex match)
  ok 40
  ok 41 - : is stripped from label (begin)
  ok 42
  ok 43 - : is stripped from label (end)
  ok 44 - timeout warning exits zero
  ok 45 - timeout warning output looks correct (exact match)
  ok 46 - timeout warning error looks correct (regex match)
  not ok 47 # TODO & SKIP handling of shell metacharacters not yet defined on Windows
  not ok 48 # TODO & SKIP handling of shell metacharacters not yet defined on Windows
  ok 49 - failure whitespace exits non-zero
  ok 50 - failure whitespace output looks correct (exact match)
  ok 51 - failure whitespace error looks correct (exact match)
  ok 52 - failure no args exits non-zero
  ok 53 - failure no args output looks correct (exact match)
  ok 54 - failure no args error looks correct (exact match)
  ok 55 - failure trivial exits non-zero
  ok 56 - failure trivial output looks correct (exact match)
  ok 57 - failure trivial error looks correct (exact match)
  ok 58 - failure non-ascii exits non-zero
  ok 59 - failure non-ascii output looks correct (exact match)
  ok 60 - failure non-ascii error looks correct (exact match)
  ok 61 - crash windows cmd metacharacters exits non-zero
  not ok 62 - crash windows cmd metacharacters error looks correct (regex match)
  ok 63 - crash posix sh metacharacters exits non-zero
  not ok 64 - crash posix sh metacharacters error looks correct (regex match)
  ok 65 - crash whitespace exits non-zero
  not ok 66 - crash whitespace error looks correct (regex match)
  ok 67 - crash no args exits non-zero
  not ok 68 - crash no args error looks correct (regex match)
  ok 69 - crash trivial exits non-zero
  not ok 70 - crash trivial error looks correct (regex match)
  ok 71 - crash non-ascii exits non-zero
  not ok 72 - crash non-ascii error looks correct (regex match)
  ok 73 - divide by zero windows cmd metacharacters exits non-zero
  not ok 74 - divide by zero windows cmd metacharacters error looks correct (exact match)
  ok 75 - divide by zero posix sh metacharacters exits non-zero
  not ok 76 - divide by zero posix sh metacharacters error looks correct (exact match)
  ok 77 - divide by zero whitespace exits non-zero
  not ok 78 - divide by zero whitespace error looks correct (exact match)
  ok 79 - divide by zero no args exits non-zero
  not ok 80 - divide by zero no args error looks correct (exact match)
  ok 81 - divide by zero trivial exits non-zero
  not ok 82 - divide by zero trivial error looks correct (exact match)
  ok 83 - divide by zero non-ascii exits non-zero
  not ok 84 - divide by zero non-ascii error looks correct (exact match)
  ok 85 - hanging windows cmd metacharacters exits non-zero
  ok 86 - hanging windows cmd metacharacters error looks correct (regex match)
  ok 87 - hanging posix sh metacharacters exits non-zero
  ok 88 - hanging posix sh metacharacters error looks correct (regex match)
  ok 89 - hanging whitespace exits non-zero
  ok 90 - hanging whitespace error looks correct (regex match)
  ok 91 - hanging no args exits non-zero
  ok 92 - hanging no args error looks correct (regex match)
  ok 93 - hanging trivial exits non-zero
  ok 94 - hanging trivial error looks correct (regex match)
  ok 95 - hanging non-ascii exits non-zero
  ok 96 - hanging non-ascii error looks correct (regex match)
  ok 97 - cwd as expected with no chdir exits zero
  ok 98 - cwd as expected with no chdir output looks correct (exact match)
  ok 99 - cwd as expected with no chdir error looks correct (exact match)
  ok 100 - cwd as expected with --chdir exits zero
  ok 101 - cwd as expected with --chdir output looks correct (exact match)
  ok 102 - cwd as expected with --chdir error looks correct (exact match)
  ok 103 - cwd as expected with -C exits zero
  ok 104 - cwd as expected with -C output looks correct (exact match)
  ok 105 - cwd as expected with -C error looks correct (exact match)
  1..105
  Dubious, test returned 12 (wstat 3072, 0xc00)
  Failed 12/105 subtests
  
  #   Failed test 'capture error crashing C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt logtext is as expected (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/15-testrunner-capture-logs.t line 192.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\Crash_32e2
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000005 (STATUS_ACCESS_VIOLATION)
  # '
  
  #   Failed test 'tee error crashing stderr is as expected (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/15-testrunner-capture-logs.t line 182.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\Crash_32e2
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000005 (STATUS_ACCESS_VIOLATION)
  # '
  
  #   Failed test 'tee error crashing C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt logtext is as expected (exact match)'
  #   at C:/work/build/qtqa/scripts/generic/t/15-testrunner-capture-logs.t line 192.
  #          got: ''dmake' is not recognized as an internal or external command,
  # operable program or batch file.
  #
  # A problem was encountered while attempting to compile and install your Inline
  # C code. The command that failed was:
  #   dmake > out.make 2>&1
  #
  # The build directory was:
  # C:\work\build\qtqa\scripts\_Inline\build\QtQA\App\Crash_32e2
  #
  # To debug the problem, cd to the build directory, and inspect the output files.
  #
  #  at C:\work\build\qtqa\scripts\generic\t\helpers\dereference_bad_pointer.pl line 0
  # INIT failed--call queue aborted.
  # '
  #     expected: 'QtQA::App::TestRunner: Process exited with exit code 0xC0000005 (STATUS_ACCESS_VIOLATION)
  # '
  # Looks like you failed 3 tests of 140.
  C:/work/build/qtqa/scripts/generic/t/15-testrunner-capture-logs.t ..
  ok 1 - mixed no capturing failing exited with non-zero exit code
  ok 2 - mixed no capturing failing stdout is as expected (exact match)
  ok 3 - mixed no capturing failing stderr is as expected (exact match)
  ok 4 - mixed_nonascii no capturing exited with zero exit code
  ok 5 - mixed_nonascii no capturing stdout is as expected (exact match)
  ok 6 - mixed_nonascii no capturing stderr is as expected (exact match)
  ok 7 # skip unsafe to run this test as superuser
  ok 8 - mixed_nonascii with capture C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt doesn't exist prior to test
  ok 9 - mixed_nonascii with capture exited with non-zero exit code
  ok 10 - mixed_nonascii with capture stdout is as expected (exact match)
  ok 11 - mixed_nonascii with capture stderr is as expected (exact match)
  ok 12 - mixed_nonascii with capture created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt
  ok 13 - mixed_nonascii with capture C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt logtext is as expected (0) (regex match)
  ok 14 - mixed_nonascii with capture C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt logtext is as expected (1) (regex match)
  ok 15 - mixed_nonascii with capture C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt logtext is as expected (2) (regex match)
  ok 16 - mixed_nonascii with tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt doesn't exist prior to test
  ok 17 - mixed_nonascii with tee exited with zero exit code
  ok 18 - mixed_nonascii with tee stdout is as expected (exact match)
  ok 19 - mixed_nonascii with tee stderr is as expected (exact match)
  ok 20 - mixed_nonascii with tee created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt
  ok 21 - mixed_nonascii with tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt logtext is as expected (0) (regex match)
  ok 22 - mixed_nonascii with tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt logtext is as expected (1) (regex match)
  ok 23 - mixed_nonascii with tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt logtext is as expected (2) (regex match)
  ok 24 - mixed with capture C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-02.txt doesn't exist prior to test
  ok 25 - mixed with capture exited with zero exit code
  ok 26 - mixed with capture stdout is as expected (exact match)
  ok 27 - mixed with capture stderr is as expected (exact match)
  ok 28 - mixed with capture created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-02.txt
  ok 29 - mixed with capture C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-02.txt logtext is as expected (0) (regex match)
  ok 30 - mixed with capture C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-02.txt logtext is as expected (1) (regex match)
  ok 31 - mixed with capture C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-02.txt logtext is as expected (2) (regex match)
  ok 32 - mixed_nonascii with capture and verbose and -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.log doesn't exist prior to test
  ok 33 - mixed_nonascii with capture and verbose and -o exited with non-zero exit code
  ok 34 - mixed_nonascii with capture and verbose and -o stdout is as expected (exact match)
  ok 35 - mixed_nonascii with capture and verbose and -o stderr is as expected (regex match)
  ok 36 - mixed_nonascii with capture and verbose and -o created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.log
  ok 37 - mixed_nonascii with capture and verbose and -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.log logtext is as expected (0) (regex match)
  ok 38 - mixed_nonascii with capture and verbose and -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.log logtext is as expected (1) (regex match)
  ok 39 - mixed_nonascii with capture and verbose and -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.log logtext is as expected (2) (regex match)
  ok 40 - mixed_nonascii with capture and verbose and -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.log logtext is as expected (3) (regex match)
  ok 41 - mixed with capture and -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-01.log doesn't exist prior to test
  ok 42 - mixed with capture and -o exited with zero exit code
  ok 43 - mixed with capture and -o stdout is as expected (exact match)
  ok 44 - mixed with capture and -o stderr is as expected (exact match)
  ok 45 - mixed with capture and -o created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-01.log
  ok 46 - mixed with capture and -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-01.log logtext is as expected (0) (regex match)
  ok 47 - mixed with capture and -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-01.log logtext is as expected (1) (regex match)
  ok 48 - mixed with capture and -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-01.log logtext is as expected (2) (regex match)
  ok 49 - mixed with capture and -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-01.log logtext is as expected (3) (regex match)
  ok 50 - mixed with capture and -o and tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-02.log doesn't exist prior to test
  ok 51 - mixed with capture and -o and tee exited with zero exit code
  ok 52 - mixed with capture and -o and tee stdout is as expected (exact match)
  ok 53 - mixed with capture and -o and tee stderr is as expected (exact match)
  ok 54 - mixed with capture and -o and tee created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-02.log
  ok 55 - mixed with capture and -o and tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-02.log logtext is as expected (0) (regex match)
  ok 56 - mixed with capture and -o and tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-02.log logtext is as expected (1) (regex match)
  ok 57 - mixed with capture and -o and tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-02.log logtext is as expected (2) (regex match)
  ok 58 - mixed with capture and -o and tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-02.log logtext is as expected (3) (regex match)
  ok 59 - mixed_nonascii new style -o, capture, multiple logs C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.xml doesn't exist prior to test
  ok 60 - mixed_nonascii new style -o, capture, multiple logs C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.xunitxml doesn't exist prior to test
  ok 61 - mixed_nonascii new style -o, capture, multiple logs exited with zero exit code
  ok 62 - mixed_nonascii new style -o, capture, multiple logs stdout is as expected (exact match)
  ok 63 - mixed_nonascii new style -o, capture, multiple logs stderr is as expected (exact match)
  ok 64 - mixed_nonascii new style -o, capture, multiple logs created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.xml
  ok 65 - mixed_nonascii new style -o, capture, multiple logs C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.xml logtext is as expected (exact match)
  ok 66 - mixed_nonascii new style -o, capture, multiple logs created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.xunitxml
  ok 67 - mixed_nonascii new style -o, capture, multiple logs C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.xunitxml logtext is as expected (exact match)
  ok 68 - mixed_nonascii new style -o, tee, multiple logs, one stdout C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-01.xml doesn't exist prior to test
  ok 69 - mixed_nonascii new style -o, tee, multiple logs, one stdout C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.txt doesn't exist prior to test
  ok 70 - mixed_nonascii new style -o, tee, multiple logs, one stdout exited with zero exit code
  ok 71 - mixed_nonascii new style -o, tee, multiple logs, one stdout stdout is as expected (exact match)
  ok 72 - mixed_nonascii new style -o, tee, multiple logs, one stdout stderr is as expected (exact match)
  ok 73 - mixed_nonascii new style -o, tee, multiple logs, one stdout created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-01.xml
  ok 74 - mixed_nonascii new style -o, tee, multiple logs, one stdout C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-01.xml logtext is as expected (exact match)
  ok 75 - mixed_nonascii new style -o, tee, multiple logs, one stdout created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.txt
  ok 76 - mixed_nonascii new style -o, tee, multiple logs, one stdout C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.txt logtext is as expected (exact match)
  ok 77 - mixed_nonascii with capture and tricky arguments C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt doesn't exist prior to test
  ok 78 - mixed_nonascii with capture and tricky arguments exited with non-zero exit code
  ok 79 - mixed_nonascii with capture and tricky arguments stdout is as expected (exact match)
  ok 80 - mixed_nonascii with capture and tricky arguments stderr is as expected (exact match)
  ok 81 - mixed_nonascii with capture and tricky arguments created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt
  ok 82 - mixed_nonascii with capture and tricky arguments C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt logtext is as expected (0) (regex match)
  ok 83 - mixed_nonascii with capture and tricky arguments C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt logtext is as expected (1) (regex match)
  ok 84 - mixed_nonascii with capture and tricky arguments C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt logtext is as expected (2) (regex match)
  ok 85 - mixed with capture and tricky arguments C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt doesn't exist prior to test
  ok 86 - mixed with capture and tricky arguments exited with zero exit code
  ok 87 - mixed with capture and tricky arguments stdout is as expected (exact match)
  ok 88 - mixed with capture and tricky arguments stderr is as expected (exact match)
  ok 89 - mixed with capture and tricky arguments created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt
  ok 90 - mixed with capture and tricky arguments C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt logtext is as expected (0) (regex match)
  ok 91 - mixed with capture and tricky arguments C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt logtext is as expected (1) (regex match)
  ok 92 - mixed with capture and tricky arguments C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt logtext is as expected (2) (regex match)
  ok 93 - mixed with capture and ignored -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.log doesn't exist prior to test
  ok 94 - mixed with capture and ignored -o exited with non-zero exit code
  ok 95 - mixed with capture and ignored -o stdout is as expected (exact match)
  ok 96 - mixed with capture and ignored -o stderr is as expected (exact match)
  ok 97 - mixed with capture and ignored -o created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.log
  ok 98 - mixed with capture and ignored -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.log logtext is as expected (0) (regex match)
  ok 99 - mixed with capture and ignored -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.log logtext is as expected (1) (regex match)
  ok 100 - mixed with capture and ignored -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog-00.log logtext is as expected (2) (regex match)
  ok 101 - mixed_nonascii with capture and ignored -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog.log-00.txt doesn't exist prior to test
  ok 102 - mixed_nonascii with capture and ignored -o exited with non-zero exit code
  ok 103 - mixed_nonascii with capture and ignored -o stdout is as expected (exact match)
  ok 104 - mixed_nonascii with capture and ignored -o stderr is as expected (exact match)
  ok 105 - mixed_nonascii with capture and ignored -o created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog.log-00.txt
  ok 106 - mixed_nonascii with capture and ignored -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog.log-00.txt logtext is as expected (0) (regex match)
  ok 107 - mixed_nonascii with capture and ignored -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog.log-00.txt logtext is as expected (1) (regex match)
  ok 108 - mixed_nonascii with capture and ignored -o C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog.log-00.txt logtext is as expected (2) (regex match)
  ok 109 - mixed_nonascii with capture and ignored -o and tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog.log-01.txt doesn't exist prior to test
  ok 110 - mixed_nonascii with capture and ignored -o and tee exited with non-zero exit code
  ok 111 - mixed_nonascii with capture and ignored -o and tee stdout is as expected (exact match)
  ok 112 - mixed_nonascii with capture and ignored -o and tee stderr is as expected (exact match)
  ok 113 - mixed_nonascii with capture and ignored -o and tee created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog.log-01.txt
  ok 114 - mixed_nonascii with capture and ignored -o and tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog.log-01.txt logtext is as expected (0) (regex match)
  ok 115 - mixed_nonascii with capture and ignored -o and tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog.log-01.txt logtext is as expected (1) (regex match)
  ok 116 - mixed_nonascii with capture and ignored -o and tee C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-testlog.log-01.txt logtext is as expected (2) (regex match)
  ok 117 - capture error nonexistent process C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/command_which_does_not_exist-00.txt doesn't exist prior to test
  ok 118 - capture error nonexistent process exited with non-zero exit code
  ok 119 - capture error nonexistent process stdout is as expected (exact match)
  ok 120 - capture error nonexistent process stderr is as expected (exact match)
  ok 121 - capture error nonexistent process created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/command_which_does_not_exist-00.txt
  ok 122 - capture error nonexistent process C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/command_which_does_not_exist-00.txt logtext is as expected (exact match)
  ok 123 - tee error nonexistent process C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/command_which_does_not_exist-01.txt doesn't exist prior to test
  ok 124 - tee error nonexistent process exited with non-zero exit code
  ok 125 - tee error nonexistent process stdout is as expected (exact match)
  ok 126 - tee error nonexistent process stderr is as expected (exact match)
  ok 127 - tee error nonexistent process created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/command_which_does_not_exist-01.txt
  ok 128 - tee error nonexistent process C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/command_which_does_not_exist-01.txt logtext is as expected (exact match)
  ok 129 - capture error crashing C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt doesn't exist prior to test
  ok 130 - capture error crashing exited with non-zero exit code
  ok 131 - capture error crashing stdout is as expected (exact match)
  ok 132 - capture error crashing stderr is as expected (exact match)
  ok 133 - capture error crashing created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt
  not ok 134 - capture error crashing C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-00.txt logtext is as expected (exact match)
  ok 135 - tee error crashing C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt doesn't exist prior to test
  ok 136 - tee error crashing exited with non-zero exit code
  ok 137 - tee error crashing stdout is as expected (exact match)
  not ok 138 - tee error crashing stderr is as expected (exact match)
  ok 139 - tee error crashing created C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt
  not ok 140 - tee error crashing C:\work\build\qtqa\scripts\test_pl_tmp\qtqa-test-capture-logs.PSdUKK/perl-01.txt logtext is as expected (exact match)
  1..140
  Dubious, test returned 3 (wstat 768, 0x300)
  Failed 3/140 subtests
  	(less 1 skipped subtest: 136 okay)
  
  Test Summary Report
  -------------------
  C:/work/build/qtqa/scripts/generic/t/10-testrunner.t             (Wstat: 3072 Tests: 105 Failed: 12)
    Failed tests:  62, 64, 66, 68, 70, 72, 74, 76, 78, 80
                  82, 84
    Non-zero exit status: 12
  C:/work/build/qtqa/scripts/generic/t/15-testrunner-capture-logs.t (Wstat: 768 Tests: 140 Failed: 3)
    Failed tests:  134, 138, 140
    Non-zero exit status: 3
  Files=2, Tests=245, 93 wallclock secs ( 0.13 usr +  0.05 sys =  0.17 CPU)
  Result: FAIL
  prove -I C:/work/build/qtqa/scripts/lib/perl5 --state=failed,save --verbose exited with value 1
  QtQA::App::TestRunner: test failure could be reproduced twice consecutively
  QtQA::App::TestRunner: end scripts: 1139 seconds, exit code 2

  Build log: http://testresults.qt.io/ci/Qt5_5.4_Integration/build_00335/win32-msvc2010_developer-build_qtnamespace_Windows_7/log.txt.gz

  Tested changes (refs/builds/5.4_1427090407):
    http://codereview.qt-project.org/106265 [PS69] - Updated submodules.



More information about the Ci-reports mailing list