[Ci-reports] fail on ssh://codereview.qt-project.org:29418/qt/qt5#stable
Qt Continuous Integration System
ci-noreply at qt-project.org
Wed Nov 6 12:17:28 CET 2013
Autotests `tst_qnmeapositioninfosource_simulation', `tst_qpacketprotocol (qtquick1)', `tst_qsslsocket_onDemandCertificates_member', and `tst_qsslsocket_onDemandCertificates_static' failed :(
Some (not all) of the tests were determined to be flaky, meaning results were not consistent across multiple runs. This might make the problem difficult to reproduce. Also, flaky failures might or might not be related to any recent changes in the source code.
Testing tst_QNmeaPositionInfoSource_Simulation
FAIL! : tst_QNmeaPositionInfoSource_Simulation::startUpdates_waitForValidDateTime(Feed GGA,RMC,GGA; expect RMC, second GGA only) Compared values are not the same
Actual (spy.count()) : 0
Expected (dateTimes.count()): 2
..\tst_qnmeapositioninfosource.cpp(360) : failure location
FAIL! : tst_QNmeaPositionInfoSource_Simulation::requestUpdate_waitForValidDateTime(Feed GGA,RMC,GGA; expect RMC, second GGA only) Compared values are not the same
Actual (spy.count()): 0
Expected (1) : 1
..\tst_qnmeapositioninfosource.cpp(415) : failure location
Totals: 24 passed, 2 failed, 0 skipped
QtQA::App::TestRunner: test failed, running again to see if it is flaky...
********* Start testing of tst_QNmeaPositionInfoSource_Simulation *********
Config: Using QtTest library 5.2.0, Qt 5.2.0
PASS : tst_QNmeaPositionInfoSource_Simulation::initTestCase()
PASS : tst_QNmeaPositionInfoSource_Simulation::constructor()
PASS : tst_QNmeaPositionInfoSource_Simulation::supportedPositioningMethods()
PASS : tst_QNmeaPositionInfoSource_Simulation::minimumUpdateInterval()
PASS : tst_QNmeaPositionInfoSource_Simulation::setUpdateInterval_delayedUpdate()
PASS : tst_QNmeaPositionInfoSource_Simulation::lastKnownPosition()
PASS : tst_QNmeaPositionInfoSource_Simulation::beginWithBufferedData(startUpdates(), 1 update in buffer)
PASS : tst_QNmeaPositionInfoSource_Simulation::beginWithBufferedData(requestUpdate(), 1 update in buffer)
PASS : tst_QNmeaPositionInfoSource_Simulation::beginWithBufferedData(startUpdates(), multiple updates in buffer)
PASS : tst_QNmeaPositionInfoSource_Simulation::beginWithBufferedData(requestUpdate(), multiple updates in buffer)
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates(1 update)
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates(2 updates)
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates(10 updates)
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates_withTimeout()
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates_expectLatestUpdateOnly()
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates_waitForValidDateTime(Feed GGA,RMC,GGA; expect RMC, second GGA only)
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates_waitForValidDateTime(Feed GGA,ZDA,GGA; expect second GGA only)
PASS : tst_QNmeaPositionInfoSource_Simulation::startUpdates_waitForValidDateTime(Feed good RMC, RMC with bad date/time, good RMC; expect first and third RMC only)
PASS : tst_QNmeaPositionInfoSource_Simulation::requestUpdate_waitForValidDateTime(Feed GGA,RMC,GGA; expect RMC, second GGA only)
PASS : tst_QNmeaPositionInfoSource_Simulation::requestUpdate_waitForValidDateTime(Feed GGA,ZDA,GGA; expect second GGA only)
PASS : tst_QNmeaPositionInfoSource_Simulation::requestUpdate_waitForValidDateTime(Feed good RMC, RMC with bad date/time, good RMC; expect first and third RMC only)
PASS : tst_QNmeaPositionInfoSource_Simulation::requestUpdate()
QWARN : tst_QNmeaPositionInfoSource_Simulation::requestUpdate_after_start() QNmeaPositionInfoSource: no QIODevice data source, call setDevice() first
QWARN : tst_QNmeaPositionInfoSource_Simulation::requestUpdate_after_start() QNmeaPositionInfoSource: no QIODevice data source, call setDevice() first
FAIL! : tst_QNmeaPositionInfoSource_Simulation::requestUpdate_after_start() Compared values are not the same
Actual (spyUpdate.count()): 0
Expected (1) : 1
..\tst_qnmeapositioninfosource.cpp(485) : failure location
PASS : tst_QNmeaPositionInfoSource_Simulation::testWithBadNmea(requestUpdate(), bad second sentence)
PASS : tst_QNmeaPositionInfoSource_Simulation::testWithBadNmea(startUpdates(), bad second sentence)
PASS : tst_QNmeaPositionInfoSource_Simulation::cleanupTestCase()
Totals: 25 passed, 1 failed, 0 skipped
********* Finished testing of tst_QNmeaPositionInfoSource_Simulation *********
QtQA::App::TestRunner: test failed on first and second attempts, but with different behavior each time:
QtQA::App::TestRunner: first attempt: exited with exit code 2
QtQA::App::TestRunner: second attempt: exited with exit code 1
QtQA::App::TestRunner: the test seems to be flaky, please fix this
QtQA::App::TestRunner: this flaky test is being treated as a FAIL
QtQA::App::TestRunner: end tst_qnmeapositioninfosource_simulation: 92 seconds, exit code 1
Testing tst_QSslSocket_onDemandCertificates_static
FAIL! : tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithoutProxy) 'socket2->waitForEncrypted()' returned FALSE. (Network operation timed out)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithSocks5Proxy) 'socket2->waitForEncrypted()' returned FALSE. (TTL expired)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithSocks5ProxyAuth) 'socket2->waitForEncrypted()' returned FALSE. (TTL expired)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithHttpProxy) 'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithHttpProxyBasicAuth) 'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
Totals: 2 passed, 5 failed, 0 skipped
QtQA::App::TestRunner: test failed, running again to see if it is flaky...
********* Start testing of tst_QSslSocket_onDemandCertificates_static *********
Config: Using QtTest library 5.2.0, Qt 5.2.0
PASS : tst_QSslSocket_onDemandCertificates_static::initTestCase()
FAIL! : tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithoutProxy) 'socket2->waitForEncrypted()' returned FALSE. (Network operation timed out)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithSocks5Proxy) 'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithSocks5ProxyAuth) 'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithHttpProxy) 'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_static::onDemandRootCertLoadingStaticMethods(WithHttpProxyBasicAuth) 'socket2->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_static.cpp(206) : failure location
PASS : tst_QSslSocket_onDemandCertificates_static::cleanupTestCase()
Totals: 2 passed, 5 failed, 0 skipped
********* Finished testing of tst_QSslSocket_onDemandCertificates_static *********
QtQA::App::TestRunner: test failure could be reproduced twice consecutively
QtQA::App::TestRunner: end tst_qsslsocket_onDemandCertificates_static: 270 seconds, exit code 5
Testing tst_QSslSocket_onDemandCertificates_member
FAIL! : tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithoutProxy) 'socket->waitForEncrypted()' returned FALSE. (Network operation timed out)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithSocks5Proxy) 'socket->waitForEncrypted()' returned FALSE. (Host not found)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithSocks5ProxyAuth) 'socket->waitForEncrypted()' returned FALSE. (Host not found)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithHttpProxy) 'socket->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithHttpProxyBasicAuth) 'socket->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
Totals: 2 passed, 5 failed, 0 skipped
QtQA::App::TestRunner: test failed, running again to see if it is flaky...
********* Start testing of tst_QSslSocket_onDemandCertificates_member *********
Config: Using QtTest library 5.2.0, Qt 5.2.0
PASS : tst_QSslSocket_onDemandCertificates_member::initTestCase()
FAIL! : tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithoutProxy) 'socket->waitForEncrypted()' returned FALSE. (Network operation timed out)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithSocks5Proxy) 'socket->waitForEncrypted()' returned FALSE. (TTL expired)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithSocks5ProxyAuth) 'socket->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithHttpProxy) 'socket->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
FAIL! : tst_QSslSocket_onDemandCertificates_member::onDemandRootCertLoadingMemberMethods(WithHttpProxyBasicAuth) 'socket->waitForEncrypted()' returned FALSE. (Connection refused)
tst_qsslsocket_onDemandCertificates_member.cpp(209) : failure location
PASS : tst_QSslSocket_onDemandCertificates_member::cleanupTestCase()
Totals: 2 passed, 5 failed, 0 skipped
********* Finished testing of tst_QSslSocket_onDemandCertificates_member *********
QtQA::App::TestRunner: test failure could be reproduced twice consecutively
QtQA::App::TestRunner: end tst_qsslsocket_onDemandCertificates_member: 271 seconds, exit code 5
Testing tst_QPacketProtocol
FAIL! : tst_QPacketProtocol::setMaximumPacketSize(invalid) 'm_server->waitForNewConnection()' returned FALSE. ()
tst_qpacketprotocol.cpp(90) : failure location
Totals: 14 passed, 1 failed, 0 skipped
QtQA::App::TestRunner: test failed, running again to see if it is flaky...
********* Start testing of tst_QPacketProtocol *********
Config: Using QtTest library 5.2.0, Qt 5.2.0
PASS : tst_QPacketProtocol::initTestCase()
PASS : tst_QPacketProtocol::maximumPacketSize()
PASS : tst_QPacketProtocol::setMaximumPacketSize(invalid)
FAIL! : tst_QPacketProtocol::setMaximumPacketSize(still invalid) 'm_server->waitForNewConnection()' returned FALSE. ()
tst_qpacketprotocol.cpp(90) : failure location
PASS : tst_QPacketProtocol::setMaximumPacketSize(valid)
PASS : tst_QPacketProtocol::send(auto send)
PASS : tst_QPacketProtocol::send(no auto send)
PASS : tst_QPacketProtocol::packetsAvailable(1)
PASS : tst_QPacketProtocol::packetsAvailable(2)
PASS : tst_QPacketProtocol::packetsAvailable(10)
PASS : tst_QPacketProtocol::clear()
PASS : tst_QPacketProtocol::read()
FAIL! : tst_QPacketProtocol::device() 'm_server->waitForNewConnection()' returned FALSE. ()
tst_qpacketprotocol.cpp(90) : failure location
PASS : tst_QPacketProtocol::tst_QPacket_clear()
PASS : tst_QPacketProtocol::cleanupTestCase()
Totals: 13 passed, 2 failed, 0 skipped
********* Finished testing of tst_QPacketProtocol *********
QtQA::App::TestRunner: test failed on first and second attempts, but with different behavior each time:
QtQA::App::TestRunner: first attempt: exited with exit code 1
QtQA::App::TestRunner: second attempt: exited with exit code 2
QtQA::App::TestRunner: the test seems to be flaky, please fix this
QtQA::App::TestRunner: this flaky test is being treated as a FAIL
QtQA::App::TestRunner: end tst_qpacketprotocol (qtquick1): 1 seconds, exit code 2
Build log: http://testresults.qt-project.org/ci/Qt5_stable_Integration/build_00540/win32-msvc2010_developer-build_qtnamespace_Windows_7/log.txt.gz
Tested changes (refs/builds/stable_1383718810):
http://codereview.qt-project.org/70454 [PS3] - Updated submodules.
More information about the Ci-reports
mailing list