[Development] Running qtbase auto tests on reference device.

[Fält Simo]

From: development-bounces+simo.falt=digia.com at qt-project.org [mailto:development-bounces+simo.falt=digia.com at qt-project.org] On Behalf Of Liang Qi
Sent: 24. lokakuuta 2013 17:11
To: Tomasz Olszak
Cc: development at qt-project.org
Subject: Re: [Development] Running qtbase auto tests on reference device.

Haven't worked on CI things for years. Looks like I missed sth here.

You could find(git grep) "TESTRUNNER" in qtqa repo, https://github.com/qtproject/qtqa . You could get an xml result file for each auto test, then use some script to gather them and generate full report.


But I really don't know the details about how those parts worked in current CI system. The QA or CI guys could give more details.

Current CI set-up is indeed using scripts located in qtqa repo. It is not using testrunner directly but trough testscheduler script, located in same repo. All test scripts, which CI is using are relying  on Makefile’s check target. So if you want to use those scripts to run test in target device, you need to copy/mount the whole src tree to your device like Thiago said or at least the build dir if running shadow build. And in addition you naturally need perl in your device. If both of these reqs do match, there is no problem running the tests with same scripts as what CI is using. Another approach is what CI is currently trying to use with Android. In qtbase/tests/auto/android there is Android specific testrunner script which builds individual tests, deploys it, runs it and returns the test results.
So currently there isn’t any common/preferred way of running tests on ref device. If someone comes up with proper solution, I can give it a spin in CI.

Simo



Regards,
Liang


On 24 October 2013 15:27, Liang Qi <cavendish.qi at gmail.com<mailto:cavendish.qi at gmail.com>> wrote:
Not sure how those auto tests work on android and ios these days.

But in Qt 4 with Symbian ages, we have a tool, runonphone, which could deploy application and relative resources to devices and run it on device, if I don't remember wrong.

https://github.com/qtproject/qt/tree/4.8/tools/runonphone

BTW, there is another tool for wince, cetest.

https://github.com/qtproject/qt/tree/4.8/tools/qtestlib/wince/cetest

And in mkspecs/features/testcase.prf file, you have a TESTRUNNER to control how to run the tools like above runonphone. Then "make check" in tests/auto is enough for you.

https://github.com/qtproject/qt/blob/4.8/mkspecs/features/testcase.prf

Regards,
Liang


On 23 October 2013 22:50, Tomasz Olszak <olszak.tomasz at gmail.com<mailto:olszak.tomasz at gmail.com>> wrote:
Hi,
I wanted to run qtbase auto tests on Tizen device. I googled a little but didn't find any relevant howto so I assumed that I cross compile tests and copy to device. I created rpm with Qt tests and ran them one by one with shell script. Is it accepted approach or perhaps there is other standard way of running tests on platform that they are not built on?

I am asking because I noticed e.g. that some tests depends that they are executed directly from test executable directory.

--
regards ,
Tomasz Olszak

_______________________________________________
Development mailing list
Development at qt-project.org<mailto:Development at qt-project.org>
http://lists.qt-project.org/mailman/listinfo/development



--
http://www.qiliang.net



--
http://www.qiliang.net
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.qt-project.org/pipermail/development/attachments/20131025/5bec0936/attachment.html>