summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2017-10-11plans/qcomlt: Add test plansAníbal Limón
This test plans are divded into benchmark, somke and stress testing. The device is set to dragonboard-410c instead of apq8016-sbc because this test plans are aimed to run when main LAVA instance [1] upgrade to v2 version like LKFT [2]. [1] https://validation.linaro.org/scheduler/device_type/apq8016-sbc [2] https://lkft.validation.linaro.org/scheduler/device_type/dragonboard-410c Change-Id: Ic4742181335c36211173f74054dfb57fb6d047ef Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2017-10-06automated: ltp: add x15 skip fileMilosz Wasilewski
Change-Id: Iab4b9c86c1b96b956d3848114941fd046dceff7e Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-10-06device-script.sh: add support for oreo androidYongqin Liu
since the timestamp of android log will be updated to the build time or the realtime when network time availbe, we could not use the timestamp in logcat to calculate boottime information for all measurement. This change is to correct the launcher time measurement with timestamp information after timestamp updated to buildtime or networktime Change-Id: I36d88e2f3958130c31ef26eea3259215547d0ef0 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-10-05linux: ltp: skipfile-lkft-hikey: Skip fanotify07Dan Rue
fanotify07 was added to syscalls in LTP 20170929 and fails on some hikey boards approximately 50% of the time. See https://bugs.linaro.org/show_bug.cgi?id=3303 for details. Change-Id: I929b8373e9df72273c3b2a1a5cec5d6db34ce9e5 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-10-04linux: ltp: Add debug output (set -x)Dan Rue
Change-Id: I9d7a88d238aca1bd9c5c2c093c109148e59bd33c Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-09-28andorid automated boottime: some improvementsYongqin Liu
1. print more message for debug help to investigate why the analyse part is failed. some times the files collected lost when try to analyze like here: https://staging.validation.linaro.org/scheduler/job/191519#L13962 seems some problem there with the logcat_all_1.log file 2. add _avg suffix for the statistic result which we are interested in 3. ignore the case when grep keyword from logcat or dmesg 4. call disablesuspend.sh on device side to wait the launcher display log printed in logcat message Change-Id: I8006995397d407d7188a2137e8f4190bea86b4e0 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-27android: set 'adb wait-for-device' timeout to 10 minutesChase Qi
Change-Id: Iaa4a2178788c1bb461a4463bc697fd0c28ab2cb5 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-22android: tradefed: pass ANDROID_SERIAL env var to tradefed-runnerChase Qi
Environment variable ANDROID_SERIAL is set in setup.sh with initialize_adb() function as root user; while test is executed from tradefed.sh as testuser, we need to pass the variable to it. tradfed-runner.py is started from tradefed.sh, subprocess picks all environment vars set in tradefed.sh by default. Once ANDROID_SERIAL set properly, test will continue even when other devices appear during the test. So, this patch also can be a workaround for the below LAVA issue. https://projects.linaro.org/browse/CTT-481 Change-Id: Ic1479c2e835e08df0db22152cef6bf19ed12bfda Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-21test-runner: add support for remote execution in LAVAChase Qi
When '-l' or '--lava_run' option specified, test-runner will use lava-test-case to send result to LAVA. It might be possible to detect if it is running in LAVA at running time by checking if 'lava-test-case' exists, but that is not reliable as local environment can also has the util installed. So the above option introduced with 'False' as default value. Change-Id: Ief0c9e75d12c07832214d2d4fa30836df964615a Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-19android boottime and bootchart: install curl packageYongqin Liu
and update the token for artifactorial token Change-Id: I7d3901ee4fdd7ea55e4a0545c18327ef05b63cd5 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-19android apk-automation: set governor to performanceYongqin Liu
before start the benchmark applications Change-Id: I38d6d2dc6cc022066c5295786f7a060ee5ef5628 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-14linux: add iozone testChase Qi
Change-Id: I9e0baed19560f0eee6606094304620d3e835a7d3 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-14sh-test-lib: added support for x86 in detect_abi()Chase Qi
Change-Id: Ic9bcddbd476ecc912603603a4476180cc1ee24dc Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-14android: use adb_debug_info() in tradefed-runnerChase Qi
'lsusb' output in LXC is misleading. The issue has been fixed in adb_debug_info(). This patch removes the old approach in tradefed-runner and uses improved adb_debug_info(). Change-Id: I52c2bdc22e2fcc9bea95d762b51edc35897effeb Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-08android: tradefed: check user existence before useraddChase Qi
Change-Id: I9a7b04b03c50ebb4ee9707b7e6ce58fa9c8cdf83 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-08android-test-lib: move 'adb wait-for-device' to the right placeChase Qi
Change-Id: I6546c8608b70a63829a3de953240919cde1d8364 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-08android quadrantpro: change to run in permissive modeYongqin Liu
also kill the first time start since it could not display successfully, and no log output to show what's the problem there. after killed the first time start up, it works well in permissive mode from the 2nd time start up Change-Id: I04e91371d0e4babd57d72654924bd1d0bc543d65 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-08android: add prefix for test cases of andebenchpro2015Yongqin Liu
add the prefix of andebenchpro2015 for each test of the andebenchpro2015 benchmark application Change-Id: Ifc9115d53500e452ef7543e524dcac501289b63d Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-07android: add test for Andebenchpro 2015 testYongqin Liu
Skip the memory test to avoid the crash with hikey oreo build ATM Change-Id: Ic180634094d10ecca210bdb53d38b8a025acfefd Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-04linux: kselftests: allow for different paths of testsMilosz Wasilewski
LKFT now builds rootfs that contains a few versions of kselftests. This patch allows to use the desied version. Defaults were set to work with 'mainline' version of the tests. Change-Id: I30b3b8647e50ee066aaa21f1b02bb5a676adcb98 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-09-04ltp: Replace 'PASS/FAIL/SKIP' with 'pass/fail/skip' for LAVA friendly parserChase Qi
LAVA complain 'Bad test result' Received signal: <TESTCASE> TEST_CASE_ID=openat02 RESULT=SKIP Bad test result: SKIP Ref link: https://lkft.validation.linaro.org/scheduler/job/21959#L13158 Stop using capital string for result, which is invalid in LAVA so replace it with small letter strings Change-Id: Ifaf542fcf1b67f6fff57db3c91c49089ee7eaf0a Signed-off-by: Chase Qi <chase.qi@linaro.org> Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-09-01android: tradefed: enable shell '-e' optionChase Qi
cts/vts packaging download failure leads to test hangs until test timed out. Refer to: https://lkft.validation.linaro.org/scheduler/job/18457#L3168 Pexpect threw an exception says android-cts/vts not found, but it didn't exit for some reasons. With '-e' option enabled, test will exit on any errors. When this happen, LAVA will record the whole test run as fail. Change-Id: Ib7919ee2c4559c3673acb6ef475840cd20916f7f Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-31android: improve adb_debug_info()Chase Qi
Using 'lsusb' in LAVA-LXC directly is misleading. This is because from within the container lsusb will show all usb devices that are connected to host and there is no way to mask host devices from what is attached to the container. Though the devices show up on lsusb, each device should be added to the container via 'lxc-device add' command to make it accessible from within the container(which is done by LAVA). The current approach uses 'lsusb -D <device>' to get the information of devices found in '/dev/bus/usb' Change-Id: I28dc05f61685d995ac7fa9cc0e9831a936ef3a20 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-30LKFT: LTP: skip pselect01 and pselect01_64Naresh Kamboju
pselect01 is a intermittent failure on ARM/ARM64 devices. skip pselect01 and pselect01_64 until next LTP release because the fix patch is applied to mainline LTP master branch. Reference link to bug, LKFT: LTP: pselect01_64: slept for too long https://bugs.linaro.org/show_bug.cgi?id=3089 Change-Id: I8de96fbe792754064fd951a6a6846bed60ac8a5f Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-08-30android: tradefed: handle timeout exception on tf shell exitChase Qi
In some cases, TF shell refuse to exit with timeout in 60 seconds. Once pexpect captured the pattern in index 0 or index 1, test should be already finished. In the successful case, index 0, test report should be already generated, refer to the following example. It should be safe to kill the child process and continue to do the result parsing. ResultReporter: Full Result: /lava-21588/0/tests/\ 0_CtsFileSystemTestCases/automated/android/tradefed/android-cts/results\ /2017.08.28_21.28.08.zip Change-Id: I5ffeea82d0904891db464dd08f89a2b199541e92 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-29automated: android:Milosz Wasilewski
add debug for starting adb server on host Change-Id: I9c1bdfc06e6f5b44b94ff4682f073563234169b2 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-08-29utils: fix test attachment urlChase Qi
Artifactorial returns the full url now, the prefix isn't needed any more. Refer to https://lkft.validation.linaro.org/scheduler/job/21790#L3996 Change-Id: I579e49cc36c8cd38ed4b5f348a2cd4e661f67681 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-29Move license file to root directory to cover the whole repoChase Qi
Change-Id: I6ab18f968bdac52d02750cdd2da6ef8a068163f7 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-29Merge "test-runner: handle incorrect test definition parameters"Chase QI
2017-08-28xtest: fix result parserChase Qi
* Escape metacharacter '+' to make it more portable. * Use decimal for result measurement. Change-Id: I6f4c565481d7a2add55cd79399c355e9ee6e7d9a Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-27tradefed-runner.py: update result check expressionYongqin Liu
remove the log level info so that it matches the log output of CTS 8.0 as well otherwise it will fail to find the complete like this: https://staging.validation.linaro.org/scheduler/job/185880#L27171 Change-Id: I4a87f60540b288d68a5c2ada2bc35f2779589e46 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-08-27android apk-automation: fix error for javawhetstoneYongqin Liu
1. failed to save the apk file since not all the parent are created 2. need to be run in permissive mode 3. also add support for scp download so that it will be convenient for local tests Change-Id: I48291ffb8bb53f875f29add565fc453b684aa8e3 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-08-24android: print USB bus and device info for adb debuggingChase Qi
Print USB bus and device info for the following 3 conditions. * Before adb initialization * After 'adb root' command executed * When adb connectivity issue detected Change-Id: Id7ad9bf1238e5f55e3752680d0ae90bcd2c9b3d6 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-22apk-automation.sh: make it more convenient to run manuallyYongqin Liu
SKIP_INSTALL: change to default true, on PC side, we will only run the install step once for the first time, after that we don't need to specify the SKIP_INSTALL option super user requirement: change to only need the super user permission when run the installation steps. other steps of the test do not need to be run as root Change-Id: I372a0e729e8ca0adf1c56739acf71757c2ae4885 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-08-22android: run 'adb root' in the foregroundChase Qi
Run 'adb root' in the background with a sleep time is a work around for a specific adb version. It is not required in current LAVA code. Run 'adb root' directly works cross adb versions and distributions. It has been tested on Ubuntu xenial, Debian jessie and stretch with inhouse and latest adb. jessie: https://lkft.validation.linaro.org/scheduler/job/20107 https://lkft.validation.linaro.org/scheduler/job/20108 xenial: https://lkft.validation.linaro.org/scheduler/job/20156 https://lkft.validation.linaro.org/scheduler/job/20155 Stretch: https://lkft.validation.linaro.org/scheduler/job/20069 https://lkft.validation.linaro.org/scheduler/job/20140 Change-Id: Ibb3fa72b97729666656dbd749bc15b5446f37d5c Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-21android: fix adb rootChase Qi
'adb root' and then 'sleep 10' is a work around for some versions of adb. In LAVA LXC, with that version adb, 'adb root' doesn't return, but it actually restarted as root. Without 'sleep 10', 'adb wait-for-device' and 'adb devices' may still look good, but the following adb commands will show 'no device found'. Refer to the below job. https://lkft.validation.linaro.org/scheduler/job/18917#L3372 BTW, we had the 'sleep 10' in the beginning, but it was removed for some reasons. Change-Id: I9b40911568993dbcf3795c3d610ccd7cde7277d3 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-21android: apk-auto: install python-requests and ca-certificatesChase Qi
* requests module is required by the test case * ca-certificates is required when using git with https Change-Id: I0300f9142b24947696f36564aa6bab52144b316d Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-18py_test_lib: add_result: don't print result line to stdoutChase Qi
Printing result lines to stdout could be expensive for test case like CtsLibcoreTestCases which generate 40k+ result lines. It is a lot of overhead. In LAVA, the printing will take more then 3 hours. Refer to the below job. https://lkft.validation.linaro.org/scheduler/job/19464 Test tool itself will print result line to stdout. In LAVA, lava-test-case will send result lines to stdout. For local run, test-runner will print the content of result.csv. So the printing in add_result() is actually unnecessary. Change-Id: I4eea7dcf1133f81205944ee51c8216b81afeb8b9 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-17android: tradefed: comment out wait_homescreen()Chase Qi
wait_homescreen() searches logcat output for 'Displayed com.android.launcher', but the log might be washed away when a lot of logs generated after it. When the function not executed in time, error occurs. This has been observer several times on lkft testing. Refer to the following link: https://lkft.validation.linaro.org/scheduler/job/18918#L4721 We are already using wait_boot_completed() to check boot status, lets comment out wait_homescreen() and see if wait_boot_completed() is sufficient. Change-Id: I930ac469cc3ea0d726f676c84413c91f6c83e700 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-09Merge "android-test-lib: Do not call lava-lxc-device-* commands."Milosz Wasilewski
2017-08-09linux: unixbench: fix a typo on logfile nameChase Qi
Change-Id: Ie79eed2ad5f43c48f4d4c793b4c42501b1a01a75 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-03android-test-lib: Do not call lava-lxc-device-* commands.Senthil Kumaran S
Fix CTT-441 - lava-lxc-device-* commands don't work properly. This is applicable after the following patches are merged: * lava-dispatcher: https://review.linaro.org/#/c/20853/ * lava-server: https://review.linaro.org/#/c/20852/ Change-Id: I3eb1308359c4f368006b959e88811af4cb01c726
2017-08-02test-runner: handle incorrect test definition parametersMilosz Wasilewski
When custom parameters for test definition (-r) are not formatter properly, they should be ignored. Change-Id: I48fd26d2466ef79f0b301a2515b37c368537e2eb Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-08-02test-runner: add support for single test parametersMilosz Wasilewski
When using test-runner to execute single test (-d) it is now possible to specify additional parameters passed to the test on test-runner command line. Change-Id: I365a7fb084dbf7528bf14ce053a0856056c27150 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-07-27android-test-lib: start adb before adding lxc deviceMilosz Wasilewski
There is a chance that timing affects 'adb devices' when run inside LXC container. Therefore the adb server is started before adding the lxc device. This patch also adds a bit of debugging in case adb device is not found. Change-Id: I5e7094f7af71ea232509690bf05f859301554e67 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-07-25linux: add 24h stress testChase Qi
Change-Id: I4753edfdd99f1b16471bb81cbc38b5e4c69c5b75 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-07-25Merge "remove obsolete directories"Milosz Wasilewski
2017-07-24manual: kvm64: unify file namesChase Qi
Change-Id: I9766b78208e6b186e59f8107a37374dd4462048f Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-07-21readme: fix a typo on running test planChase Qi
To run test plan with test runner, the right parameter is '-p' not '-a'. Change-Id: Ia8477c661791784ce6f98c2fc78dfc4ac4574056 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-07-20test-runner: fail gracefully if SSH connection is closedMilosz Wasilewski
Environment is collected after the tests are executed. In case SSH connection is closed during test execution, environment collection should fail gracefully so at least test results can be presented. Change-Id: I55e1874dae2f20f9960bf0a12d05a35a48d321fc Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
generated by cgit v1.2.3 (git 2.25.1) at 2024-07-10 08:48:16 +0000