summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2017-10-24automated: wlan-smoke: add new testNicolas Dechesne
WLAN smoke test. This initial set of tests only verify the state of the WLAN $DEVICE at boot (on or off) and test if the $DEVICE can be enabled and disabled. There is no WLAN transmission/connection. == Example of test execution with test-runner on DB410c, running OE RPB: name,test_case_id,result,measurement,units,test_params wlan-smoke,ip-link,pass,,,DEVICE=wlan0;BOOT=enabled wlan-smoke,wlan-boot,pass,,,DEVICE=wlan0;BOOT=enabled wlan-smoke,wlan-down,pass,,,DEVICE=wlan0;BOOT=enabled wlan-smoke,wlan-up,pass,,,DEVICE=wlan0;BOOT=enabled == Static code analysis $ python3 validate.py -s SC1091 -g * SHELLCHECK: [PASSED]: automated/linux/wlan-smoke/wlan-smoke-test.sh * YAMLVALID: [PASSED]: automated/linux/wlan-smoke/wlan-smoke.yaml * METADATA [PASSED]: automated/linux/wlan-smoke/wlan-smoke.yaml Change-Id: I2be32c0975b7997492e4467a7d5585438669315d Signed-off-by: Nicolas Dechesne <nicolas.dechesne@linaro.org>
2017-10-21automated: ltp: skip ltp containers Network Namespaces testsNaresh Kamboju
skip ltp containers Network Namespaces tests hikey, juno, x15 and x86. skip failed 17 test cases on x15 and x86. skip failed 5 test cases on hikey and juno. Reference: mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 LKFT: linux-mainline: HiKey and Juno: ltp-containers Network Namespaces tests failed https://bugs.linaro.org/show_bug.cgi?id=3327 Change-Id: Iaf369a25d7d0ab24736ff3d64554b48c8aa60ad7 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-20automated: ltp: skip quotactl01 test on hikey juno and x15Naresh Kamboju
Skip quotactl01 test on hikey juno and x15. Reference: mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 Change-Id: I588c41934b8b1d27d3dcda4bae1a2d614243dd7f Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-20automated: ltp: skip NFS not supported ltp syscalls tests on x86 and junoNaresh Kamboju
Skip NFS not supported LTP syscalls tests on x86 and juno when test setup using NFS file system on x86 and Juno device. Reference: mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 Change-Id: I4dc45b2a157d4cb08a4be78267d5ea436a37bf7b Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-20plan: erp: remove sysbench percpu subtestChase Qi
percpu run sysbench cpu test for each processor, it is mainly designed for big-little arch, which isn't the case on ERP platforms. Change-Id: I2a4e916aa200129a49d73cad860320cf2043855e Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-10-20automated: ltp: skip ltp sched tests on x86 and junoNaresh Kamboju
LTP sched tests hog the cpu which is causing NFS server not responding issues when test setup using NFS file system on x86 and Juno device. so skip these test cases pth_str01 pth_str02 pth_str03 time-schedule01 LKFT: linux-mainline: x86 : ltp sched tests hang due to NFS not responding https://bugs.linaro.org/show_bug.cgi?id=3338 Change-Id: I080d89961ebe6c8ed59784d69472e83f8a66ac53 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-20plans: update erp test planChase Qi
* Use erp as test plan name instead of rpb_ee. * Removed release version from test plan name so that we don't have to update it for each release. * Added iozone and sysbench tests. Change-Id: Iaed1aa4e11eda45d06cb7510ae4c5da2b9b6011f Signed-off-by: Chase Qi <chase.qi@linaro.org> (cherry picked from commit e110ddba92baac35877e17ac285089b40f3fd559)
2017-10-19automated: linux: ltp.sh: bump LTP version to 20170929Naresh Kamboju
Change-Id: I5cd0102cd940b1036daaf2e09d96b2bae37b9c3e Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-19automated: linux: ltp: bump LTP version to 20170929Naresh Kamboju
Change-Id: I47ad444f9210831ee7623d5df2187f780cea91d9 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-19Merge "plans/qcomlt: Add test plans"Milosz Wasilewski
2017-10-19automated: optee-xtest-qemu: initial OP-TEE sanity test suite using QEMUFathi Boudra
Change-Id: I79e1e09f57dd6567a421f07b7a24936dfac91f9f Signed-off-by: Fathi Boudra <fathi.boudra@linaro.org>
2017-10-19cyclictest.sh: use pre-installed binary if being already installedChase Qi
In my case, my system has already get cyclictest installed, so just use it. Signed-off-by: Lei Yang <Lei.Yang@windriver.com> Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-10-17android: tjbench: replace ratio units '%' with 'percent'Chase Qi
'%' is reserved character for some version awk, use 'percent' instead to make it more portable. Change-Id: Ifcd8d79c7847e56d46edd3f071790c4820173d83 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-10-12automated:ltp: Add skips for fs and ltp testsDan Rue
Change-Id: Ibeae78cd4d602369300c5a1ab9ccff42b0186603 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-10-11plans/qcomlt: Add test plansAníbal Limón
This test plans are divded into benchmark, somke and stress testing. The device is set to dragonboard-410c instead of apq8016-sbc because this test plans are aimed to run when main LAVA instance [1] upgrade to v2 version like LKFT [2]. [1] https://validation.linaro.org/scheduler/device_type/apq8016-sbc [2] https://lkft.validation.linaro.org/scheduler/device_type/dragonboard-410c Change-Id: Ic4742181335c36211173f74054dfb57fb6d047ef Signed-off-by: Aníbal Limón <anibal.limon@linaro.org>
2017-10-11utils: filter 'find /lava-*' output to get test directory onlyChase Qi
Except LAVA test directories like '/lava-[0-9]+', the current approach also captures unwanted directories like '/lava-lxc' directory. When this case happen, it skips test attachment publishing as there is no 'serets' file in non-test directory. With '-regex' option, it filters find output and keep LAVA test directories only. Change-Id: I77f9fc490790a7eebbaaf353e9c4ed26ddad9879 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-10-06automated: ltp: add x15 skip fileMilosz Wasilewski
Change-Id: Iab4b9c86c1b96b956d3848114941fd046dceff7e Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-10-06device-script.sh: add support for oreo androidYongqin Liu
since the timestamp of android log will be updated to the build time or the realtime when network time availbe, we could not use the timestamp in logcat to calculate boottime information for all measurement. This change is to correct the launcher time measurement with timestamp information after timestamp updated to buildtime or networktime Change-Id: I36d88e2f3958130c31ef26eea3259215547d0ef0 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-10-05linux: ltp: skipfile-lkft-hikey: Skip fanotify07Dan Rue
fanotify07 was added to syscalls in LTP 20170929 and fails on some hikey boards approximately 50% of the time. See https://bugs.linaro.org/show_bug.cgi?id=3303 for details. Change-Id: I929b8373e9df72273c3b2a1a5cec5d6db34ce9e5 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-10-04linux: ltp: Add debug output (set -x)Dan Rue
Change-Id: I9d7a88d238aca1bd9c5c2c093c109148e59bd33c Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-09-28andorid automated boottime: some improvementsYongqin Liu
1. print more message for debug help to investigate why the analyse part is failed. some times the files collected lost when try to analyze like here: https://staging.validation.linaro.org/scheduler/job/191519#L13962 seems some problem there with the logcat_all_1.log file 2. add _avg suffix for the statistic result which we are interested in 3. ignore the case when grep keyword from logcat or dmesg 4. call disablesuspend.sh on device side to wait the launcher display log printed in logcat message Change-Id: I8006995397d407d7188a2137e8f4190bea86b4e0 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-27android: set 'adb wait-for-device' timeout to 10 minutesChase Qi
Change-Id: Iaa4a2178788c1bb461a4463bc697fd0c28ab2cb5 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-22android: tradefed: pass ANDROID_SERIAL env var to tradefed-runnerChase Qi
Environment variable ANDROID_SERIAL is set in setup.sh with initialize_adb() function as root user; while test is executed from tradefed.sh as testuser, we need to pass the variable to it. tradfed-runner.py is started from tradefed.sh, subprocess picks all environment vars set in tradefed.sh by default. Once ANDROID_SERIAL set properly, test will continue even when other devices appear during the test. So, this patch also can be a workaround for the below LAVA issue. https://projects.linaro.org/browse/CTT-481 Change-Id: Ic1479c2e835e08df0db22152cef6bf19ed12bfda Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-21test-runner: add support for remote execution in LAVAChase Qi
When '-l' or '--lava_run' option specified, test-runner will use lava-test-case to send result to LAVA. It might be possible to detect if it is running in LAVA at running time by checking if 'lava-test-case' exists, but that is not reliable as local environment can also has the util installed. So the above option introduced with 'False' as default value. Change-Id: Ief0c9e75d12c07832214d2d4fa30836df964615a Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-19android boottime and bootchart: install curl packageYongqin Liu
and update the token for artifactorial token Change-Id: I7d3901ee4fdd7ea55e4a0545c18327ef05b63cd5 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-19android apk-automation: set governor to performanceYongqin Liu
before start the benchmark applications Change-Id: I38d6d2dc6cc022066c5295786f7a060ee5ef5628 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-14linux: add iozone testChase Qi
Change-Id: I9e0baed19560f0eee6606094304620d3e835a7d3 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-14sh-test-lib: added support for x86 in detect_abi()Chase Qi
Change-Id: Ic9bcddbd476ecc912603603a4476180cc1ee24dc Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-14android: use adb_debug_info() in tradefed-runnerChase Qi
'lsusb' output in LXC is misleading. The issue has been fixed in adb_debug_info(). This patch removes the old approach in tradefed-runner and uses improved adb_debug_info(). Change-Id: I52c2bdc22e2fcc9bea95d762b51edc35897effeb Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-08android: tradefed: check user existence before useraddChase Qi
Change-Id: I9a7b04b03c50ebb4ee9707b7e6ce58fa9c8cdf83 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-08android-test-lib: move 'adb wait-for-device' to the right placeChase Qi
Change-Id: I6546c8608b70a63829a3de953240919cde1d8364 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-09-08android quadrantpro: change to run in permissive modeYongqin Liu
also kill the first time start since it could not display successfully, and no log output to show what's the problem there. after killed the first time start up, it works well in permissive mode from the 2nd time start up Change-Id: I04e91371d0e4babd57d72654924bd1d0bc543d65 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-08android: add prefix for test cases of andebenchpro2015Yongqin Liu
add the prefix of andebenchpro2015 for each test of the andebenchpro2015 benchmark application Change-Id: Ifc9115d53500e452ef7543e524dcac501289b63d Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-07android: add test for Andebenchpro 2015 testYongqin Liu
Skip the memory test to avoid the crash with hikey oreo build ATM Change-Id: Ic180634094d10ecca210bdb53d38b8a025acfefd Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-09-04linux: kselftests: allow for different paths of testsMilosz Wasilewski
LKFT now builds rootfs that contains a few versions of kselftests. This patch allows to use the desied version. Defaults were set to work with 'mainline' version of the tests. Change-Id: I30b3b8647e50ee066aaa21f1b02bb5a676adcb98 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-09-04ltp: Replace 'PASS/FAIL/SKIP' with 'pass/fail/skip' for LAVA friendly parserChase Qi
LAVA complain 'Bad test result' Received signal: <TESTCASE> TEST_CASE_ID=openat02 RESULT=SKIP Bad test result: SKIP Ref link: https://lkft.validation.linaro.org/scheduler/job/21959#L13158 Stop using capital string for result, which is invalid in LAVA so replace it with small letter strings Change-Id: Ifaf542fcf1b67f6fff57db3c91c49089ee7eaf0a Signed-off-by: Chase Qi <chase.qi@linaro.org> Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-09-01android: tradefed: enable shell '-e' optionChase Qi
cts/vts packaging download failure leads to test hangs until test timed out. Refer to: https://lkft.validation.linaro.org/scheduler/job/18457#L3168 Pexpect threw an exception says android-cts/vts not found, but it didn't exit for some reasons. With '-e' option enabled, test will exit on any errors. When this happen, LAVA will record the whole test run as fail. Change-Id: Ib7919ee2c4559c3673acb6ef475840cd20916f7f Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-31android: improve adb_debug_info()Chase Qi
Using 'lsusb' in LAVA-LXC directly is misleading. This is because from within the container lsusb will show all usb devices that are connected to host and there is no way to mask host devices from what is attached to the container. Though the devices show up on lsusb, each device should be added to the container via 'lxc-device add' command to make it accessible from within the container(which is done by LAVA). The current approach uses 'lsusb -D <device>' to get the information of devices found in '/dev/bus/usb' Change-Id: I28dc05f61685d995ac7fa9cc0e9831a936ef3a20 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-30LKFT: LTP: skip pselect01 and pselect01_64Naresh Kamboju
pselect01 is a intermittent failure on ARM/ARM64 devices. skip pselect01 and pselect01_64 until next LTP release because the fix patch is applied to mainline LTP master branch. Reference link to bug, LKFT: LTP: pselect01_64: slept for too long https://bugs.linaro.org/show_bug.cgi?id=3089 Change-Id: I8de96fbe792754064fd951a6a6846bed60ac8a5f Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-08-30android: tradefed: handle timeout exception on tf shell exitChase Qi
In some cases, TF shell refuse to exit with timeout in 60 seconds. Once pexpect captured the pattern in index 0 or index 1, test should be already finished. In the successful case, index 0, test report should be already generated, refer to the following example. It should be safe to kill the child process and continue to do the result parsing. ResultReporter: Full Result: /lava-21588/0/tests/\ 0_CtsFileSystemTestCases/automated/android/tradefed/android-cts/results\ /2017.08.28_21.28.08.zip Change-Id: I5ffeea82d0904891db464dd08f89a2b199541e92 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-29automated: android:Milosz Wasilewski
add debug for starting adb server on host Change-Id: I9c1bdfc06e6f5b44b94ff4682f073563234169b2 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-08-29utils: fix test attachment urlChase Qi
Artifactorial returns the full url now, the prefix isn't needed any more. Refer to https://lkft.validation.linaro.org/scheduler/job/21790#L3996 Change-Id: I579e49cc36c8cd38ed4b5f348a2cd4e661f67681 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-29Move license file to root directory to cover the whole repoChase Qi
Change-Id: I6ab18f968bdac52d02750cdd2da6ef8a068163f7 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-29Merge "test-runner: handle incorrect test definition parameters"Chase QI
2017-08-28xtest: fix result parserChase Qi
* Escape metacharacter '+' to make it more portable. * Use decimal for result measurement. Change-Id: I6f4c565481d7a2add55cd79399c355e9ee6e7d9a Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-27tradefed-runner.py: update result check expressionYongqin Liu
remove the log level info so that it matches the log output of CTS 8.0 as well otherwise it will fail to find the complete like this: https://staging.validation.linaro.org/scheduler/job/185880#L27171 Change-Id: I4a87f60540b288d68a5c2ada2bc35f2779589e46 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-08-27android apk-automation: fix error for javawhetstoneYongqin Liu
1. failed to save the apk file since not all the parent are created 2. need to be run in permissive mode 3. also add support for scp download so that it will be convenient for local tests Change-Id: I48291ffb8bb53f875f29add565fc453b684aa8e3 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-08-24android: print USB bus and device info for adb debuggingChase Qi
Print USB bus and device info for the following 3 conditions. * Before adb initialization * After 'adb root' command executed * When adb connectivity issue detected Change-Id: Id7ad9bf1238e5f55e3752680d0ae90bcd2c9b3d6 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-08-22apk-automation.sh: make it more convenient to run manuallyYongqin Liu
SKIP_INSTALL: change to default true, on PC side, we will only run the install step once for the first time, after that we don't need to specify the SKIP_INSTALL option super user requirement: change to only need the super user permission when run the installation steps. other steps of the test do not need to be run as root Change-Id: I372a0e729e8ca0adf1c56739acf71757c2ae4885 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2017-08-22android: run 'adb root' in the foregroundChase Qi
Run 'adb root' in the background with a sleep time is a work around for a specific adb version. It is not required in current LAVA code. Run 'adb root' directly works cross adb versions and distributions. It has been tested on Ubuntu xenial, Debian jessie and stretch with inhouse and latest adb. jessie: https://lkft.validation.linaro.org/scheduler/job/20107 https://lkft.validation.linaro.org/scheduler/job/20108 xenial: https://lkft.validation.linaro.org/scheduler/job/20156 https://lkft.validation.linaro.org/scheduler/job/20155 Stretch: https://lkft.validation.linaro.org/scheduler/job/20069 https://lkft.validation.linaro.org/scheduler/job/20140 Change-Id: Ibb3fa72b97729666656dbd749bc15b5446f37d5c Signed-off-by: Chase Qi <chase.qi@linaro.org>
generated by cgit v1.2.3 (git 2.25.1) at 2024-07-11 11:14:52 +0000