summaryrefslogtreecommitdiff
path: root/automated
AgeCommit message (Collapse)Author
2018-11-09kselftests: moving skip tests to qa reports known xfail testsNaresh Kamboju
kselftest skipfile contains only the hang and kernel crash tests. The known to fail test cases are moved to qa reports known issues repo. Here is the pull request, https://github.com/Linaro/qa-reports-known-issues/pull/24 Change-Id: I1652c10b99fa0bb8442d4f5fc42bb564df7d85bc Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-11-07linux: add docker integration test for local daemonChase Qi
Change-Id: Id44518c5cc8a74b4a272fd4e5587d7074dac9227 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-10-29LTP: skip fanotify08 and fanotify09 on 4.9 and 4.4Naresh Kamboju
fanotify08 and fanotify09 started running from new LTP release 20180926 and they reported timeout on 4.9 and 4.4 kernel. Ref: LTP: 20170929: fanotify07 causes v4.4 and v4.9 to hang due to kernel <-> userland dead-lock https://bugs.linaro.org/show_bug.cgi?id=3303 Change-Id: I2897c31d9fe6c5fcfa1a1f8647a8972ff79f1ff4 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-10-25Merge "LTP: skipfile: Add new 4.19 tag and remote obsolete 4.17"Dan Rue
2018-10-24kselftest: skipfile: Add new 4.19 tag and remove obsolete 4.17Naresh Kamboju
Change-Id: Ic2f889bacf33c6bc9a72dd9df1bfe348efdaaf21 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-10-24LTP: skipfile: Add new 4.19 tag and remote obsolete 4.17Naresh Kamboju
Change-Id: Iab0c35ba5e20c18dcbccb6e1b69e414916613521 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-10-16LTP and Kselftest: skiplist updated for 2 bugsRafael David Tinoco
skip known failures for bugs: Bug: #4023 - LTP: hugemmap06: cant reserve hugepages for small boards skipping it for x15. Bug: #4025 - Selftest: x86_syscall_arg_fault_32: bus errors are testing HW on QEMU and not the OS, skip for qemu. Change-Id: I79a1596eabd6d8a3ed6f170566e31c9a31b156d9 Link: https://bugs.linaro.org/show_bug.cgi?id=4023 Link: https://bugs.linaro.org/show_bug.cgi?id=4025 Signed-off-by: Rafael David Tinoco <rafael.tinoco@linaro.org>
2018-10-10Merge "skipgen: Build using go version go1.11.1"Milosz Wasilewski
2018-10-10kselftest: skip rseq: run_param_test.sh on all arm / arm64Naresh Kamboju
rseq: run_param_test.sh running more than hour on arm / arm64 devices. This will be skipped on all arm / arm64 devices till this get fixed on upstream. Change-Id: I3dfe18c7d3afe1c5dbed402a0a743b698281d824 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-10-09skipgen: Build using go version go1.11.1Dan Rue
Update the skipgen binaries to fix a runtime problem observed on juno. It's the same version of skipgen (v0.2.3), but the binaries have been re-built using go1.11.1. The following error has been observed on juno: ../../bin/arm64/skipgen --board juno-r2 --branch mainline --environment production /lava-446677/0/tests/1_ltp-quickhit-tests/automated/linux/ltp/skipfile-lkft.yaml [ 57.852577] audit: type=1701 audit(1538323393.606:3): auid=4294967295 uid=0 gid=0 ses=4294967295 pid=2883 comm=\"skipgen\" exe=\"/lava-446677/0/tests/1_ltp-quickhit-tests/automated/bin/arm64/skipgen\" sig=4 res=1 ../../lib/sh-test-lib: line 361: 2883 Illegal instruction (core dumped) ../../bin/${abi}/skipgen ${SKIPGEN_ARGS} \"${SKIPFILE_YAML}\" > \"${SKIPFILE_PATH}\" Building skipgen with the latest version of go, 1.11.1, seems to have fixed the issue. Change-Id: Ib983ab9c46fbedd7f1d2a6d6ac107a07ad78e638 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-10-02LTP: comment out runltp_testnameNaresh Kamboju
Since we have introduced known failures as xfail we do not need the summary of test check return value. Change-Id: If491d1be18bc55546c156d61f7c34edd39b1b286 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-09-21kselftest: skip hang test bpf test_kmod.sh on all devicesNaresh Kamboju
Change-Id: I4cb567408c1d4d7d594f3ccb4981418a41ec0450 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-09-17linux/v4l2-compliance: support to modprobe driver and install v4l-utilsChase Qi
* Add hikey to supported board list. * Add support to modprobe driver module. * Try to install v4l-utils when v4l2-compliance command not found. * Drop support for media device testing as we cannot really test it. * Bug fixes. Change-Id: I8518a06e04a1f842f4ebacf32c9b63eaf58ef5cb Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-09-04automated: linux: initial ota update testVishal Bhoj
Change-Id: Ia5cd0303437bd28f2992b1f8f26fe77a265b697e Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>
2018-08-31LTP: skiplist updated for qemu_i386 and i386Naresh Kamboju
skip known failures on qemu_i386 and i386 - select04 - fcntl36 - futex_wake04 Change-Id: Iff9f4fbd0e1b50d64b6583e8dcc30be65d0d028e Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-08-31LTP: skip known failure cve-2014-0196 on db410cNaresh Kamboju
Change-Id: I3f2ae0abc66df71ec8b6389c83c3982566446171 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-08-30kselftest: Adding i386 and qemu_i386 device entries for skipfileNaresh Kamboju
Skip known kselftest failures on i386 and qemu_i386. Change-Id: I8cc2fe1de8efa548706404204d1b06edc09a9299 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-08-30LTP: update skipfile for i386Naresh Kamboju
Adding i386 device to skipfile to skip known failures on this device. Change-Id: Idacd9672e4c480f662cf58bb8126d48f087bc4a3 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-08-29Merge "add noninteractive tradefed test wrapper"Chase Qi
2018-08-29add noninteractive tradefed test wrapperVishal Bhoj
tradefed can handle adb disconnection and other device issues. Whenever adb connection to the device breaks, tradefed will wait for a timeout and end the testing which inturn will end the process. We should then get a return code of failure. Change-Id: I814a2194ae1663cf932a3aab30137736e6fab7ac Signed-off-by: Vishal Bhoj <vishal.bhoj@linaro.org>
2018-08-27LTP: adding qemu_i386 device for skipfileNaresh Kamboju
Change-Id: I9149942e7d2273a51942b3f1502fbc9f480b1ce3 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-08-24Merge "Add i386 skipgen binary"Milosz Wasilewski
2018-08-24Merge "linux/dockerized-tests: add local run support and readme"Milosz Wasilewski
2018-08-24Merge "linux/dockrized-tests: launch container with --privileged and --init ↵Milosz Wasilewski
flags"
2018-08-24linux/dockrized-tests: launch container with --privileged and --init flagsChase Qi
--privileged flag is required by tests need to modify system/kernel parameters. --init flag is required by ltp syscalls so that tests spawned and exit correctly. Change-Id: Ic903adb8c943206247f406d094b63e24dec4083e Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-08-24linux/dockerized-tests: add local run support and readmeChase Qi
Change-Id: I351b336bb643b66b4a739915bd263ba66de59b0b Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-08-23Add i386 skipgen binaryDan Rue
Bump everything to skipgen v0.2.3 - but the only change is the addition of i386. Change-Id: I7bfa5ee76b5d66c00bffd44d77c7a2833c6bd680 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-08-23automated/lib/sh-test-lib: update detect_abi with i386Anders Roxell
Change-Id: Ice90297b025b2cbf167cce3928559f2f54bd556f Signed-off-by: Anders Roxell <anders.roxell@linaro.org>
2018-08-22kselftest: update skiplist based on v4.18Naresh Kamboju
As a part of kselftest upgrade to v4.18 the new known failed test cases to be skipped. So the skiplist is been updated. Change-Id: Id307b337458e7f99deb973991c5b4e23bc7bf3b7 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-08-16android apk-automation: update some benchamrks to work with pie and laterYongqin Liu
when run some tests on pie builds, the older version dialog was popped up, and we need to press the OK button there to make the benchmark apks continue. This this change is to fix that problem. Change-Id: I5ae0607b72277b2b9008a6cd9464eb33e28c0021 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2018-08-16Merge "android apk-automation: add Geekbench4 test"Milosz Wasilewski
2018-08-15LKFT: kselftest skipfile: 4.18 renamesDan Rue
As of linux 4.18, some tests now have their directory name, followed by an underscore, prepended to the test name. Update to add the new test names, and leave the old ones for backward compatibility. Change-Id: I266b7c6d7d63ffe8aad10603f221659b4664f398 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-08-15android apk-automation: add Geekbench4 testYongqin Liu
with apk from here: https://geekbench-3.en.uptodown.com/android Change-Id: I096696455a585d244f089e7a9befbf4337f0cec2 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2018-08-14LKFT: Add 4.18 branch to skipfilesDan Rue
Change-Id: I34ac47bd4e88dcb4da7f6796b58b46a767ffe283 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-08-08linux: add support for test run with dockerChase Qi
With over-ssh* test case, test will be triggered over ssh. Change-Id: Icaa4b57324d0628ba771a36c2e4c0a606fa4788b Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-08-07android boottime: add adb_root for collect dmesg infoYongqin Liu
running dmesg command need to have super user permission Change-Id: Iff2b6d3f6fb94b1743f6f2e6f8dc5624a8a6c341 Signed-off-by: Yongqin Liu <yongqin.liu@linaro.org>
2018-08-06LTP: unskip netns_* tests on lkft build testingNaresh Kamboju
Change-Id: I91f61b260a0b05c8d7adf0e7089b2cd0890d9398 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-08-01send-to-lava: send result elements in the same order as receivedChase Qi
This change only effects test local execution. Unify elements order in result line will benefit log post processing. Change-Id: Ifa2dffe7a90401209d3008e804ce2bbbb41b40de Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-07-31Merge "linux/aep-pre-post: install dependencies with virtualevn"Chase Qi
2018-07-30linux/aep-pre-post: install dependencies with virtualevnChase Qi
Run LISA within python2 virtualevn to avoid dependency confliction with other tools. Change-Id: I8e5487f740ba11ba695e73db2f3e8917cd672395 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-07-24workload-automation3: Update default paths and config filenamesLisa Nguyen
Fix remaining outdated paths and config filenames to run WA3. Otherwise, we will end up running WA2 if we don't cd into the correct directory and WA3 does not use config files with the .py extension. Change-Id: I4b081cbc7e2adf991b4272ada48018217724560b Signed-off-by: Lisa Nguyen <lisa.nguyen@linaro.org>
2018-07-24LTP: skip open11 on all qemuNaresh Kamboju
skip known test failure open11 on qemu_x86_64, qemu_arm and qemu_arm64. LKFT: next: LTP open11 failed - Got: TEST_ERRNO=EACCES(13): Permission denied instead of errno 0 userland update morty to rocko (openembedded) caused this bug. Ref: https://bugs.linaro.org/show_bug.cgi?id=3948 Change-Id: I13c1f6d9d3b33bb1f69fcf25a37e4294c6cb1e78 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-07-23workload-automation3: add test cases for WA3Chase Qi
Base on the current workload-automation test case: * Install WA3 with pip3 as it is python3 based. * The format of config file has been changed in WA3. Templates for WA3 are hosted here https://git.linaro.org/qa/wa-templates.git/. Required changed in test script updated. * The same as android, install latest devlib on Linux. Keep the original test cases for WA2 until they are not needed. Change-Id: I6dcc26b1ab292b876fe0696277db4d72194c4476 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2018-07-20Kselftest: Remove obsolete 4.16 branch from skiplistNaresh Kamboju
Change-Id: I7b52b0868367d686dc4c66ef7b9f1e3f99a4ff71 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-07-19Merge "LTP: skip fcntl36 on qemu_arm"Dan Rue
2018-07-19LKFT: kselftest: skip rtcpie on qemuNaresh Kamboju
Skip known failed test case rtcpie on qemu This test case need a HW clock which is missing on qemu Ref: db410c: rtcpie: /dev/rtc0: No such file - timers tests not unsupported url: https://bugs.linaro.org/show_bug.cgi?id=3924 Change-Id: I29db787146fc816ed8b6016bdfbc1f46bc04b644 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-07-19LTP: skip fcntl36 on qemu_armNaresh Kamboju
Change-Id: I11000ec5b08c987d27c7aac8efb1f2337cdfae01 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-07-19LTP: skip known LTP failures creat08 and open10Naresh Kamboju
These two test cases creat08 and open10 to be skipped until the upsteam LTP fix test cases. Ref: LKFT: creat08 and open10 testdir.B.3132/setgid: Incorrect modes, setgid bit should be set https://bugs.linaro.org/show_bug.cgi?id=3940 Change-Id: I4f252021e17e025ec10963999c1c961f92a591e7 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-07-17LKFT: kselftest: skip rtcpie on db410cNaresh Kamboju
Dragonboard 410c doesn't seem to have a functional hardware clock. a HW clock is really needed, and this test should be skipped from kselftest for Dragonboard 410c. Ref: db410c: rtcpie: /dev/rtc0: No such file - timers tests not unsupported url: https://bugs.linaro.org/show_bug.cgi?id=3924 Change-Id: Ieaa4946ec864a3bbd54982fd1939fda35a4b8f91 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-07-11LTP: skip known failure test case inotify08 on 4.14Naresh Kamboju
inotify08 is not supported on 4.14, 4.9 and 4.4 Ref: LKFT: LTP: inotify08 FAIL: didn't get event: mask=4 https://bugs.linaro.org/show_bug.cgi?id=3881 Change-Id: I38ac1ef65f4fb2f3093f5a8a4eb4523cc5580566 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
generated by cgit v1.2.3 (git 2.25.1) at 2024-07-03 03:46:37 +0000