summaryrefslogtreecommitdiff
path: root/automated/linux/ltp
AgeCommit message (Collapse)Author
2017-12-13[WIP] automated: ltp: skipfile created for skipfile_${device}_{kversion}HEADmasterNaresh Kamboju
Following issues are addressed - Uniform naming as skipfile_{device}_{kversion} - Move all skipfiles under skipfiles directory - Created soft link skipfiles - Skipfile content modified to have single test case name per line Change-Id: Ic0d44e7935ee378ca22e9b144f823a682c29a1ec Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-12-12automated: ltp: provide minimal skiplist for LKFT projectMilosz Wasilewski
Change-Id: I37d224ee8f6b1d724ac72f506a54842d5d107739 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-12-12ltp: skipfile: keep only single word testcase name in skipfileNaresh Kamboju
When you want to skip a testcase make sure to write single word testcase name in skipfile. Change-Id: I87f0320daddfb9423036ca33d89131f9e1939827 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-12-06LTP: Juno: stop skipping NFS failed test casesNaresh Kamboju
Since we have sda1 mounted on to /ltp-tmp as TMPDIR for LTP runs stop skipping NFS failed test cases on Juno device. Ref: ltp: update test definition to allow for TMPDIR settings https://projects.linaro.org/browse/QA-1723 Change-Id: I132cf770a4d1160efe6a64f4bf84debeec4154a1 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-21LTP: Skip msgctl10 which fails on QDF2400Dan Rue
Not only does it fail, it also does not seem to finish cleanly and cause other tests to fail inconsistently, and all of LTP to exit early (as observed by the number of test results) https://bugs.linaro.org/show_bug.cgi?id=3487 Change-Id: Id991d961d58475ed956259c1554b978deab83bf5 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-20linux: ltp: skip min_free_kbytes on RPKChase Qi
By default, Debian installer will set the size of swap partition to the size of memory capacity. min_free_kbytes needs to occupy both memory and swap spaces. When memory size is large, this test takes hours to finish. For example, on D05 that 128G memory installed, this test takes more then 3 hours. It can be finished, but just too slow. It is possbile to customize partitioning steps to reduce swap partition size for this single test, but that is probably not wanted. Change-Id: I99e397f5277e49c9e01f7d73f34f126f5a8e3764 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-11-20LTP: Skip keyctl03 in RPKNaresh Kamboju
This test fails when run under automation but passes when run manually. Reported in https://bugs.linaro.org/show_bug.cgi?id=3451 Change-Id: I5a1781a8a967de7d457017ed5ee91d59d735f07b Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-17LTP: Skip netns ipv6 tests in RPKDan Rue
Known timing issue in test https://bugs.linaro.org/show_bug.cgi?id=3420 Change-Id: Ibe91acb3e1aade7914356ace2c35d269802ba75b Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-17LTP: skip intermittent failure perf_event_open02Naresh Kamboju
skip LTP syscalls (intermittent failure) perf_event_open02 test case. Ref: LKFT: 4.9-rc: x86: LTP: perf_event_open02.c:333: test failed (ratio was greater than ) - intermittent failure https://bugs.linaro.org/show_bug.cgi?id=3382 Change-Id: If7a7640758ecd59a041c8f10173cdfab1b0145e5 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-16LTP: skip ioctl03 on all devicesNaresh Kamboju
Skip LTP test case ioctl03 on all devices. Ref: LKFT: linux-mainline: Hikey and x15: LTP ioctl03: TFAIL: ioctl03.c:114: (UNKNOWN 0x30) https://bugs.linaro.org/show_bug.cgi?id=3470 Change-Id: Ied681edb3ea5d213cc2f2c6a5e38fcd472ed48eb Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-16LTP: x86: skip intermittent failure readahead02Naresh Kamboju
LTP test case readahead02 failed intermittently on x86 running stable-4.4. Ref: LKFT: 4.4: LTP readahead02 fails on x86 https://bugs.linaro.org/show_bug.cgi?id=3457 Change-Id: Id0c4f86bd4b62cc1dc97f8e33cc0bad6f1084e02 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-15Merge "LTP: Juno: skipfile-lkft-juno soft link created from skipfile-lsk-juno"Dan Rue
2017-11-15LTP: Adding known LTP failures to skipfileNaresh Kamboju
Adding known fail test cases to Hikey, Juno, x15 and x86. Reference bug id and ticket ids are updated inside each skipfile. Change-Id: Iecf7a088286a9d290476625a47f37d513d493b78 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-15LTP: Juno: skipfile-lkft-juno soft link created from skipfile-lsk-junoNaresh Kamboju
Change-Id: I1ef3e6d5bd6b6d92526729d8c8ce7fd63a42d722 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-14ltp: hikey: skip fcntl35Naresh Kamboju
skip these two test cases on Hikey running linux-4.4 fcntl35 fcntl35 fcntl35_64 fcntl35_64 LKFT: 4.4: Hikey: LTP: fcntl35.c:98: FAIL: an unprivileged user init the capacity of a pipe to 65536 unexpectedly, expected 4096 https://bugs.linaro.org/show_bug.cgi?id=3378 Change-Id: I0d82a0a3dee0266db8de01a978efce0459897147 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-14LTP: Enable kernel.unprivileged_userns_cloneDan Rue
Test 'userns07' verifies that the kernel imposes a limit of at least 32 nested levels on user namespaces. However, user namespaces are disabled by default in debian. If user namespaces are disabled, enable them. Change-Id: I223a8f974905ae8f0373adc71c3bab2ef10c98ff Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-13LTP RPK Skipfile: Re-enable rwtest03 and rwtest04Dan Rue
Verified fixed via https://bugs.linaro.org/show_bug.cgi?id=3191#c17 Change-Id: Ie6dded09d9818ec1cc289015343b954c3a872e05 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-09LTP: Stop systemd-timesyncd if runningDan Rue
systemd-timesyncd interferes with the leapsec_timer test. Disable it. Change-Id: I616b74d6ea4aa07ad973e548dfa7664c4b03f6e8 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-08automated: ltp: add getrandom02 to skipfileMilosz Wasilewski
getrandom sometimes fails because of SIGKILL. Bug reported: https://bugs.linaro.org/show_bug.cgi?id=3401 Change-Id: I86b56467594c5b8b468646ad3ad8e9a764a52b90 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-11-07automated: ltp: add leapsec_timer to LTP skiplistMilosz Wasilewski
leapsec_timer ocassionaly fails because some other process updates the clock during testing. Change-Id: I46629786b6206c7324e95df2cee9115848021626 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-11-06LTP: Add package 'acl' for acl_test01Dan Rue
Add package 'acl' in both debian and redhat based distros. It is required by acl_test01 (which uses setfacl). Change-Id: I7b9bd72b8e3945b3ad8bf93491dd0db0f2782230 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-02LTP: Add automake package dependencyDan Rue
Needed for building LTP. Not sure why this wasn't already listed - perhaps most systems already have it incidentally. Change-Id: If6d9e41c9e84f40d65a6ebb1f82fc8f716259a7f Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-11-01automated: linux: ltp: skip utimensat01 on junoNaresh Kamboju
utimensat01 should have skipped by LTP but it got failed when using NFS rootfs. till NFS issues resolved this test will be under skip list for juno. LKFT: linux-mainline: Juno: LTP utimensat01 failed due to NFS mounted rootfs https://bugs.linaro.org/show_bug.cgi?id=3398 Ref: mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 Change-Id: I46c1828e9093d10573f2d5d01852aa5515b283bf Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-01automated: ltp: skip linkat01 on x86Naresh Kamboju
Due to NFS file system on x86 the LTP test case linkat01 failed so skip it. Ref: mainline kernel tests baselining https://projects.linaro.org/browse/CTT-585 Change-Id: Ia615315d7259e2aa24e1c12376f57519580410dd Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-11-01automated: ltp: prevent failing LAVA job if rm TMP_DIR failsMilosz Wasilewski
Change-Id: I0f116bdfa49442bcddc2edc537e388c09ea566a7 Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-10-30LTP: Skip flaky LTP tests on x15Dan Rue
Change-Id: I3dfdccc7b3893872a14ea8d5436ab0edfb7ddd11 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-10-24automated: ltp: skip quota_remount_test01 on hikey and junoNaresh Kamboju
Till this bug resolved quota_remount_test01 will be skipped Reference: ltp-fs-tests/quota_remount_test01 https://bugs.linaro.org/show_bug.cgi?id=3354 mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 Change-Id: I7f53182962fab7f03ffe394e6c4d6e2834409267 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-21automated: ltp: skip ltp containers Network Namespaces testsNaresh Kamboju
skip ltp containers Network Namespaces tests hikey, juno, x15 and x86. skip failed 17 test cases on x15 and x86. skip failed 5 test cases on hikey and juno. Reference: mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 LKFT: linux-mainline: HiKey and Juno: ltp-containers Network Namespaces tests failed https://bugs.linaro.org/show_bug.cgi?id=3327 Change-Id: Iaf369a25d7d0ab24736ff3d64554b48c8aa60ad7 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-20automated: ltp: skip quotactl01 test on hikey juno and x15Naresh Kamboju
Skip quotactl01 test on hikey juno and x15. Reference: mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 Change-Id: I588c41934b8b1d27d3dcda4bae1a2d614243dd7f Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-20automated: ltp: skip NFS not supported ltp syscalls tests on x86 and junoNaresh Kamboju
Skip NFS not supported LTP syscalls tests on x86 and juno when test setup using NFS file system on x86 and Juno device. Reference: mainline kernel tests baselining https://projects.linaro.org/projects/CTT/queues/issue/CTT-585 Change-Id: I4dc45b2a157d4cb08a4be78267d5ea436a37bf7b Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-20automated: ltp: skip ltp sched tests on x86 and junoNaresh Kamboju
LTP sched tests hog the cpu which is causing NFS server not responding issues when test setup using NFS file system on x86 and Juno device. so skip these test cases pth_str01 pth_str02 pth_str03 time-schedule01 LKFT: linux-mainline: x86 : ltp sched tests hang due to NFS not responding https://bugs.linaro.org/show_bug.cgi?id=3338 Change-Id: I080d89961ebe6c8ed59784d69472e83f8a66ac53 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-19automated: linux: ltp.sh: bump LTP version to 20170929Naresh Kamboju
Change-Id: I5cd0102cd940b1036daaf2e09d96b2bae37b9c3e Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-19automated: linux: ltp: bump LTP version to 20170929Naresh Kamboju
Change-Id: I47ad444f9210831ee7623d5df2187f780cea91d9 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-10-12automated:ltp: Add skips for fs and ltp testsDan Rue
Change-Id: Ibeae78cd4d602369300c5a1ab9ccff42b0186603 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-10-06automated: ltp: add x15 skip fileMilosz Wasilewski
Change-Id: Iab4b9c86c1b96b956d3848114941fd046dceff7e Signed-off-by: Milosz Wasilewski <milosz.wasilewski@linaro.org>
2017-10-05linux: ltp: skipfile-lkft-hikey: Skip fanotify07Dan Rue
fanotify07 was added to syscalls in LTP 20170929 and fails on some hikey boards approximately 50% of the time. See https://bugs.linaro.org/show_bug.cgi?id=3303 for details. Change-Id: I929b8373e9df72273c3b2a1a5cec5d6db34ce9e5 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-10-04linux: ltp: Add debug output (set -x)Dan Rue
Change-Id: I9d7a88d238aca1bd9c5c2c093c109148e59bd33c Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-09-04ltp: Replace 'PASS/FAIL/SKIP' with 'pass/fail/skip' for LAVA friendly parserChase Qi
LAVA complain 'Bad test result' Received signal: <TESTCASE> TEST_CASE_ID=openat02 RESULT=SKIP Bad test result: SKIP Ref link: https://lkft.validation.linaro.org/scheduler/job/21959#L13158 Stop using capital string for result, which is invalid in LAVA so replace it with small letter strings Change-Id: Ifaf542fcf1b67f6fff57db3c91c49089ee7eaf0a Signed-off-by: Chase Qi <chase.qi@linaro.org> Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-08-30LKFT: LTP: skip pselect01 and pselect01_64Naresh Kamboju
pselect01 is a intermittent failure on ARM/ARM64 devices. skip pselect01 and pselect01_64 until next LTP release because the fix patch is applied to mainline LTP master branch. Reference link to bug, LKFT: LTP: pselect01_64: slept for too long https://bugs.linaro.org/show_bug.cgi?id=3089 Change-Id: I8de96fbe792754064fd951a6a6846bed60ac8a5f Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-07-13linux: ltp: Fix su01Dan Rue
The su01 test has three problems: - It requires expect (fixed in this patch) - It requires root's password to be set in environment variable PASSWD (fixed in this patch; hard coded to 'root') - It requires a fix to su01 in LTP itself - proposed change at https://github.com/linux-test-project/ltp/pull/183 Change-Id: I1a693a62058f59446b68fe48cc5739e09dc6c70c Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-07-13linux: ltp: Change LTP_TMPDIR to /ltp-tmpNaresh Kamboju
LTP_TMPDIR=${HOME}/ltp-tmp is causing below error so fixing by changing LTP_TMPDIR=/ltp-tmp Error: chdir03 2 TBROK : chdir03.c:153: rmdir(/home/root/ltp-tmp/ltp-G4ktVVX945/chdEY97gl/3090) failed: errno=ENOENT(2): No such file or directory Change-Id: I6026372ffd1dd234e76d3667e2546d1c40a5b801 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-07-11linux: ltp: Install libaio for ltp/aio0[12]Dan Rue
Change-Id: Ifc5a2494e2734ee2dd174af68d2f23293f347cb7 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-07-11linux: ltp: use mkdir -m 777 to create LTP TMPBASE directoryNaresh Kamboju
runltp script uses -d parameter to set the tmp base directory. Behind the scene, it's using already mktemp -d to create a unique directory. Simply create a base directory as expected by runltp script, with permission set to 777 for tests that call tst_tmpdir() and try to write to it as user nobody. It's fixing also the following error: chdir03 2 TBROK : chdir03.c:153: rmdir(/home/root/ltp-tmp.ePFn/ltp-Jey9cImTdA/chdhhnMyQ/3141) failed: errno=ENOENT(2): No such file or directory Change-Id: Ic3349fdb51919d220070af5ddcf50f031a57a3b4 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-07-07linux: ltp: create temporary directoryNaresh Kamboju
Create LTP temporary files under $(mktemp -d ${HOME}/ltp.tmp.XXXX) directory. This will fix readahead02 test failure so stop skipping it. with reference to bug, LTP: readahead02: readahead failed to save any I/O https://bugs.linaro.org/show_bug.cgi?id=2961 Change-Id: Ic923234332d1a8782118ed4560f9c9eb8c4c2308 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-07-03linux: ltp: skipfile-lkft-hikeyNaresh Kamboju
Lets re-enable test cases which fixed on latest LTP and cherry-picked in OE build. - faccessat01 - fchmodat01 with reference to Bug 2963 - LTP: faccessat01 1 TBROK : tst_sig.c:233: unexpected signal SIGSEGV(11) received (pid = 2573) Bug 2964 - LTP: fchmodat01: 1 TBROK : tst_sig.c:233: unexpected signal SIGSEGV(11) received (pid = 2592) Change-Id: I121058d47ed110e315f88d3b5ab43616be543b84 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2017-06-23Skip ltp rwtest03 and rwtest04Dan Rue
Per https://bugs.linaro.org/show_bug.cgi?id=3068 Change-Id: I12fbb90d9248eea8aa2fd513359734026d53106e Signed-off-by: Dan Rue <dan.rue@linaro.org>
2017-06-21linux: ltp: install sudo for utimensat01 testChase Qi
This patch fixes the below error utimensat01 1 TBROK: can't read /etc/sudoers Change-Id: I8cfc8645007f38938d0e97aab6632ba84566813f Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-06-20linux: ltp: install genisoimage for isofs testChase Qi
Change-Id: I10749307b18e92a7414837c220393e2acf21a8b2 Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-06-19linux: ltp: install quota to solve test dependencyChase Qi
* quota is required by quota_remount_test01 * cope with shellchecks Change-Id: Iac605a4d75d0652e305989511f1d7369603f8e9c Signed-off-by: Chase Qi <chase.qi@linaro.org>
2017-06-16Merge "linux: ltp: fix a typo"Milosz Wasilewski