aboutsummaryrefslogtreecommitdiff
path: root/automated/linux/ltp/skipfile-lkft.yaml
AgeCommit message (Collapse)Author
2019-02-21LTP: skip LTP dio long running tests on all devicesNaresh Kamboju
From KV-171 investigation LTP dio long running tests have been identified and skipping those test cases on all devices. Ref: https://projects.linaro.org/browse/KV-171 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2019-02-13LTP: skipping memory mtest06 and ksm01Naresh Kamboju
Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2019-02-06LTP: moved skip list to qa known issues listNaresh Kamboju
The test cases known to failed are moved from skipfile-lkft.yaml to qa known issues report repository ltp-production.yaml file. The fixed test cases entries removed from skipfile-lkft.yaml file. Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2019-01-10LTP: sendfile09: skip creating large filesNaresh Kamboju
sendfile09 and sendfile09_64 tests creates 5GB file and calls sendfile(2) with offset at 3GB. These tests are time consuming so skipping on slow devices db410c and hikey. Change-Id: I9a215e1fd531dd31f1ffa5acc1a28485dd19dcec Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2019-01-08lkft skipfiles: Add 4.20; rm 4.18, 4.16Dan Rue
Update list of stable branches where applicable. Change-Id: Ib13184907555dd094fa3567fec3e3734e13b5369 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-10-29LTP: skip fanotify08 and fanotify09 on 4.9 and 4.4Naresh Kamboju
fanotify08 and fanotify09 started running from new LTP release 20180926 and they reported timeout on 4.9 and 4.4 kernel. Ref: LTP: 20170929: fanotify07 causes v4.4 and v4.9 to hang due to kernel <-> userland dead-lock https://bugs.linaro.org/show_bug.cgi?id=3303 Change-Id: I2897c31d9fe6c5fcfa1a1f8647a8972ff79f1ff4 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-10-24LTP: skipfile: Add new 4.19 tag and remote obsolete 4.17Naresh Kamboju
Change-Id: Iab0c35ba5e20c18dcbccb6e1b69e414916613521 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-10-16LTP and Kselftest: skiplist updated for 2 bugsRafael David Tinoco
skip known failures for bugs: Bug: #4023 - LTP: hugemmap06: cant reserve hugepages for small boards skipping it for x15. Bug: #4025 - Selftest: x86_syscall_arg_fault_32: bus errors are testing HW on QEMU and not the OS, skip for qemu. Change-Id: I79a1596eabd6d8a3ed6f170566e31c9a31b156d9 Link: https://bugs.linaro.org/show_bug.cgi?id=4023 Link: https://bugs.linaro.org/show_bug.cgi?id=4025 Signed-off-by: Rafael David Tinoco <rafael.tinoco@linaro.org>
2018-08-31LTP: skiplist updated for qemu_i386 and i386Naresh Kamboju
skip known failures on qemu_i386 and i386 - select04 - fcntl36 - futex_wake04 Change-Id: Iff9f4fbd0e1b50d64b6583e8dcc30be65d0d028e Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-08-31LTP: skip known failure cve-2014-0196 on db410cNaresh Kamboju
Change-Id: I3f2ae0abc66df71ec8b6389c83c3982566446171 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-08-30LTP: update skipfile for i386Naresh Kamboju
Adding i386 device to skipfile to skip known failures on this device. Change-Id: Idacd9672e4c480f662cf58bb8126d48f087bc4a3 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-08-27LTP: adding qemu_i386 device for skipfileNaresh Kamboju
Change-Id: I9149942e7d2273a51942b3f1502fbc9f480b1ce3 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-08-14LKFT: Add 4.18 branch to skipfilesDan Rue
Change-Id: I34ac47bd4e88dcb4da7f6796b58b46a767ffe283 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-08-06LTP: unskip netns_* tests on lkft build testingNaresh Kamboju
Change-Id: I91f61b260a0b05c8d7adf0e7089b2cd0890d9398 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-07-24LTP: skip open11 on all qemuNaresh Kamboju
skip known test failure open11 on qemu_x86_64, qemu_arm and qemu_arm64. LKFT: next: LTP open11 failed - Got: TEST_ERRNO=EACCES(13): Permission denied instead of errno 0 userland update morty to rocko (openembedded) caused this bug. Ref: https://bugs.linaro.org/show_bug.cgi?id=3948 Change-Id: I13c1f6d9d3b33bb1f69fcf25a37e4294c6cb1e78 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-07-19LTP: skip fcntl36 on qemu_armNaresh Kamboju
Change-Id: I11000ec5b08c987d27c7aac8efb1f2337cdfae01 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-07-19LTP: skip known LTP failures creat08 and open10Naresh Kamboju
These two test cases creat08 and open10 to be skipped until the upsteam LTP fix test cases. Ref: LKFT: creat08 and open10 testdir.B.3132/setgid: Incorrect modes, setgid bit should be set https://bugs.linaro.org/show_bug.cgi?id=3940 Change-Id: I4f252021e17e025ec10963999c1c961f92a591e7 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-07-11LTP: skip known failure test case inotify08 on 4.14Naresh Kamboju
inotify08 is not supported on 4.14, 4.9 and 4.4 Ref: LKFT: LTP: inotify08 FAIL: didn't get event: mask=4 https://bugs.linaro.org/show_bug.cgi?id=3881 Change-Id: I38ac1ef65f4fb2f3093f5a8a4eb4523cc5580566 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-07-04LTP: skip inotify07 and inotify08 on 4.4 and 4.9Naresh Kamboju
Skip known failed inotify07 and inotify08 on 4.4 and 4.9 on all devices. Ref: https://bugs.linaro.org/show_bug.cgi?id=3931 https://bugs.linaro.org/show_bug.cgi?id=3881 Change-Id: Iceea5f08900a026e8cd5ea5e45ab1f0551ddad51 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-06-26LTP: skip cve-2015-3290 on qemu_x86_64Naresh Kamboju
Skip known intermittent failure test case cve-2015-3290 on qemu_x86_64 on all branches. Ref: LKFT: LTP: cve-2015-3290 failed intermittently on qemu_x86_64 https://bugs.linaro.org/show_bug.cgi?id=3910 Change-Id: I58ee844318c3e58a67708841f716790733cb0a53 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-06-20LTP: LKFT: msgctl10/11 renamed to msgstressDan Rue
Per http://lists.linux.it/pipermail/ltp/2018-June/008358.html, msgctl08-msgctl11 will be renamed to msgstress01-msgstress04. Update our skiplist accordingly. Change-Id: Ie9325e51788e6f4a69a8826dd5a8c710c435ee96 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-06-19LTP: skip keyctl02 on slow qemu_armNaresh Kamboju
qemu_arm is slow to complete keyctl02 in 30 minutes. Better to skip this test case on qemu_arm. Ref: https://bugs.linaro.org/show_bug.cgi?id=3883 Change-Id: I5f84eea9b919fec028ab39c95d9b4f3e0e923980 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-06-11LTP: update skipfile for 4.17Naresh Kamboju
Change-Id: Ia2a841bc8d7c463823190cdf62d1a8483adef733 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-06-07LTP: skips select04 on fully virtualized environmentsRafael David Tinoco
Fixes: https://bugs.linaro.org/show_bug.cgi?id=3852 Skips known LTP timing issue: select04 on qemu32 and qemu64. Change-Id: Ie5a151763bb911dbce6d71cc5222e3a5497ebf7d Signed-off-by: Rafael David Tinoco <rafael.tinoco@linaro.org>
2018-06-05LTP: skip known LTP CVE failuresNaresh Kamboju
Skip the known LTP CVE failures - cve-2011-2183 - cve-2014-0196 - cve-2015-7550 - cve-2016-7117 Change-Id: I9a0b0e19fe866be06408b27b8f8e5cf7ab03fb6a Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-05-25LTP: unskip fcntl35 and fcntl35_64Naresh Kamboju
Backport patch fixed fcntl35 and fcntl35_64 on 4.4 kernel. so unskip these tests. Re: Backport of pipe.c patch to 4.4.y that fixes LTP fcntl35 test error https://www.spinics.net/lists/stable/msg239475.html https://www.spinics.net/lists/stable/msg239479.html Bug link: https://bugs.linaro.org/show_bug.cgi?id=3378 Change-Id: I8692e731d7200c910aa82f9de01bd351e4c713f9 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-05-03LTP: skip known failed tests on qemu_armNaresh Kamboju
The following known failures test cases skipped on qemu_arm. - fork13 - msgctl10 - msgctl11 - pselect01 - pselect01_64 - quotactl01 - readahead02 Change-Id: I9c889d690c3d4d016953dfee298db86ad5fdb916 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-04-27LTP: skip ltp sched hackbench tests on qemu arm and qemu arm64Naresh Kamboju
LTP sched tests hackbench crashing the system so skip them. Ref: https://bugs.linaro.org/show_bug.cgi?id=3777 Change-Id: I90f52eb8f09c93d1b59a735a3610924b657a662b Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-04-25LTP: skip sched subtests on qemu_arm and qemu_arm64Naresh Kamboju
Skip the following LTP sched sub tests on qemu arm and arm64 - pth_str01 - pth_str02 - pth_str03 - time-schedule01 Change-Id: I65c30fe0ad02a9bcd5a91c47eb619c7dc20cc817 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-04-24LTP: skip timed out test cases on qemu devicesNaresh Kamboju
ltp-syscalls-tests failed and timed out on slow qemu devices. It is better to skip these LTP timing related test case on qemu devices. * clock_nanosleep02 * epoll_wait02 * futex_wait05 * nanosleep01 * poll02 Ref: https://bugs.linaro.org/show_bug.cgi?id=3768 Change-Id: I588231576da4d643af13e95b3f83754b33c7c9ed Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-04-16LTP: audit and update ltp skipfile for lkft buildsNaresh Kamboju
LTP skipfile updated with bug urls, reason for skip. Few testcases no longer to be skipped have been removed. Ref: https://projects.linaro.org/browse/CTT-1048 Change-Id: Ib15bc6ef1a7ba7a1b14e7cd5e6ce60d89446b61a Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-04-06LKFT: skipfiles: Add 4.16Dan Rue
Change-Id: Ib77621f642246f95b90b9508e90e634f26a5cc6c Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-03-02Merge "LTP: skip known failures on db410c and qemu"Dan Rue
2018-03-02LTP: skip known failures on db410c and qemuNaresh Kamboju
Change-Id: Id94bfe61eaa85d39ab6e04f0d6ce391bc093baa6 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-03-02LTP: skip fork13 and msgctl10/11 on qemu devices on all branchesNaresh Kamboju
Change-Id: I295e201679e061adfb315c883f71c474ccb10b92 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-03-02LKFT: LTP: skip quotactl01 on db410cDan Rue
Change-Id: Ie00782d764d273bdf95ee207f38a77f053d9849f Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-03-02LTP: skip ltp tests on db410cNaresh Kamboju
Change-Id: I1dc9a68db3d97e71e20d94e418a73e32d10ef6e7 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-02-27LKFT: LTP: Skip quota_remount_test01 on db410cDan Rue
Change-Id: I06a3a20156b88ee7b2ba982e476493d1da6ff435 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-02-27LTP: qemu: update skipfileNaresh Kamboju
Following test cases skipped on qemu runs - readahead02 - gf15 - gf01 - gf14 - quote_remount_test01 Change-Id: Iff4771580b8206d6f90923807ea843ea4b1d1b35 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-02-21LKFT: LTP: Skip gf18 on qemuDan Rue
It uses more space than qemu has. Change-Id: Id5c8f9a6987b566c9a1d1caa2d5376823ffecc6f Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-02-20LKFT: LTP: skip netns_netlink on x15/4.15Dan Rue
Per https://bugs.linaro.org/show_bug.cgi?id=3484 Change-Id: I3db5efad838218def49fa13e08eb4535d3b0a703 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-02-16LKFT: LTP: Skip perf_event_open02 on all boardsDan Rue
Per https://bugs.linaro.org/show_bug.cgi?id=3382, this is a bad test that fails when the system is under load. Change-Id: I25250be554c7a426deacf4f3ce68a13fb9164cf6 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-02-15Revert "LKFT: LTP: Skip fanotify06 due to fuse issue"Dan Rue
This reverts commit 1ff989fa5f94a29756846a8f48b8dd5c1b620706. Test has been fixed in LTP upstream and we are carrying the patch. It is now passing. Change-Id: Iacd3773e31f6bdae41a8ed1a2736e15dc043b56f
2018-02-13LTP: unskip ioctl03 on all devicesNaresh Kamboju
LTP version update to 20180118 has been fixed this issue. Change-Id: I8da8b48363cd8e259796713feb3be88740271191 Signed-off-by: Naresh Kamboju <naresh.kamboju@linaro.org>
2018-02-09LKFT: LTP: Skip fanotify06 due to fuse issueDan Rue
Change-Id: I9b2eafb3b74451c81d1bbfe1693beb60edb19c43 Signed-off-by: Dan Rue <dan.rue@linaro.org>
2018-01-29LTP: Convert LKFT skipfiles to a yaml skipfileDan Rue
skipfile-lkft.yaml encompasses all of the lkft skipfiles in this directory as well as the skipfiles/ directory. They may be removed once build jobs are updated to use a generated skipfile. To generate a skipfile from skipfile-lkft.yaml, use skipgen, which is included in this repository at /bin/<arch>/skipgen. ltp.sh will be expanded to support skipgen separately. The actual contents have been derived from the various skipfiles. In cases of inconsistency, the skip was expanded. For example, netns_breakns_ip_ipv4_ioctl is currently skipped on 4.4 hikey, 4.4 juno, and all branches of x15 and x86. In skipfile-lkft.yaml, it's skipped for all branches on all boards. No other modifications to the skipfiles have been implemented. There are obvious skips that need adjusting, but that will be done subsequently. This review is just a one to one translation of the skipfiles into one yaml skipfile. If you notice things that are wrong or shouldn't be listed anymore - good! That's the point of this effort 😀 Lastly, teach validate.py about skipgen yaml files. Validate them by running skipgen itself against them and verifying that a skiplist of at least 1 skip is produced. Change-Id: Ic46af16d36dfd30ed0876808f916318cddd44fa2 Signed-off-by: Dan Rue <dan.rue@linaro.org>
generated by cgit v1.2.3 (git 2.25.1) at 2024-07-23 13:10:25 +0000