aboutsummaryrefslogtreecommitdiff
path: root/tcwg_bmk.yaml
AgeCommit message (Collapse)Author
2020-01-22tcwg_bmk: Use separate builder labels for tk1 and tx1 benchmarkingMaxim Kuvyrkov
... to give each at least 1 dedicated box. Change-Id: I7699bdfd51a2438a9d1fb8db377495ebc2c72cae
2020-01-20tcwg_bmk: Re-enable periodic triggerMaxim Kuvyrkov
Change-Id: I40f5e37fd6d8df5eac3fa65801ad1f8ff8081a8e
2020-01-17tcwg_bmk, tcwg_gnu, tcwg_kernel: Update release branchesMaxim Kuvyrkov
Binutils to binutils-2_33-branch, LLVM to release/10.x, and Linux to linux-5.4.y . Change-Id: I8c46e2cedd7f8919733a8ac0a304674813326b09
2020-01-15tcwg_bmk: Block dev builds on dev bisectsMaxim Kuvyrkov
Change-Id: I454e87afd1f6ea56f858dcc354c70584ab428997
2020-01-15tcwg_bmk: Fix name of GCC release branchMaxim Kuvyrkov
Change-Id: I3f0e2f4e907a6c7033ef3a14c1fe43e5fd589cfd
2020-01-15tcwg_bmk: Enable master configurationsMaxim Kuvyrkov
Change-Id: I1df043e96f9ecdfc6c3d4628574ff4b3e3ce70ce
2020-01-15tcwg_bmk: CleanupMaxim Kuvyrkov
Change-Id: Ida4eecbce81cc69ea7ab3352f1c4c895b980091b
2020-01-15tcwg_bmk: Delete pre-rename tcwg_bmk-dev jobsMaxim Kuvyrkov
Change-Id: I77c5dd98ba9f3bf14f7aa8a3cc0f0bbfa9cc3feb
2020-01-15tcwg_bmk: Delete pre-rename jobsMaxim Kuvyrkov
Change-Id: I988aa610c0b4ceddc8f81ecf8746db490b1f15f7
2020-01-15tcwg_bmk: Instantiate tcwg_bmk-dev jobsMaxim Kuvyrkov
Change-Id: I74b595a565a8a01b1ac08acbf6b6f07fbc37a73e
2020-01-15tcwg_bmk-*: Split into tcwg_bmk_tk1-* and tcwg_bmk_tx1-*Maxim Kuvyrkov
... to allow scaling the number of benchmarking board types. Right now we are blocking all tcwg_bmk-* jobs when bisecting, which causes TX1 (aarch64) jobs to block on TK1 (armhf) regressions and vice versa. This is bearable now, but with adding SynQuacers (for SPEC CPU2017 benchmarkins) and/or X15 (for armhf) benchmarking we will hit the bottleneck. This also allows benchmarking of AArch32 code on ARMv8 boards. Change-Id: I4fc9444f8c62d11baee14f364740ca36c7600f3d
2020-01-15tcwg_bmk: Add support for passing extra build paramsMaxim Kuvyrkov
... in a generic way. This replaces "benchmarks" parameter. Change-Id: Ie7deff7a28df3862df6a3bf30201a79da008a9f4
2020-01-15tcwg_*: Use github GCC mirror while official repo is slowMaxim Kuvyrkov
Change-Id: Ia99b6e1c84d910a6eb08cdd4be4f3e20e89b0683
2019-12-20tcwg_bmk: Don't escape '{' and '}' in outside of job templatesMaxim Kuvyrkov
Change-Id: I6af3cc2cd8008d090354439e145777bf63ed5dbe
2019-12-18tcwg_bmk: Move replay_log file to a cleaned directoryMaxim Kuvyrkov
Move replay_log to jenkins-scripts, which is cleaned before the build starts. This prevents us from using replay_log from a previous build. Change-Id: Ibcc20d6966a5f45d973dda386b95a450c7a49c2f
2019-12-17tcwg_bmk: Fix nameMaxim Kuvyrkov
Change-Id: Ife280b7e93fa5be31475e2faaccbdc870fdfc810
2019-12-17tcwg_bmk: Add details to build-names of tcwg_bmk-build and tcwg_bmk-bisectMaxim Kuvyrkov
Change-Id: Iaa282dffc950c41c768ba3788132dad159534ee7
2019-12-17tcwg_bmk: Add "benchmarks" parameter to tcwg_bmk-build and tcwg_bmk-bisectMaxim Kuvyrkov
This parameter will be added to the automated CI loops after testing. Change-Id: Icbbc667595521edba4f2671961da87468963ef12
2019-12-13tcwg_bmk: Add tcwg_bmk-dev viewMaxim Kuvyrkov
Change-Id: I2be23e636e4ec794a74c99fe4a6e5819ed778502
2019-12-13tcwg_bmk: Re-enable *-release-* configurations, but without pollscm triggerMaxim Kuvyrkov
... for now. Change-Id: Id7e747166a1134dbb71cc18240b3d7f1592eddb6
2019-12-13tcwg_bmk: Add "replay_log" parameter to bisect jobMaxim Kuvyrkov
Change-Id: Ic5925267329a96a02a92024686b3245782c3acf7
2019-12-10tcwg_bmk: Increase bisect timeout to 2 daysMaxim Kuvyrkov
Assuming 10 steps 3h each we can easily exceed current timeout. Change-Id: I569c410f190689ff12161269e122727ce4fa2ffa
2019-12-09tcwg_bmk: Remove unnecessary build-blockerMaxim Kuvyrkov
Change-Id: Ic99ec051344cea650fc88433728cfe6f719d464e
2019-12-09tcwg_bmk: Disable CI builds while we are testing for regressionsMaxim Kuvyrkov
... in recent toolchain releases with tcwg_bmk-build and tcwg_bmk-bisect jobs. Change-Id: Iaad1b61ffed571f061dd239e63f7d79d78bee568
2019-12-09tcwg_bmk: Add "push" value to update_baseline parameterMaxim Kuvyrkov
Change-Id: If1fd9879dc4be8233740175de3492b94ab54ea9f
2019-12-07tcwg_bmk: Fix character escapeMaxim Kuvyrkov
Change-Id: I9cc1874598a1a82c349fcc840661f357c4454d47
2019-12-06tcwg_bmk: Fix escape quotesMaxim Kuvyrkov
Change-Id: I4698d5e788e2b0abd21e505beb97d79262a8bfd6
2019-12-05tcwg_bmk: Add missing parameter to tcwg_bmk-bisectMaxim Kuvyrkov
Change-Id: Ib1ce3ffccc70daa32b15de101c2d84e10a0a17c2
2019-12-04tcwg_bmk: Use custom ci_project / git namespace for manual buildsMaxim Kuvyrkov
Change-Id: I37cac881783aa8c5840ab45f16e5e5926e8b7d27
2019-12-04tcwg_bmk: Add tcwg_bmk-build and tcwg_bmk-bisect jobsMaxim Kuvyrkov
Change-Id: Ic02b0c8404c99c3be793a964336646844fd005bd
2019-12-04tcwg_bmk: Generalize handling of parametersMaxim Kuvyrkov
... in preparation for tcwg_bmk-build job definition. Change-Id: I9667a1eb7bc6825d2288eafcb9a5f4eb3bb12708
2019-10-25tcwg-*: Use git.linaro.org instead of git-us.linaro.orgChristophe Lyon
We've seen sporadic failures where Jenkins couldn't get git-us.linaro.org's certificate and we switched a subset of our jobs to git.linaro.org instead. There was no such failure since then, so apply the same change to all our jobs, since we just got that problem with tcwg-cleanup-stale-workspaces. Change-Id: Id6452208f93f4a3c3eed90a0b0c02bd9dc0dc0b9
2019-10-14tcwg_bmk: Fix cron patternMaxim Kuvyrkov
Change from every 2 or 3 hours to 2 or 3 days. Change-Id: I6fae9feb54a5b7fb87ed7600239d97a00c4708ff
2019-10-14tcwg_bmk: Attempt to update GCC, Glibc and LLVM once againMaxim Kuvyrkov
Change-Id: I6d44cc5b02cd389ddeb44e5486667eb1aa594560
2019-10-11tcwg_bmk: Fix cron patternMaxim Kuvyrkov
It appears that "H H H/1 * *" means once a month, not every day, as intended. Change-Id: I192489fc4e8537682e0aefbbf54e7090a080b0a0
2019-10-11tcwg_bmk: Speed up resets of baselines for release configurationsMaxim Kuvyrkov
Master configurations are still disabled to give bandwidth to update release branches. Change-Id: Ic4f54a815bb2abdc71b43a327352d50249ff364a
2019-10-10tcwg_bmk: Add gnu configurations: Os-vs-Os_LTO, O2-vs-O2_LTO and O3-vs-O3_LTOMaxim Kuvyrkov
Change-Id: I135b4970cbbbb9af2bc548bf1c84737ea5bcb720
2019-10-08tcwg_bmk: Reset "release" baseline to previous to latest releaseMaxim Kuvyrkov
Change-Id: Ia8ef02e1bce95ba857e051633db4c98ab20f1026
2019-10-08tcwg_bmk: Disable before resetMaxim Kuvyrkov
We have introduced an infrastructure bug in perfdatadir2csv.sh just as we updated release branches for gcc, glibc and llvm, so we got a bunch of failed builds. Disable builds and revert them back to previous release versions. Then cleanup/reset baselines, and do the release update again -- see subsequent commits. Change-Id: I2418ee05d09bbfdf80e8858716ac2163e61a0830
2019-09-22tcwg_bmk: Update release branchesMaxim Kuvyrkov
Change-Id: Ic31dd26d4234dc962029abd65bef1130ee3dc3f0
2019-09-17tcwg_bmk: Disable "master" configuration to reduce system loadMaxim Kuvyrkov
... while we are shaking out instabilities. Change-Id: Ib6855956d28ac5a1507da66d3723d97cffe91d54
2019-09-12tcwg_bmk: Re-enable O2_LTO benchmarkingMaxim Kuvyrkov
Change-Id: I2bbc4d25001a4f96044e0a60b6b557407b35d5ce
2019-08-12tcwg_bmk: While debugging stability, run only -O2 speed benchmarkingMaxim Kuvyrkov
Change-Id: Ie9db55bf05e3ac02d6d94be2c531ce8e52f88edf
2019-08-09tcwg_bmk: Re-enable speed jobsMaxim Kuvyrkov
... now that csvs2table.py outputs symbols with 60s+ runtime. Change-Id: Id9f45fcea6763f3d09cd99f9586441762c150137
2019-07-16tcwg_bmk: Move benchmarking jobs to "old" x86_64 buildersMaxim Kuvyrkov
... since they have been overloading dev-01 lately. Change-Id: I31ad6162cc1b65376be9da6734b3f52d1cb27382
2019-07-16tcwg_bmk: Disable speed configurationsMaxim Kuvyrkov
... until we improve regression heuristics. Change-Id: Idbb7657a915a119ae3cbd1a0418d552238e78d6b
2019-06-27tcwg_bmk: Re-enable trackingMaxim Kuvyrkov
Change-Id: Iccd9f03d95e73a6535d29416d5b77b4c65bde92c
2019-06-18tcwg_bmk: Re-init baselineMaxim Kuvyrkov
Turns out the perf workaround was necessary after all. Change-Id: I8339239bbce16b88212a493a49fb9ce737f4a555
2019-06-17tcwg_bmk: Start regression trackingMaxim Kuvyrkov
Change-Id: Ibd2a988b2201969f05f299bb1081848e466fa33c
2019-06-14tcwg_bmk: Re-init baselinesMaxim Kuvyrkov
Turns out we have been uploading wrong results (from run id "999" instead of "1nnn") for a few weeks. Change-Id: I60fd4d4dfe7c60e52ce2153ecb06cb0b18aefd91