diff options
| author | TCWG BuildSlave <tcwg-buildslave@linaro.org> | 2023-09-02 05:49:37 +0000 |
|---|---|---|
| committer | TCWG BuildSlave <tcwg-buildslave@linaro.org> | 2023-09-02 05:49:38 +0000 |
| commit | 41906b306db0b35c8e5715d79456255cb2fb6f20 (patch) | |
| tree | fbe4b76bb9c9e1f9fe1b72e626e1b9022084162c | |
| parent | 6797d3f609c2f75d8190dd00970ad5fe91362711 (diff) | |
onsuccess: #62: 1: [TCWG CI] https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/62/
Results :
| # reset_artifacts:
| -10
| # build_abe binutils:
| -9
| # build_abe stage1 -- --set gcc_override_configure=--disable-libsanitizer --set gcc_override_configure=--disable-multilib --set gcc_override_configure=--with-cpu=cortex-m4 --set gcc_override_configure=--with-mode=thumb --set gcc_override_configure=--with-float=hard:
| -8
| # build_abe newlib:
| -6
| # build_abe stage2 -- --set gcc_override_configure=--disable-libsanitizer --set gcc_override_configure=--disable-multilib --set gcc_override_configure=--with-cpu=cortex-m4 --set gcc_override_configure=--with-mode=thumb --set gcc_override_configure=--with-float=hard:
| -5
| # benchmark -- -O3_LTO_mthumb:
| 1
check_regression status : 0
51 files changed, 612 insertions, 549 deletions
diff --git a/.gitignore b/.gitignore deleted file mode 100644 index 41b857e..0000000 --- a/.gitignore +++ /dev/null @@ -1 +0,0 @@ -annex/ diff --git a/01-reset_artifacts/console.log.xz b/01-reset_artifacts/console.log.xz Binary files differindex 8bde98b..1d60afe 100644 --- a/01-reset_artifacts/console.log.xz +++ b/01-reset_artifacts/console.log.xz diff --git a/02-prepare_abe/console.log.xz b/02-prepare_abe/console.log.xz Binary files differindex 49d633b..14a75bb 100644 --- a/02-prepare_abe/console.log.xz +++ b/02-prepare_abe/console.log.xz diff --git a/03-build_abe-binutils/console.log.xz b/03-build_abe-binutils/console.log.xz Binary files differindex d46f26a..5582eef 100644 --- a/03-build_abe-binutils/console.log.xz +++ b/03-build_abe-binutils/console.log.xz diff --git a/03-build_abe-binutils/make-binutils.log.xz b/03-build_abe-binutils/make-binutils.log.xz Binary files differindex f466d36..3a394ae 100644 --- a/03-build_abe-binutils/make-binutils.log.xz +++ b/03-build_abe-binutils/make-binutils.log.xz diff --git a/04-build_abe-stage1/console.log.xz b/04-build_abe-stage1/console.log.xz Binary files differindex cf052d9..a8c5a5e 100644 --- a/04-build_abe-stage1/console.log.xz +++ b/04-build_abe-stage1/console.log.xz diff --git a/04-build_abe-stage1/make-gcc-stage1.log.xz b/04-build_abe-stage1/make-gcc-stage1.log.xz Binary files differindex 7523636..e7747e8 100644 --- a/04-build_abe-stage1/make-gcc-stage1.log.xz +++ b/04-build_abe-stage1/make-gcc-stage1.log.xz diff --git a/05-clean_sysroot/console.log.xz b/05-clean_sysroot/console.log.xz Binary files differindex a7de189..f1d9e90 100644 --- a/05-clean_sysroot/console.log.xz +++ b/05-clean_sysroot/console.log.xz diff --git a/06-build_abe-newlib/console.log.xz b/06-build_abe-newlib/console.log.xz Binary files differindex c1646aa..82efa24 100644 --- a/06-build_abe-newlib/console.log.xz +++ b/06-build_abe-newlib/console.log.xz diff --git a/06-build_abe-newlib/make-newlib.log.xz b/06-build_abe-newlib/make-newlib.log.xz Binary files differindex 6a264d4..acf94c0 100644 --- a/06-build_abe-newlib/make-newlib.log.xz +++ b/06-build_abe-newlib/make-newlib.log.xz diff --git a/07-build_abe-stage2/console.log.xz b/07-build_abe-stage2/console.log.xz Binary files differindex a9a33ec..a90c887 100644 --- a/07-build_abe-stage2/console.log.xz +++ b/07-build_abe-stage2/console.log.xz diff --git a/07-build_abe-stage2/make-gcc-stage2.log.xz b/07-build_abe-stage2/make-gcc-stage2.log.xz Binary files differindex 5260611..42d40ad 100644 --- a/07-build_abe-stage2/make-gcc-stage2.log.xz +++ b/07-build_abe-stage2/make-gcc-stage2.log.xz diff --git a/08-benchmark/benchmark-build.log b/08-benchmark/benchmark-build.log index 6ecbdea..ad6f014 100644 --- a/08-benchmark/benchmark-build.log +++ b/08-benchmark/benchmark-build.log @@ -1,20 +1,20 @@ -Started TCWG Benchmark #38907 +Started TCWG Benchmark #40145 Started from command line by tcwg-buildslave@linaro.org Running as SYSTEM [EnvInject] - Loading node environment variables. -Building remotely on tcwg-bmk-bkp-01 (tcwg-bmk-coordinator tcwg-parallel-jobs tcwg) in workspace /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_9 +Building remotely on tcwg-bmk-bkp-01 (tcwg-bmk-coordinator tcwg-parallel-jobs tcwg) in workspace /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_12 [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent -SSH_AUTH_SOCK=/tmp/ssh-XXXXXXqQoJGf/agent.32905 -SSH_AGENT_PID=32907 +SSH_AUTH_SOCK=/tmp/ssh-XXXXXXM6Tahw/agent.37272 +SSH_AGENT_PID=37274 [ssh-agent] Started. Running ssh-add (command line suppressed) -Identity added: /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_9_tmp/private_key_3480759606545028329.key (/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_9_tmp/private_key_3480759606545028329.key) +Identity added: /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_12_tmp/private_key_17483093475528445508.key (/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_12_tmp/private_key_17483093475528445508.key) [ssh-agent] Using credentials tcwg-benchmark (benchmark for TCWG machines) The recommended git tool is: NONE No credentials specified - > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_9/jenkins-scripts/.git # timeout=10 + > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_12/jenkins-scripts/.git # timeout=10 Fetching changes from the remote Git repository > /usr/bin/git config remote.origin.url https://git.linaro.org/toolchain/jenkins-scripts.git # timeout=10 Cleaning workspace @@ -28,14 +28,14 @@ Fetching upstream changes from https://git.linaro.org/toolchain/jenkins-scripts. > git --version # 'git version 2.34.1' > /usr/bin/git fetch --tags --force --progress --prune -- https://git.linaro.org/toolchain/jenkins-scripts.git +refs/heads/*:refs/remotes/origin/* +refs/changes/*:refs/changes/* # timeout=10 > /usr/bin/git rev-parse origin/master^{commit} # timeout=10 -Checking out Revision 2ec1a6363957f53f2082af20db78979f82b9ee42 (origin/master) +Checking out Revision fd1841679e5130ca495be5e830d34b267022ebc4 (origin/master) > /usr/bin/git config core.sparsecheckout # timeout=10 - > /usr/bin/git checkout -f 2ec1a6363957f53f2082af20db78979f82b9ee42 # timeout=10 -Commit message: "tcwg_bmk-build.sh: Use all history to compute sample variability" - > /usr/bin/git rev-list --no-walk 2ec1a6363957f53f2082af20db78979f82b9ee42 # timeout=10 + > /usr/bin/git checkout -f fd1841679e5130ca495be5e830d34b267022ebc4 # timeout=10 +Commit message: "round-robin-notify.sh (update_jira_card): Fix handling of summary with ": "" + > /usr/bin/git rev-list --no-walk fd1841679e5130ca495be5e830d34b267022ebc4 # timeout=10 The recommended git tool is: NONE No credentials specified - > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_9/bmk-scripts/.git # timeout=10 + > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_12/bmk-scripts/.git # timeout=10 Fetching changes from the remote Git repository > /usr/bin/git config remote.origin.url https://git.linaro.org/toolchain/bmk-scripts.git # timeout=10 Cleaning workspace @@ -49,30 +49,30 @@ Fetching upstream changes from https://git.linaro.org/toolchain/bmk-scripts.git > git --version # 'git version 2.34.1' > /usr/bin/git fetch --tags --force --progress --prune -- https://git.linaro.org/toolchain/bmk-scripts.git +refs/heads/*:refs/remotes/origin/* +refs/changes/*:refs/changes/* # timeout=10 > /usr/bin/git rev-parse origin/master^{commit} # timeout=10 -Checking out Revision edac536d4e7314bc435306bc12967c10bf8fbcd3 (origin/master) +Checking out Revision a91db271ffdc7b9b2f4f7b4c3fcbef96aaa5549d (origin/master) > /usr/bin/git config core.sparsecheckout # timeout=10 - > /usr/bin/git checkout -f edac536d4e7314bc435306bc12967c10bf8fbcd3 # timeout=10 -Commit message: "samples-variability.py: Now compute average and sigmas with weighted inputs" - > /usr/bin/git rev-list --no-walk edac536d4e7314bc435306bc12967c10bf8fbcd3 # timeout=10 + > /usr/bin/git checkout -f a91db271ffdc7b9b2f4f7b4c3fcbef96aaa5549d # timeout=10 +Commit message: "output-bmk-results.py: debug traces more readable" + > /usr/bin/git rev-list --no-walk a91db271ffdc7b9b2f4f7b4c3fcbef96aaa5549d # timeout=10 No emails were triggered. -New run name is '#38907-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64)' -[tcwg-benchmark-tcwg-bmk-bkp-01_9] $ /bin/bash /tmp/jenkins6265773920604423556.sh +New run name is '#40145-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64)' +[tcwg-benchmark-tcwg-bmk-bkp-01_12] $ /bin/bash /tmp/jenkins11665292433464621159.sh + rm -rf artifacts + mkdir -p artifacts/jenkins + has_perf_logs=yes + case "$bmk_hw:$image_arch" in + hw_tag=stm32 + has_perf_logs=no -++ echo build-02.tcwglab:51077:/tmp/tmp.jtGE7KJSZ2 -++ sed -e s/@build_num@/38907/g -e s/@hw_tag@/stm32/g -+ results_dest=build-02.tcwglab:51077:/tmp/tmp.jtGE7KJSZ2 +++ echo build-05.tcwglab:51655:/tmp/tmp.cWy4jNG7Eq +++ sed -e s/@build_num@/40145/g -e s/@hw_tag@/stm32/g ++ results_dest=build-05.tcwglab:51655:/tmp/tmp.cWy4jNG7Eq + idle_boards=0 + total_boards=0 ++ set +f ++ ls -tr /home/tcwg-benchmark/boards/tcwg-bmk-stm32-01.lock + for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock) + res=0 -+ wait 33025 ++ wait 37391 + flock -en -E 124 9 + total_boards=1 + '[' 0 = 124 ']' @@ -87,20 +87,20 @@ New run name is '#38907-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_ + read -a bmks + cat Waiting for the completion of TCWG Benchmark_backend -TCWG Benchmark_backend #135762 started. -TCWG Benchmark_backend #135762-38907+1-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64) completed. Result was SUCCESS -New run name is '#38907-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64)' +TCWG Benchmark_backend #137941 started. +TCWG Benchmark_backend #137941-40145+1-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64) completed. Result was SUCCESS +New run name is '#40145-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64)' $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; -echo Agent pid 32907 killed; +echo Agent pid 37274 killed; [ssh-agent] Stopped. Archiving artifacts Email was triggered for: Success Sending email for trigger: Success -#38906-tcwg_bmk-fujitsu_speed-cpu2017speed/llvm-aarch64-master-O3-bisect (fx:arm64) is still in progress; ignoring for purposes of comparison +#40144-tcwg_bmk-code_size-spec2k6/gnu-aarch64-master-O3-build (sq:arm64) is still in progress; ignoring for purposes of comparison Failed to create e-mail address for ERROR:,File,'artifacts/jenkins/mail-recipients.txt',does,not,exist -#38906-tcwg_bmk-fujitsu_speed-cpu2017speed/llvm-aarch64-master-O3-bisect (fx:arm64) is still in progress; ignoring for purposes of comparison +#40144-tcwg_bmk-code_size-spec2k6/gnu-aarch64-master-O3-build (sq:arm64) is still in progress; ignoring for purposes of comparison An attempt to send an e-mail to empty list of recipients, ignored. Finished: SUCCESS -Completed TCWG Benchmark #38907-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64) : SUCCESS +Completed TCWG Benchmark #40145-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64) : SUCCESS diff --git a/08-benchmark/benchmark.log b/08-benchmark/benchmark.log deleted file mode 100644 index d36d362..0000000 --- a/08-benchmark/benchmark.log +++ /dev/null @@ -1,105 +0,0 @@ -Started TCWG Benchmark #38907 -Started from command line by tcwg-buildslave@linaro.org -Running as SYSTEM -[EnvInject] - Loading node environment variables. -Building remotely on tcwg-bmk-bkp-01 (tcwg-bmk-coordinator tcwg-parallel-jobs tcwg) in workspace /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_9 -[ssh-agent] Looking for ssh-agent implementation... -[ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) -$ ssh-agent -SSH_AUTH_SOCK=/tmp/ssh-XXXXXXqQoJGf/agent.32905 -SSH_AGENT_PID=32907 -[ssh-agent] Started. -Running ssh-add (command line suppressed) -Identity added: /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_9_tmp/private_key_3480759606545028329.key (/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_9_tmp/private_key_3480759606545028329.key) -[ssh-agent] Using credentials tcwg-benchmark (benchmark for TCWG machines) -The recommended git tool is: NONE -No credentials specified - > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_9/jenkins-scripts/.git # timeout=10 -Fetching changes from the remote Git repository - > /usr/bin/git config remote.origin.url https://git.linaro.org/toolchain/jenkins-scripts.git # timeout=10 -Cleaning workspace - > /usr/bin/git rev-parse --verify HEAD # timeout=10 -Resetting working tree - > /usr/bin/git reset --hard # timeout=10 - > /usr/bin/git clean -fdx # timeout=10 -Pruning obsolete local branches -Fetching upstream changes from https://git.linaro.org/toolchain/jenkins-scripts.git - > /usr/bin/git --version # timeout=10 - > git --version # 'git version 2.34.1' - > /usr/bin/git fetch --tags --force --progress --prune -- https://git.linaro.org/toolchain/jenkins-scripts.git +refs/heads/*:refs/remotes/origin/* +refs/changes/*:refs/changes/* # timeout=10 - > /usr/bin/git rev-parse origin/master^{commit} # timeout=10 -Checking out Revision 2ec1a6363957f53f2082af20db78979f82b9ee42 (origin/master) - > /usr/bin/git config core.sparsecheckout # timeout=10 - > /usr/bin/git checkout -f 2ec1a6363957f53f2082af20db78979f82b9ee42 # timeout=10 -Commit message: "tcwg_bmk-build.sh: Use all history to compute sample variability" - > /usr/bin/git rev-list --no-walk 2ec1a6363957f53f2082af20db78979f82b9ee42 # timeout=10 -The recommended git tool is: NONE -No credentials specified - > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_9/bmk-scripts/.git # timeout=10 -Fetching changes from the remote Git repository - > /usr/bin/git config remote.origin.url https://git.linaro.org/toolchain/bmk-scripts.git # timeout=10 -Cleaning workspace - > /usr/bin/git rev-parse --verify HEAD # timeout=10 -Resetting working tree - > /usr/bin/git reset --hard # timeout=10 - > /usr/bin/git clean -fdx # timeout=10 -Pruning obsolete local branches -Fetching upstream changes from https://git.linaro.org/toolchain/bmk-scripts.git - > /usr/bin/git --version # timeout=10 - > git --version # 'git version 2.34.1' - > /usr/bin/git fetch --tags --force --progress --prune -- https://git.linaro.org/toolchain/bmk-scripts.git +refs/heads/*:refs/remotes/origin/* +refs/changes/*:refs/changes/* # timeout=10 - > /usr/bin/git rev-parse origin/master^{commit} # timeout=10 -Checking out Revision edac536d4e7314bc435306bc12967c10bf8fbcd3 (origin/master) - > /usr/bin/git config core.sparsecheckout # timeout=10 - > /usr/bin/git checkout -f edac536d4e7314bc435306bc12967c10bf8fbcd3 # timeout=10 -Commit message: "samples-variability.py: Now compute average and sigmas with weighted inputs" - > /usr/bin/git rev-list --no-walk edac536d4e7314bc435306bc12967c10bf8fbcd3 # timeout=10 -No emails were triggered. -New run name is '#38907-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64)' -[tcwg-benchmark-tcwg-bmk-bkp-01_9] $ /bin/bash /tmp/jenkins6265773920604423556.sh -+ rm -rf artifacts -+ mkdir -p artifacts/jenkins -+ has_perf_logs=yes -+ case "$bmk_hw:$image_arch" in -+ hw_tag=stm32 -+ has_perf_logs=no -++ echo build-02.tcwglab:51077:/tmp/tmp.jtGE7KJSZ2 -++ sed -e s/@build_num@/38907/g -e s/@hw_tag@/stm32/g -+ results_dest=build-02.tcwglab:51077:/tmp/tmp.jtGE7KJSZ2 -+ idle_boards=0 -+ total_boards=0 -++ set +f -++ ls -tr /home/tcwg-benchmark/boards/tcwg-bmk-stm32-01.lock -+ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock) -+ res=0 -+ wait 33025 -+ flock -en -E 124 9 -+ total_boards=1 -+ '[' 0 = 124 ']' -+ idle_boards=1 -+ n_boards=1 -+ '[' 1 -lt 1 ']' -+ count=1 -+ read -a bmks -++ ./bmk-scripts/break-up-bmks.sh --bench_list coremark --bmk_hw stm32 --n_boards 1 --run_profile parallel --board_selection balance -+ cat -+ count=2 -+ read -a bmks -+ cat -Waiting for the completion of TCWG Benchmark_backend -TCWG Benchmark_backend #135762 started. -TCWG Benchmark_backend #135762-38907+1-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64) completed. Result was SUCCESS -New run name is '#38907-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64)' -$ ssh-agent -k -unset SSH_AUTH_SOCK; -unset SSH_AGENT_PID; -echo Agent pid 32907 killed; -[ssh-agent] Stopped. -Archiving artifacts -Email was triggered for: Success -Sending email for trigger: Success -#38906-tcwg_bmk-fujitsu_speed-cpu2017speed/llvm-aarch64-master-O3-bisect (fx:arm64) is still in progress; ignoring for purposes of comparison -Failed to create e-mail address for ERROR:,File,'artifacts/jenkins/mail-recipients.txt',does,not,exist -#38906-tcwg_bmk-fujitsu_speed-cpu2017speed/llvm-aarch64-master-O3-bisect (fx:arm64) is still in progress; ignoring for purposes of comparison -An attempt to send an e-mail to empty list of recipients, ignored. -Finished: SUCCESS diff --git a/08-benchmark/console.log.xz b/08-benchmark/console.log.xz Binary files differindex 8b6440e..3c533f1 100644 --- a/08-benchmark/console.log.xz +++ b/08-benchmark/console.log.xz diff --git a/09-check_regression/bmk-specific-variability.csv b/09-check_regression/bmk-specific-variability.csv deleted file mode 100644 index a9e0080..0000000 --- a/09-check_regression/bmk-specific-variability.csv +++ /dev/null @@ -1 +0,0 @@ -benchmark,symbol,average,sigmas,3-sigmas-percentage diff --git a/09-check_regression/console.log.xz b/09-check_regression/console.log.xz Binary files differindex 859334e..589e36f 100644 --- a/09-check_regression/console.log.xz +++ b/09-check_regression/console.log.xz diff --git a/09-check_regression/output-bmk-results.log b/09-check_regression/output-bmk-results.log index 66ec788..3f99de7 100644 --- a/09-check_regression/output-bmk-results.log +++ b/09-check_regression/output-bmk-results.log @@ -1,2 +1,2 @@ -DEBUG: coremark,coremark : checking symbol.regression size=0% (threshold=10%) -DEBUG: coremark,coremark : checking symbol.improvement size=0% (threshold=10%) +DEBUG: checking symbol.regression : coremark,coremark : size=0% (threshold=10%) +DEBUG: checking symbol.improvement : coremark,coremark : size=0% (threshold=10%) diff --git a/annex/bmk-data b/annex/bmk-data new file mode 100644 index 0000000..3b52e09 --- /dev/null +++ b/annex/bmk-data @@ -0,0 +1 @@ +bkp-01.tcwglab:/home/tcwg-buildslave/base-artifacts/annex/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO/62-8630474f1b6b3ba0aa65814aa20cf096.tar.xz diff --git a/git/binutils_rev b/git/binutils_rev index c81aeb6..09e5056 100644 --- a/git/binutils_rev +++ b/git/binutils_rev @@ -1 +1 @@ -6feae66da1d652a50c1759bae46128087f7dfab0 +41770089162edd23ea7ae33b7952585316accde5 diff --git a/git/gcc_rev b/git/gcc_rev index d9ad9db..a4dcb05 100644 --- a/git/gcc_rev +++ b/git/gcc_rev @@ -1 +1 @@ -17d670dbca16d8ccb502c5d82c67981b1ba937af +4e2d53c943400e8b5d49a7d5aab4a1ad046aefba diff --git a/git/newlib_rev b/git/newlib_rev index 8e342c9..f92f972 100644 --- a/git/newlib_rev +++ b/git/newlib_rev @@ -1 +1 @@ -65d34484e9097fd9036dd577028423355cb5f5bc +c4aa56bbf26f297d4faf1bae80822c0d820a5d44 diff --git a/jenkins/build-name b/jenkins/build-name index c186de9..1109271 100644 --- a/jenkins/build-name +++ b/jenkins/build-name @@ -1 +1 @@ -#55-binutils-gcc-newlib-R1 +#62-binutils-gcc-newlib-R1 diff --git a/jenkins/notify-full.log b/jenkins/notify-full.log index 01d2e4f..2f523cf 100644 --- a/jenkins/notify-full.log +++ b/jenkins/notify-full.log @@ -1,27 +1,27 @@ ++ pwd ++ cat -+ remote_exec 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' ./jenkins-scripts/round-robin-notify.sh '@@rr[top_artifacts]' artifacts __TCWG_JIRA_TOKEN ijQW9spm0p7HwZnUtLFx7CCA __stage full __verbose true ++ remote_exec 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ./jenkins-scripts/round-robin-notify.sh '@@rr[top_artifacts]' artifacts __TCWG_JIRA_TOKEN ijQW9spm0p7HwZnUtLFx7CCA __stage full __verbose true + set -euf -o pipefail + local host -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -d: -f 1 -+ host=build-02.tcwglab ++ host=build-05.tcwglab + local port -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 2 + port= + local dir -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 3 -+ dir=/home/tcwg-buildslave/workspace/tcwg_bmk_1 ++ dir=/home/tcwg-buildslave/workspace/tcwg_bmk_0 + local opts -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 4 -+ opts=-p51077 ++ opts=-p51655 + local env_vars -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 5 -+ env_vars='ssh_host=build-02.tcwglab ssh_port=51077' ++ env_vars='ssh_host=build-05.tcwglab ssh_port=51655' + shift + local -a cmd + cmd=() @@ -52,10 +52,10 @@ + for i in "$@" + cmd+=("$(printf '%q' "$i")") ++ printf %q true -++ printf %q /home/tcwg-buildslave/workspace/tcwg_bmk_1 -+ ssh -p51077 build-02.tcwglab 'export ssh_host=build-02.tcwglab ssh_port=51077 && cd /home/tcwg-buildslave/workspace/tcwg_bmk_1 && exec ./jenkins-scripts/round-robin-notify.sh @@rr\[top_artifacts\] artifacts __TCWG_JIRA_TOKEN ijQW9spm0p7HwZnUtLFx7CCA __stage full __verbose true' +++ printf %q /home/tcwg-buildslave/workspace/tcwg_bmk_0 ++ ssh -p51655 build-05.tcwglab 'export ssh_host=build-05.tcwglab ssh_port=51655 && cd /home/tcwg-buildslave/workspace/tcwg_bmk_0 && exec ./jenkins-scripts/round-robin-notify.sh @@rr\[top_artifacts\] artifacts __TCWG_JIRA_TOKEN ijQW9spm0p7HwZnUtLFx7CCA __stage full __verbose true' -/home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/round-robin-notify.sh @@rr[top_artifacts] artifacts __TCWG_JIRA_TOKEN ijQW9spm0p7HwZnUtLFx7CCA __stage full __verbose true +/home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/round-robin-notify.sh @@rr[top_artifacts] artifacts __TCWG_JIRA_TOKEN ijQW9spm0p7HwZnUtLFx7CCA __stage full __verbose true + false + dryrun= @@ -71,33 +71,35 @@ ++ get_current_manifest '{rr[ci_project]}' ++ get_manifest artifacts/manifest.sh '{rr[ci_project]}' ++ set +x -# Debug traces : + ci_project=tcwg_bmk-code_size-coremark ++ get_current_manifest '{rr[ci_config]}' ++ get_manifest artifacts/manifest.sh '{rr[ci_config]}' ++ set +x +# Debug traces : + ci_config=gnu_eabi-arm_eabi-master-O3_LTO + echo '# Debug traces :' ++ get_baseline_manifest BUILD_URL ++ get_manifest base-artifacts/manifest.sh BUILD_URL false ++ set +x -# Baseline : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/53/ +# Baseline : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/ # Using dir : base-artifacts -+ echo '# Baseline : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/53/' ++ echo '# Baseline : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/' + echo '# Using dir : base-artifacts' ++ get_current_manifest BUILD_URL ++ get_manifest artifacts/manifest.sh BUILD_URL ++ set +x -# Artifacts : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/ +# Artifacts : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/62/ # Using dir : artifacts -+ echo '# Artifacts : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/' ++ echo '# Artifacts : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/62/' + echo '# Using dir : artifacts' + echo '' + mkdir -p artifacts/notify + '[' -f /home/tcwg-buildslave/.jipdate.yml ']' + set +x # check_source_changes ++ declare -Ag pw ++ '[' ignore = precommit ']' + check_source_changes + echo '# check_source_changes' ++ get_current_manifest '{rr[update_baseline]}' @@ -137,7 +139,7 @@ +++ assert_with_msg 'ERROR: No binutils_rev in baseline git' '[' -f base-artifacts/git/binutils_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/binutils_rev -++ '[' x6feae66da1d652a50c1759bae46128087f7dfab0 '!=' x3b23a5ea693deee60648c9a9e9d666d83549298e ']' +++ '[' x41770089162edd23ea7ae33b7952585316accde5 '!=' x6feae66da1d652a50c1759bae46128087f7dfab0 ']' ++ echo -ne binutils ++ delim=' ' ++ for c in $(print_updated_components) @@ -152,7 +154,7 @@ +++ assert_with_msg 'ERROR: No gcc_rev in baseline git' '[' -f base-artifacts/git/gcc_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/gcc_rev -++ '[' x17d670dbca16d8ccb502c5d82c67981b1ba937af '!=' x68783211f660a501dee203aec11dae99bf9808ba ']' +++ '[' x4e2d53c943400e8b5d49a7d5aab4a1ad046aefba '!=' x17d670dbca16d8ccb502c5d82c67981b1ba937af ']' ++ echo -ne ' gcc' ++ delim=' ' ++ for c in $(print_updated_components) @@ -167,17 +169,17 @@ +++ assert_with_msg 'ERROR: No newlib_rev in baseline git' '[' -f base-artifacts/git/newlib_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/newlib_rev -++ '[' x65d34484e9097fd9036dd577028423355cb5f5bc '!=' x1a646ad7970a2cd3a1c931af4217cc17fc576116 ']' +++ '[' xc4aa56bbf26f297d4faf1bae80822c0d820a5d44 '!=' x65d34484e9097fd9036dd577028423355cb5f5bc ']' ++ echo -ne ' newlib' ++ delim=' ' ++ echo +# Debug traces : +# change_kind=multiple_components : binutils gcc newlib + local c base_rev cur_rev c_commits + '[' 3 = 0 ']' + '[' 3 = 1 ']' + change_kind=multiple_components + changed_single_component= -# Debug traces : -# change_kind=multiple_components : binutils gcc newlib + echo '# Debug traces :' + echo '# change_kind=multiple_components : binutils gcc newlib' + for c in "${changed_components[@]}" @@ -187,17 +189,17 @@ ++ assert_with_msg 'ERROR: No binutils_rev in baseline git' '[' -f base-artifacts/git/binutils_rev ']' ++ set -euf -o pipefail +x ++ cat base-artifacts/git/binutils_rev -+ base_rev=3b23a5ea693deee60648c9a9e9d666d83549298e ++ base_rev=6feae66da1d652a50c1759bae46128087f7dfab0 ++ get_current_git binutils_rev ++ set -euf -o pipefail ++ assert_with_msg 'ERROR: No binutils_rev in current git' '[' -f artifacts/git/binutils_rev ']' ++ set -euf -o pipefail +x ++ cat artifacts/git/binutils_rev -+ cur_rev=6feae66da1d652a50c1759bae46128087f7dfab0 -++ git -C binutils rev-list --count 3b23a5ea693deee60648c9a9e9d666d83549298e..6feae66da1d652a50c1759bae46128087f7dfab0 -# rev for binutils : 3b23a5ea693deee60648c9a9e9d666d83549298e..6feae66da1d652a50c1759bae46128087f7dfab0 (46 commits) -+ c_commits=46 -+ echo '# rev for binutils : 3b23a5ea693deee60648c9a9e9d666d83549298e..6feae66da1d652a50c1759bae46128087f7dfab0 (46 commits)' ++ cur_rev=41770089162edd23ea7ae33b7952585316accde5 +++ git -C binutils rev-list --count 6feae66da1d652a50c1759bae46128087f7dfab0..41770089162edd23ea7ae33b7952585316accde5 +# rev for binutils : 6feae66da1d652a50c1759bae46128087f7dfab0..41770089162edd23ea7ae33b7952585316accde5 (214 commits) ++ c_commits=214 ++ echo '# rev for binutils : 6feae66da1d652a50c1759bae46128087f7dfab0..41770089162edd23ea7ae33b7952585316accde5 (214 commits)' + for c in "${changed_components[@]}" ++ get_baseline_git gcc_rev ++ set -euf -o pipefail @@ -205,17 +207,17 @@ ++ assert_with_msg 'ERROR: No gcc_rev in baseline git' '[' -f base-artifacts/git/gcc_rev ']' ++ set -euf -o pipefail +x ++ cat base-artifacts/git/gcc_rev -+ base_rev=68783211f660a501dee203aec11dae99bf9808ba ++ base_rev=17d670dbca16d8ccb502c5d82c67981b1ba937af ++ get_current_git gcc_rev ++ set -euf -o pipefail ++ assert_with_msg 'ERROR: No gcc_rev in current git' '[' -f artifacts/git/gcc_rev ']' ++ set -euf -o pipefail +x ++ cat artifacts/git/gcc_rev -+ cur_rev=17d670dbca16d8ccb502c5d82c67981b1ba937af -++ git -C gcc rev-list --count 68783211f660a501dee203aec11dae99bf9808ba..17d670dbca16d8ccb502c5d82c67981b1ba937af -# rev for gcc : 68783211f660a501dee203aec11dae99bf9808ba..17d670dbca16d8ccb502c5d82c67981b1ba937af (141 commits) -+ c_commits=141 -+ echo '# rev for gcc : 68783211f660a501dee203aec11dae99bf9808ba..17d670dbca16d8ccb502c5d82c67981b1ba937af (141 commits)' ++ cur_rev=4e2d53c943400e8b5d49a7d5aab4a1ad046aefba +++ git -C gcc rev-list --count 17d670dbca16d8ccb502c5d82c67981b1ba937af..4e2d53c943400e8b5d49a7d5aab4a1ad046aefba +# rev for gcc : 17d670dbca16d8ccb502c5d82c67981b1ba937af..4e2d53c943400e8b5d49a7d5aab4a1ad046aefba (355 commits) ++ c_commits=355 ++ echo '# rev for gcc : 17d670dbca16d8ccb502c5d82c67981b1ba937af..4e2d53c943400e8b5d49a7d5aab4a1ad046aefba (355 commits)' + for c in "${changed_components[@]}" ++ get_baseline_git newlib_rev ++ set -euf -o pipefail @@ -223,19 +225,18 @@ ++ assert_with_msg 'ERROR: No newlib_rev in baseline git' '[' -f base-artifacts/git/newlib_rev ']' ++ set -euf -o pipefail +x ++ cat base-artifacts/git/newlib_rev -+ base_rev=1a646ad7970a2cd3a1c931af4217cc17fc576116 ++ base_rev=65d34484e9097fd9036dd577028423355cb5f5bc ++ get_current_git newlib_rev ++ set -euf -o pipefail ++ assert_with_msg 'ERROR: No newlib_rev in current git' '[' -f artifacts/git/newlib_rev ']' ++ set -euf -o pipefail +x ++ cat artifacts/git/newlib_rev -+ cur_rev=65d34484e9097fd9036dd577028423355cb5f5bc -# rev for newlib : 1a646ad7970a2cd3a1c931af4217cc17fc576116..65d34484e9097fd9036dd577028423355cb5f5bc (4 commits) ++ cur_rev=c4aa56bbf26f297d4faf1bae80822c0d820a5d44 +++ git -C newlib rev-list --count 65d34484e9097fd9036dd577028423355cb5f5bc..c4aa56bbf26f297d4faf1bae80822c0d820a5d44 +# rev for newlib : 65d34484e9097fd9036dd577028423355cb5f5bc..c4aa56bbf26f297d4faf1bae80822c0d820a5d44 (19 commits) -# generate_extra_details -++ git -C newlib rev-list --count 1a646ad7970a2cd3a1c931af4217cc17fc576116..65d34484e9097fd9036dd577028423355cb5f5bc -+ c_commits=4 -+ echo '# rev for newlib : 1a646ad7970a2cd3a1c931af4217cc17fc576116..65d34484e9097fd9036dd577028423355cb5f5bc (4 commits)' ++ c_commits=19 ++ echo '# rev for newlib : 65d34484e9097fd9036dd577028423355cb5f5bc..c4aa56bbf26f297d4faf1bae80822c0d820a5d44 (19 commits)' + echo '' + setup_stages_to_run + '[' ignore = onregression ']' @@ -252,46 +253,50 @@ + print_result_f=print_result + print_config_f=print_config + print_last_icommit_f=print_last_icommit ++ generate_extra_details_f=generate_extra_details + case "$ci_project" in + print_result_f=bmk_print_result + print_config_f=bmk_print_config -+ generate_extra_details -+ set -euf -o pipefail -+ echo '# generate_extra_details' -# post_interesting_commits -# post_interesting_commits -# print all notification files ++ generate_extra_details_f=bmk_generate_extra_details + post_interesting_commits init +# post_interesting_commits + set -euf -o pipefail + echo '# post_interesting_commits' + local stage=init + '[' multiple_components '!=' single_commit ']' + return + '[' full '!=' full ']' ++ bmk_generate_extra_details ++ set -euf -o pipefail ++ local artifacts_mail_dir metric_id ++ artifacts_mail_dir=artifacts/notify ++ case "$ci_project" in ++ metric_id=size ++ wait 30787 ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/output-bmk-results.py artifacts/results-vs-prev/compare-results-internal.csv artifacts/results-vs-prev/bmk-specific-variability.csv artifacts/notify/ size build verbose + check_if_first_report + declare -g first_icommit_to_report + first_icommit_to_report=false + '[' xmultiple_components '!=' xsingle_commit ']' + return + post_interesting_commits full +# post_interesting_commits + set -euf -o pipefail + echo '# post_interesting_commits' + local stage=full + '[' multiple_components '!=' single_commit ']' + return -+ echo '# print all notification files' -+ print_mail_recipients -+ false -+ return + true + generate_jira_dir + set -euf -o pipefail + local icommit_entry jira_key= ++ print_last_icommit --entry ++ false +++ set -euf -o pipefail ++ local print_arg=--entry +++ shift 1 ++ '[' xmultiple_components '!=' xsingle_commit ']' -++ return +++ return 0 + icommit_entry= + '[' '' '!=' '' ']' + mkdir -p artifacts/notify/jira @@ -303,9 +308,11 @@ ++ jira_card=GNU-689 ++ echo GNU-689 ++ bmk_print_result --oneline +++ set -euf -o pipefail ++ false ++ local print_arg=--oneline ++ artifacts_mail_dir=artifacts/notify +++ '[' full '!=' full ']' ++ case "$ci_project" in ++ metric_id=size ++ local improved_or_regressed @@ -336,53 +343,94 @@ ++ get_current_manifest BUILD_URL ++ get_manifest artifacts/manifest.sh BUILD_URL ++ set +x -+ bmk_print_result --oneline -+ false -+ local print_arg=--oneline -+ artifacts_mail_dir=artifacts/notify -+ case "$ci_project" in -+ metric_id=size -+ local improved_or_regressed -+ '[' -f artifacts/notify/exe.regression ']' -+ '[' -f artifacts/notify/symbol.regression ']' -+ improved_or_regressed=improvement -+ declare -A changed_by_msg -+ changed_by_msg[size-regression]='grew in size by' -+ changed_by_msg[size-improvement]='reduced in size by' -+ changed_by_msg[time-regression]='slowed down by' -+ changed_by_msg[time-improvement]='speeds up by' -+ changed_by_msg[vect-regression]='reduced by' -+ changed_by_msg[vect-improvement]='increased up by' -+ changed_by_msg[sve-regression]='reduced by' -+ changed_by_msg[sve-improvement]='increased up by' -+ changed_by='reduced in size by' -+ case $metric_id in -+ exe_threshold=1 -+ symbol_threshold=10 -+ case "$print_arg" in -+ assert_with_msg 'Builds with infra problems should never get here' '[' 0 '!=' 125 ']' -+ set -euf -o pipefail +x -+ local metric bmk symbol short_diag long_diag -+ '[' -f artifacts/notify/exe.improvement ']' -+ '[' -f artifacts/notify/symbol.improvement ']' -+ short_diag='No change' -+ echo 'No change' -+ print_mail_body +# print all notification files ++ echo '# print all notification files' + true -+ local bad_artifacts_url good_artifacts_url -++ get_current_manifest BUILD_URL -++ get_manifest artifacts/manifest.sh BUILD_URL -++ set +x -+ bad_artifacts_url=https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/artifact/artifacts -++ get_baseline_manifest BUILD_URL -++ get_manifest base-artifacts/manifest.sh BUILD_URL false -++ set +x -+ good_artifacts_url=https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/53/artifact/artifacts -+ cat ++ generate_mail_files ++ set -euf -o pipefail ++ print_mail_recipients ++ set -euf -o pipefail ++ local c= ++ '[' '' = '' ']' ++ echo bcc:tcwg-validation@linaro.org ++ return 0 +++ print_commits --oneline +++ set -euf -o pipefail +++ false +++ local print_arg=--oneline +++ '[' multiple_components = no_change ']' +++ local more_lines +++ '[' multiple_components = single_commit ']' +++ '[' multiple_components = single_component ']' +++ '[' multiple_components = multiple_components ']' +++ local new_commits c base_rev cur_rev c_commits components +++ local commits_or_patches +++ '[' '' '!=' '' ']' +++ commits_or_patches=commits +++ new_commits=0 +++ for c in "${changed_components[@]}" ++++ get_baseline_git binutils_rev ++++ set -euf -o pipefail ++++ local base_artifacts=base-artifacts ++++ assert_with_msg 'ERROR: No binutils_rev in baseline git' '[' -f base-artifacts/git/binutils_rev ']' ++++ set -euf -o pipefail +x ++++ cat base-artifacts/git/binutils_rev +++ base_rev=6feae66da1d652a50c1759bae46128087f7dfab0 ++++ get_current_git binutils_rev ++++ set -euf -o pipefail ++++ assert_with_msg 'ERROR: No binutils_rev in current git' '[' -f artifacts/git/binutils_rev ']' ++++ set -euf -o pipefail +x ++++ cat artifacts/git/binutils_rev +++ cur_rev=41770089162edd23ea7ae33b7952585316accde5 ++++ git -C binutils rev-list --count 6feae66da1d652a50c1759bae46128087f7dfab0..41770089162edd23ea7ae33b7952585316accde5 +++ c_commits=214 +++ new_commits=214 +++ for c in "${changed_components[@]}" ++++ get_baseline_git gcc_rev ++++ set -euf -o pipefail ++++ local base_artifacts=base-artifacts ++++ assert_with_msg 'ERROR: No gcc_rev in baseline git' '[' -f base-artifacts/git/gcc_rev ']' ++++ set -euf -o pipefail +x ++++ cat base-artifacts/git/gcc_rev +++ base_rev=17d670dbca16d8ccb502c5d82c67981b1ba937af ++++ get_current_git gcc_rev ++++ set -euf -o pipefail ++++ assert_with_msg 'ERROR: No gcc_rev in current git' '[' -f artifacts/git/gcc_rev ']' ++++ set -euf -o pipefail +x ++++ cat artifacts/git/gcc_rev +++ cur_rev=4e2d53c943400e8b5d49a7d5aab4a1ad046aefba ++++ git -C gcc rev-list --count 17d670dbca16d8ccb502c5d82c67981b1ba937af..4e2d53c943400e8b5d49a7d5aab4a1ad046aefba +++ c_commits=355 +++ new_commits=569 +++ for c in "${changed_components[@]}" ++++ get_baseline_git newlib_rev ++++ set -euf -o pipefail ++++ local base_artifacts=base-artifacts ++++ assert_with_msg 'ERROR: No newlib_rev in baseline git' '[' -f base-artifacts/git/newlib_rev ']' ++++ set -euf -o pipefail +x ++++ cat base-artifacts/git/newlib_rev +++ base_rev=65d34484e9097fd9036dd577028423355cb5f5bc ++++ get_current_git newlib_rev ++++ set -euf -o pipefail ++++ assert_with_msg 'ERROR: No newlib_rev in current git' '[' -f artifacts/git/newlib_rev ']' ++++ set -euf -o pipefail +x ++++ cat artifacts/git/newlib_rev +++ cur_rev=c4aa56bbf26f297d4faf1bae80822c0d820a5d44 ++++ git -C newlib rev-list --count 65d34484e9097fd9036dd577028423355cb5f5bc..c4aa56bbf26f297d4faf1bae80822c0d820a5d44 +++ c_commits=19 +++ new_commits=588 ++++ echo binutils gcc newlib ++++ tr ' ' , +++ components=binutils,gcc,newlib +++ echo '588 commits in binutils,gcc,newlib' +++ '[' --oneline = --oneline ']' +++ return 0 ++ bmk_print_result --oneline +++ set -euf -o pipefail ++ false ++ local print_arg=--oneline ++ artifacts_mail_dir=artifacts/notify +++ '[' full '!=' full ']' ++ case "$ci_project" in ++ metric_id=size ++ local improved_or_regressed @@ -410,11 +458,32 @@ ++ '[' -f artifacts/notify/symbol.improvement ']' ++ short_diag='No change' ++ echo 'No change' -++ print_commits --oneline ++ echo '[Linaro-TCWG-CI]' '588 commits in binutils,gcc,newlib: No change' ++ print_mail_body ++ local bad_artifacts_url good_artifacts_url +++ get_current_manifest BUILD_URL +++ get_manifest artifacts/manifest.sh BUILD_URL +++ set +x ++ bad_artifacts_url=https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/62/artifact/artifacts +++ get_baseline_manifest BUILD_URL +++ get_manifest base-artifacts/manifest.sh BUILD_URL false +++ set +x ++ good_artifacts_url=https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/artifact/artifacts ++ cat +++ print_commits --short +++ sed -e 's/^/ | /' +++ set -euf -o pipefail ++ false -++ local print_arg=--oneline -++ local components new_commits more_lines -++ case "$change_kind:$print_arg" in +++ local print_arg=--short +++ '[' multiple_components = no_change ']' +++ local more_lines +++ '[' multiple_components = single_commit ']' +++ '[' multiple_components = single_component ']' +++ '[' multiple_components = multiple_components ']' +++ local new_commits c base_rev cur_rev c_commits components +++ local commits_or_patches +++ '[' '' '!=' '' ']' +++ commits_or_patches=commits ++ new_commits=0 ++ for c in "${changed_components[@]}" +++ get_baseline_git binutils_rev @@ -423,16 +492,16 @@ +++ assert_with_msg 'ERROR: No binutils_rev in baseline git' '[' -f base-artifacts/git/binutils_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/binutils_rev -++ base_rev=3b23a5ea693deee60648c9a9e9d666d83549298e +++ base_rev=6feae66da1d652a50c1759bae46128087f7dfab0 +++ get_current_git binutils_rev +++ set -euf -o pipefail +++ assert_with_msg 'ERROR: No binutils_rev in current git' '[' -f artifacts/git/binutils_rev ']' +++ set -euf -o pipefail +x +++ cat artifacts/git/binutils_rev -++ cur_rev=6feae66da1d652a50c1759bae46128087f7dfab0 -+++ git -C binutils rev-list --count 3b23a5ea693deee60648c9a9e9d666d83549298e..6feae66da1d652a50c1759bae46128087f7dfab0 -++ c_commits=46 -++ new_commits=46 +++ cur_rev=41770089162edd23ea7ae33b7952585316accde5 ++++ git -C binutils rev-list --count 6feae66da1d652a50c1759bae46128087f7dfab0..41770089162edd23ea7ae33b7952585316accde5 +++ c_commits=214 +++ new_commits=214 ++ for c in "${changed_components[@]}" +++ get_baseline_git gcc_rev +++ set -euf -o pipefail @@ -440,16 +509,16 @@ +++ assert_with_msg 'ERROR: No gcc_rev in baseline git' '[' -f base-artifacts/git/gcc_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/gcc_rev -++ base_rev=68783211f660a501dee203aec11dae99bf9808ba +++ base_rev=17d670dbca16d8ccb502c5d82c67981b1ba937af +++ get_current_git gcc_rev +++ set -euf -o pipefail +++ assert_with_msg 'ERROR: No gcc_rev in current git' '[' -f artifacts/git/gcc_rev ']' +++ set -euf -o pipefail +x +++ cat artifacts/git/gcc_rev -++ cur_rev=17d670dbca16d8ccb502c5d82c67981b1ba937af -+++ git -C gcc rev-list --count 68783211f660a501dee203aec11dae99bf9808ba..17d670dbca16d8ccb502c5d82c67981b1ba937af -++ c_commits=141 -++ new_commits=187 +++ cur_rev=4e2d53c943400e8b5d49a7d5aab4a1ad046aefba ++++ git -C gcc rev-list --count 17d670dbca16d8ccb502c5d82c67981b1ba937af..4e2d53c943400e8b5d49a7d5aab4a1ad046aefba +++ c_commits=355 +++ new_commits=569 ++ for c in "${changed_components[@]}" +++ get_baseline_git newlib_rev +++ set -euf -o pipefail @@ -457,27 +526,21 @@ +++ assert_with_msg 'ERROR: No newlib_rev in baseline git' '[' -f base-artifacts/git/newlib_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/newlib_rev -++ base_rev=1a646ad7970a2cd3a1c931af4217cc17fc576116 +++ base_rev=65d34484e9097fd9036dd577028423355cb5f5bc +++ get_current_git newlib_rev +++ set -euf -o pipefail +++ assert_with_msg 'ERROR: No newlib_rev in current git' '[' -f artifacts/git/newlib_rev ']' +++ set -euf -o pipefail +x +++ cat artifacts/git/newlib_rev -++ cur_rev=65d34484e9097fd9036dd577028423355cb5f5bc -+++ git -C newlib rev-list --count 1a646ad7970a2cd3a1c931af4217cc17fc576116..65d34484e9097fd9036dd577028423355cb5f5bc -++ c_commits=4 -++ new_commits=191 +++ cur_rev=c4aa56bbf26f297d4faf1bae80822c0d820a5d44 ++++ git -C newlib rev-list --count 65d34484e9097fd9036dd577028423355cb5f5bc..c4aa56bbf26f297d4faf1bae80822c0d820a5d44 +++ c_commits=19 +++ new_commits=588 +++ echo binutils gcc newlib +++ tr ' ' , ++ components=binutils,gcc,newlib -++ echo '191 commits in binutils,gcc,newlib' -++ print_commits --short -++ sed -e 's/^/ | /' -++ false -++ local print_arg=--short -++ local components new_commits more_lines -++ case "$change_kind:$print_arg" in -++ new_commits=0 +++ echo '588 commits in binutils,gcc,newlib' +++ '[' --short = --oneline ']' ++ for c in "${changed_components[@]}" +++ get_baseline_git binutils_rev +++ set -euf -o pipefail @@ -485,27 +548,20 @@ +++ assert_with_msg 'ERROR: No binutils_rev in baseline git' '[' -f base-artifacts/git/binutils_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/binutils_rev -++ base_rev=3b23a5ea693deee60648c9a9e9d666d83549298e +++ base_rev=6feae66da1d652a50c1759bae46128087f7dfab0 +++ get_current_git binutils_rev +++ set -euf -o pipefail +++ assert_with_msg 'ERROR: No binutils_rev in current git' '[' -f artifacts/git/binutils_rev ']' +++ set -euf -o pipefail +x +++ cat artifacts/git/binutils_rev -++ cur_rev=6feae66da1d652a50c1759bae46128087f7dfab0 -+++ git -C binutils rev-list --count 3b23a5ea693deee60648c9a9e9d666d83549298e..6feae66da1d652a50c1759bae46128087f7dfab0 -++ c_commits=46 -++ new_commits=46 -++ echo 'binutils commits:' -+++ git -C binutils log --pretty=oneline 3b23a5ea693deee60648c9a9e9d666d83549298e..6feae66da1d652a50c1759bae46128087f7dfab0 -+++ head -n5 -+++ true -++ echo '6feae66da1d652a50c1759bae46128087f7dfab0 [gdb/build, c++20] Handle deprecated std::allocator::construct -9246b7bd6dfeb273f9be7648acffddfe19f966ff [gdb/build] Return const reference in target_read_auxv -2b9ed6db3fb08feab70857dc7eb94fbe6a45e069 [gdb/build, c++20] Fix invalid conversion in test_symbols -5bd5fecdd25eda1335796df8d77511f62bbd1898 [gdb/build, c++20] Fix deprecated implicit capture of this -63b87362a5800890ccc5ca8494a9e0443472ef99 [gdb/build, c++20] Fix DISABLE_COPY_AND_ASSIGN use in ui_out_emit_type' -++ '[' 46 -gt 5 ']' -++ echo '... and 41 more' +++ cur_rev=41770089162edd23ea7ae33b7952585316accde5 ++++ git -C binutils rev-list --count 6feae66da1d652a50c1759bae46128087f7dfab0..41770089162edd23ea7ae33b7952585316accde5 +++ c_commits=214 +++ '[' '' '!=' '' ']' +++ git -C binutils log -n 5 --oneline 6feae66da1d652a50c1759bae46128087f7dfab0..41770089162edd23ea7ae33b7952585316accde5 +++ '[' 214 -gt 5 ']' +++ echo '... and 209 more commits in binutils' +++ '[' '' '!=' '' ']' ++ for c in "${changed_components[@]}" +++ get_baseline_git gcc_rev +++ set -euf -o pipefail @@ -513,27 +569,20 @@ +++ assert_with_msg 'ERROR: No gcc_rev in baseline git' '[' -f base-artifacts/git/gcc_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/gcc_rev -++ base_rev=68783211f660a501dee203aec11dae99bf9808ba +++ base_rev=17d670dbca16d8ccb502c5d82c67981b1ba937af +++ get_current_git gcc_rev +++ set -euf -o pipefail +++ assert_with_msg 'ERROR: No gcc_rev in current git' '[' -f artifacts/git/gcc_rev ']' +++ set -euf -o pipefail +x +++ cat artifacts/git/gcc_rev -++ cur_rev=17d670dbca16d8ccb502c5d82c67981b1ba937af -+++ git -C gcc rev-list --count 68783211f660a501dee203aec11dae99bf9808ba..17d670dbca16d8ccb502c5d82c67981b1ba937af -++ c_commits=141 -++ new_commits=187 -++ echo 'gcc commits:' -+++ git -C gcc log --pretty=oneline 68783211f660a501dee203aec11dae99bf9808ba..17d670dbca16d8ccb502c5d82c67981b1ba937af -+++ head -n5 -+++ true -++ echo '17d670dbca16d8ccb502c5d82c67981b1ba937af testsuite: Remove unused dg-line in ce8cdf5bcf96a2db6d7b9f656fc9ba58d7942a83 -93f803d53b5ccaabded9d7b4512b54da81c1c616 fixincludes: Update darwin_flt_eval_method for macOS 14 -0beac9209f0ae230b34ad31e76e7b0b633a5fb21 build: Allow for Xcode 15 ld -v output -51d702f3baf73aa4016b9798045d13318074ca1e libstdc++: Disable PCH for tests that rely on include order -91315f23ba127ea4d1a584023bae34e143f6eb8c libstdc++: Fix testsuite no_pch directive' -++ '[' 141 -gt 5 ']' -++ echo '... and 136 more' +++ cur_rev=4e2d53c943400e8b5d49a7d5aab4a1ad046aefba ++++ git -C gcc rev-list --count 17d670dbca16d8ccb502c5d82c67981b1ba937af..4e2d53c943400e8b5d49a7d5aab4a1ad046aefba +++ c_commits=355 +++ '[' '' '!=' '' ']' +++ git -C gcc log -n 5 --oneline 17d670dbca16d8ccb502c5d82c67981b1ba937af..4e2d53c943400e8b5d49a7d5aab4a1ad046aefba +++ '[' 355 -gt 5 ']' +++ echo '... and 350 more commits in gcc' +++ '[' '' '!=' '' ']' ++ for c in "${changed_components[@]}" +++ get_baseline_git newlib_rev +++ set -euf -o pipefail @@ -541,28 +590,27 @@ +++ assert_with_msg 'ERROR: No newlib_rev in baseline git' '[' -f base-artifacts/git/newlib_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/newlib_rev -++ base_rev=1a646ad7970a2cd3a1c931af4217cc17fc576116 +++ base_rev=65d34484e9097fd9036dd577028423355cb5f5bc +++ get_current_git newlib_rev +++ set -euf -o pipefail +++ assert_with_msg 'ERROR: No newlib_rev in current git' '[' -f artifacts/git/newlib_rev ']' +++ set -euf -o pipefail +x +++ cat artifacts/git/newlib_rev -++ cur_rev=65d34484e9097fd9036dd577028423355cb5f5bc -+++ git -C newlib rev-list --count 1a646ad7970a2cd3a1c931af4217cc17fc576116..65d34484e9097fd9036dd577028423355cb5f5bc -++ c_commits=4 -++ new_commits=191 -++ echo 'newlib commits:' -+++ git -C newlib log --pretty=oneline 1a646ad7970a2cd3a1c931af4217cc17fc576116..65d34484e9097fd9036dd577028423355cb5f5bc -+++ head -n5 -++ echo '65d34484e9097fd9036dd577028423355cb5f5bc Cygwin: shared: Fix access permissions setting in open_shared(). -2ee8de782b809c83c4261cc6e7e17bdaf31cff96 Cygwin: pty: Add missing pinfo check in transfer_input(). -46c4a9072436b01f9239bbac2e9a24bc08755026 Cygwin: cXXrtomb, mbrtcXX: use function-specific internal state -b5111e46424b693e04bc0e964a01f871a71c26ef struct _reent: add state for unicode functions' -++ '[' 4 -gt 5 ']' +++ cur_rev=c4aa56bbf26f297d4faf1bae80822c0d820a5d44 ++++ git -C newlib rev-list --count 65d34484e9097fd9036dd577028423355cb5f5bc..c4aa56bbf26f297d4faf1bae80822c0d820a5d44 +++ c_commits=19 +++ '[' '' '!=' '' ']' +++ git -C newlib log -n 5 --oneline 65d34484e9097fd9036dd577028423355cb5f5bc..c4aa56bbf26f297d4faf1bae80822c0d820a5d44 +++ '[' 19 -gt 5 ']' +++ echo '... and 14 more commits in newlib' +++ '[' '' '!=' '' ']' +++ return 0 ++ bmk_print_result --short +++ set -euf -o pipefail ++ false ++ local print_arg=--short ++ artifacts_mail_dir=artifacts/notify +++ '[' full '!=' full ']' ++ case "$ci_project" in ++ metric_id=size ++ local improved_or_regressed @@ -589,7 +637,7 @@ b5111e46424b693e04bc0e964a01f871a71c26ef struct _reent: add state for unicode fu ++ '[' -f artifacts/notify/symbol.improvement ']' ++ echo 'No change' ++ bmk_print_config -++ . /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/tcwg_bmk-config.sh +++ . /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/tcwg_bmk-config.sh +++ [[ -v rr[ci_project] ]] +++ [[ -v rr[ci_config] ]] +++ declare -A bmk_data @@ -680,102 +728,8 @@ b5111e46424b693e04bc0e964a01f871a71c26ef struct _reent: add state for unicode fu +++ case "$target" in +++ target=arm-eabi +++ echo arm-eabi -+ '[' xmultiple_components '!=' xsingle_commit ']' ++ '[' multiple_components '!=' single_commit ']' + return -+ print_mail_subject -+ true -++ bmk_print_result --oneline -++ false -++ local print_arg=--oneline -++ artifacts_mail_dir=artifacts/notify -++ case "$ci_project" in -++ metric_id=size -++ local improved_or_regressed -++ '[' -f artifacts/notify/exe.regression ']' -++ '[' -f artifacts/notify/symbol.regression ']' -++ improved_or_regressed=improvement -++ declare -A changed_by_msg -++ changed_by_msg[size-regression]='grew in size by' -++ changed_by_msg[size-improvement]='reduced in size by' -++ changed_by_msg[time-regression]='slowed down by' -++ changed_by_msg[time-improvement]='speeds up by' -++ changed_by_msg[vect-regression]='reduced by' -++ changed_by_msg[vect-improvement]='increased up by' -++ changed_by_msg[sve-regression]='reduced by' -++ changed_by_msg[sve-improvement]='increased up by' -++ changed_by='reduced in size by' -++ case $metric_id in -++ exe_threshold=1 -++ symbol_threshold=10 -++ case "$print_arg" in -++ assert_with_msg 'Builds with infra problems should never get here' '[' 0 '!=' 125 ']' -++ set -euf -o pipefail +x -++ local metric bmk symbol short_diag long_diag -++ '[' -f artifacts/notify/exe.improvement ']' -++ '[' -f artifacts/notify/symbol.improvement ']' -++ short_diag='No change' -++ echo 'No change' -++ print_commits --oneline -++ false -++ local print_arg=--oneline -++ local components new_commits more_lines -++ case "$change_kind:$print_arg" in -++ new_commits=0 -++ for c in "${changed_components[@]}" -+++ get_baseline_git binutils_rev -+++ set -euf -o pipefail -+++ local base_artifacts=base-artifacts -+++ assert_with_msg 'ERROR: No binutils_rev in baseline git' '[' -f base-artifacts/git/binutils_rev ']' -+++ set -euf -o pipefail +x -+++ cat base-artifacts/git/binutils_rev -++ base_rev=3b23a5ea693deee60648c9a9e9d666d83549298e -+++ get_current_git binutils_rev -+++ set -euf -o pipefail -+++ assert_with_msg 'ERROR: No binutils_rev in current git' '[' -f artifacts/git/binutils_rev ']' -+++ set -euf -o pipefail +x -+++ cat artifacts/git/binutils_rev -++ cur_rev=6feae66da1d652a50c1759bae46128087f7dfab0 -+++ git -C binutils rev-list --count 3b23a5ea693deee60648c9a9e9d666d83549298e..6feae66da1d652a50c1759bae46128087f7dfab0 -++ c_commits=46 -++ new_commits=46 -++ for c in "${changed_components[@]}" -+++ get_baseline_git gcc_rev -+++ set -euf -o pipefail -+++ local base_artifacts=base-artifacts -+++ assert_with_msg 'ERROR: No gcc_rev in baseline git' '[' -f base-artifacts/git/gcc_rev ']' -+++ set -euf -o pipefail +x -+++ cat base-artifacts/git/gcc_rev -++ base_rev=68783211f660a501dee203aec11dae99bf9808ba -+++ get_current_git gcc_rev -+++ set -euf -o pipefail -+++ assert_with_msg 'ERROR: No gcc_rev in current git' '[' -f artifacts/git/gcc_rev ']' -+++ set -euf -o pipefail +x -+++ cat artifacts/git/gcc_rev -++ cur_rev=17d670dbca16d8ccb502c5d82c67981b1ba937af -+++ git -C gcc rev-list --count 68783211f660a501dee203aec11dae99bf9808ba..17d670dbca16d8ccb502c5d82c67981b1ba937af -++ c_commits=141 -++ new_commits=187 -++ for c in "${changed_components[@]}" -+++ get_baseline_git newlib_rev -+++ set -euf -o pipefail -+++ local base_artifacts=base-artifacts -+++ assert_with_msg 'ERROR: No newlib_rev in baseline git' '[' -f base-artifacts/git/newlib_rev ']' -+++ set -euf -o pipefail +x -+++ cat base-artifacts/git/newlib_rev -++ base_rev=1a646ad7970a2cd3a1c931af4217cc17fc576116 -+++ get_current_git newlib_rev -+++ set -euf -o pipefail -+++ assert_with_msg 'ERROR: No newlib_rev in current git' '[' -f artifacts/git/newlib_rev ']' -+++ set -euf -o pipefail +x -+++ cat artifacts/git/newlib_rev -++ cur_rev=65d34484e9097fd9036dd577028423355cb5f5bc -+++ git -C newlib rev-list --count 1a646ad7970a2cd3a1c931af4217cc17fc576116..65d34484e9097fd9036dd577028423355cb5f5bc -++ c_commits=4 -++ new_commits=191 -+++ echo binutils gcc newlib -+++ tr ' ' , -++ components=binutils,gcc,newlib -++ echo '191 commits in binutils,gcc,newlib' # generate dashboard # generate_dashboard_squad ... Skipping @@ -783,7 +737,6 @@ b5111e46424b693e04bc0e964a01f871a71c26ef struct _reent: add state for unicode fu ... Skipping # post_to_jira Full stage ran successfully. -+ echo '[Linaro-TCWG-CI] No change after commit: 191 commits in binutils,gcc,newlib' + echo '# generate dashboard' + generate_dashboard_squad + local results_date diff --git a/jenkins/notify-init.log b/jenkins/notify-init.log index 3297590..b792ecf 100644 --- a/jenkins/notify-init.log +++ b/jenkins/notify-init.log @@ -1,27 +1,27 @@ ++ pwd ++ cat -+ remote_exec 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' ./jenkins-scripts/round-robin-notify.sh '@@rr[top_artifacts]' artifacts --notify ignore __stage init __verbose true ++ remote_exec 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ./jenkins-scripts/round-robin-notify.sh '@@rr[top_artifacts]' artifacts --notify ignore __stage init __verbose true + set -euf -o pipefail + local host -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -d: -f 1 -+ host=build-02.tcwglab ++ host=build-05.tcwglab + local port -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 2 + port= + local dir +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 3 -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' -+ dir=/home/tcwg-buildslave/workspace/tcwg_bmk_1 ++ dir=/home/tcwg-buildslave/workspace/tcwg_bmk_0 + local opts -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 4 -+ opts=-p51077 ++ opts=-p51655 + local env_vars -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 5 -+ env_vars='ssh_host=build-02.tcwglab ssh_port=51077' ++ env_vars='ssh_host=build-05.tcwglab ssh_port=51655' + shift + local -a cmd + cmd=() @@ -52,10 +52,10 @@ + for i in "$@" + cmd+=("$(printf '%q' "$i")") ++ printf %q true -++ printf %q /home/tcwg-buildslave/workspace/tcwg_bmk_1 -+ ssh -p51077 build-02.tcwglab 'export ssh_host=build-02.tcwglab ssh_port=51077 && cd /home/tcwg-buildslave/workspace/tcwg_bmk_1 && exec ./jenkins-scripts/round-robin-notify.sh @@rr\[top_artifacts\] artifacts --notify ignore __stage init __verbose true' +++ printf %q /home/tcwg-buildslave/workspace/tcwg_bmk_0 ++ ssh -p51655 build-05.tcwglab 'export ssh_host=build-05.tcwglab ssh_port=51655 && cd /home/tcwg-buildslave/workspace/tcwg_bmk_0 && exec ./jenkins-scripts/round-robin-notify.sh @@rr\[top_artifacts\] artifacts --notify ignore __stage init __verbose true' -/home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/round-robin-notify.sh @@rr[top_artifacts] artifacts --notify ignore __stage init __verbose true +/home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/round-robin-notify.sh @@rr[top_artifacts] artifacts --notify ignore __stage init __verbose true + false + dryrun= @@ -71,33 +71,35 @@ ++ get_current_manifest '{rr[ci_project]}' ++ get_manifest artifacts/manifest.sh '{rr[ci_project]}' ++ set +x -# Debug traces : + ci_project=tcwg_bmk-code_size-coremark ++ get_current_manifest '{rr[ci_config]}' ++ get_manifest artifacts/manifest.sh '{rr[ci_config]}' ++ set +x +# Debug traces : + ci_config=gnu_eabi-arm_eabi-master-O3_LTO + echo '# Debug traces :' ++ get_baseline_manifest BUILD_URL ++ get_manifest base-artifacts/manifest.sh BUILD_URL false ++ set +x -# Baseline : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/53/ +# Baseline : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/ # Using dir : base-artifacts -+ echo '# Baseline : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/53/' ++ echo '# Baseline : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/' + echo '# Using dir : base-artifacts' ++ get_current_manifest BUILD_URL ++ get_manifest artifacts/manifest.sh BUILD_URL ++ set +x -# Artifacts : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/ +# Artifacts : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/62/ # Using dir : artifacts -+ echo '# Artifacts : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/' ++ echo '# Artifacts : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/62/' + echo '# Using dir : artifacts' + echo '' + mkdir -p artifacts/notify + '[' -f /home/tcwg-buildslave/.jipdate.yml ']' + set +x # check_source_changes ++ declare -Ag pw ++ '[' ignore = precommit ']' + check_source_changes + echo '# check_source_changes' ++ get_current_manifest '{rr[update_baseline]}' @@ -137,7 +139,7 @@ +++ assert_with_msg 'ERROR: No binutils_rev in baseline git' '[' -f base-artifacts/git/binutils_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/binutils_rev -++ '[' x6feae66da1d652a50c1759bae46128087f7dfab0 '!=' x3b23a5ea693deee60648c9a9e9d666d83549298e ']' +++ '[' x41770089162edd23ea7ae33b7952585316accde5 '!=' x6feae66da1d652a50c1759bae46128087f7dfab0 ']' ++ echo -ne binutils ++ delim=' ' ++ for c in $(print_updated_components) @@ -152,7 +154,7 @@ +++ assert_with_msg 'ERROR: No gcc_rev in baseline git' '[' -f base-artifacts/git/gcc_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/gcc_rev -++ '[' x17d670dbca16d8ccb502c5d82c67981b1ba937af '!=' x68783211f660a501dee203aec11dae99bf9808ba ']' +++ '[' x4e2d53c943400e8b5d49a7d5aab4a1ad046aefba '!=' x17d670dbca16d8ccb502c5d82c67981b1ba937af ']' ++ echo -ne ' gcc' ++ delim=' ' ++ for c in $(print_updated_components) @@ -160,8 +162,6 @@ +++ set -euf -o pipefail +++ assert_with_msg 'ERROR: No newlib_rev in current git' '[' -f artifacts/git/newlib_rev ']' +++ set -euf -o pipefail +x -# Debug traces : -# change_kind=multiple_components : binutils gcc newlib +++ cat artifacts/git/newlib_rev +++ get_baseline_git newlib_rev +++ set -euf -o pipefail @@ -169,10 +169,12 @@ +++ assert_with_msg 'ERROR: No newlib_rev in baseline git' '[' -f base-artifacts/git/newlib_rev ']' +++ set -euf -o pipefail +x +++ cat base-artifacts/git/newlib_rev -++ '[' x65d34484e9097fd9036dd577028423355cb5f5bc '!=' x1a646ad7970a2cd3a1c931af4217cc17fc576116 ']' +++ '[' xc4aa56bbf26f297d4faf1bae80822c0d820a5d44 '!=' x65d34484e9097fd9036dd577028423355cb5f5bc ']' ++ echo -ne ' newlib' ++ delim=' ' ++ echo +# Debug traces : +# change_kind=multiple_components : binutils gcc newlib + local c base_rev cur_rev c_commits + '[' 3 = 0 ']' + '[' 3 = 1 ']' @@ -187,17 +189,17 @@ ++ assert_with_msg 'ERROR: No binutils_rev in baseline git' '[' -f base-artifacts/git/binutils_rev ']' ++ set -euf -o pipefail +x ++ cat base-artifacts/git/binutils_rev -+ base_rev=3b23a5ea693deee60648c9a9e9d666d83549298e ++ base_rev=6feae66da1d652a50c1759bae46128087f7dfab0 ++ get_current_git binutils_rev ++ set -euf -o pipefail ++ assert_with_msg 'ERROR: No binutils_rev in current git' '[' -f artifacts/git/binutils_rev ']' ++ set -euf -o pipefail +x ++ cat artifacts/git/binutils_rev -+ cur_rev=6feae66da1d652a50c1759bae46128087f7dfab0 -++ git -C binutils rev-list --count 3b23a5ea693deee60648c9a9e9d666d83549298e..6feae66da1d652a50c1759bae46128087f7dfab0 -# rev for binutils : 3b23a5ea693deee60648c9a9e9d666d83549298e..6feae66da1d652a50c1759bae46128087f7dfab0 (46 commits) -+ c_commits=46 -+ echo '# rev for binutils : 3b23a5ea693deee60648c9a9e9d666d83549298e..6feae66da1d652a50c1759bae46128087f7dfab0 (46 commits)' ++ cur_rev=41770089162edd23ea7ae33b7952585316accde5 +++ git -C binutils rev-list --count 6feae66da1d652a50c1759bae46128087f7dfab0..41770089162edd23ea7ae33b7952585316accde5 +# rev for binutils : 6feae66da1d652a50c1759bae46128087f7dfab0..41770089162edd23ea7ae33b7952585316accde5 (214 commits) ++ c_commits=214 ++ echo '# rev for binutils : 6feae66da1d652a50c1759bae46128087f7dfab0..41770089162edd23ea7ae33b7952585316accde5 (214 commits)' + for c in "${changed_components[@]}" ++ get_baseline_git gcc_rev ++ set -euf -o pipefail @@ -205,17 +207,17 @@ ++ assert_with_msg 'ERROR: No gcc_rev in baseline git' '[' -f base-artifacts/git/gcc_rev ']' ++ set -euf -o pipefail +x ++ cat base-artifacts/git/gcc_rev -+ base_rev=68783211f660a501dee203aec11dae99bf9808ba ++ base_rev=17d670dbca16d8ccb502c5d82c67981b1ba937af ++ get_current_git gcc_rev ++ set -euf -o pipefail ++ assert_with_msg 'ERROR: No gcc_rev in current git' '[' -f artifacts/git/gcc_rev ']' ++ set -euf -o pipefail +x ++ cat artifacts/git/gcc_rev -+ cur_rev=17d670dbca16d8ccb502c5d82c67981b1ba937af -++ git -C gcc rev-list --count 68783211f660a501dee203aec11dae99bf9808ba..17d670dbca16d8ccb502c5d82c67981b1ba937af -# rev for gcc : 68783211f660a501dee203aec11dae99bf9808ba..17d670dbca16d8ccb502c5d82c67981b1ba937af (141 commits) -+ c_commits=141 -+ echo '# rev for gcc : 68783211f660a501dee203aec11dae99bf9808ba..17d670dbca16d8ccb502c5d82c67981b1ba937af (141 commits)' ++ cur_rev=4e2d53c943400e8b5d49a7d5aab4a1ad046aefba +++ git -C gcc rev-list --count 17d670dbca16d8ccb502c5d82c67981b1ba937af..4e2d53c943400e8b5d49a7d5aab4a1ad046aefba +# rev for gcc : 17d670dbca16d8ccb502c5d82c67981b1ba937af..4e2d53c943400e8b5d49a7d5aab4a1ad046aefba (355 commits) ++ c_commits=355 ++ echo '# rev for gcc : 17d670dbca16d8ccb502c5d82c67981b1ba937af..4e2d53c943400e8b5d49a7d5aab4a1ad046aefba (355 commits)' + for c in "${changed_components[@]}" ++ get_baseline_git newlib_rev ++ set -euf -o pipefail @@ -223,18 +225,18 @@ ++ assert_with_msg 'ERROR: No newlib_rev in baseline git' '[' -f base-artifacts/git/newlib_rev ']' ++ set -euf -o pipefail +x ++ cat base-artifacts/git/newlib_rev -+ base_rev=1a646ad7970a2cd3a1c931af4217cc17fc576116 ++ base_rev=65d34484e9097fd9036dd577028423355cb5f5bc ++ get_current_git newlib_rev ++ set -euf -o pipefail ++ assert_with_msg 'ERROR: No newlib_rev in current git' '[' -f artifacts/git/newlib_rev ']' ++ set -euf -o pipefail +x ++ cat artifacts/git/newlib_rev -+ cur_rev=65d34484e9097fd9036dd577028423355cb5f5bc -++ git -C newlib rev-list --count 1a646ad7970a2cd3a1c931af4217cc17fc576116..65d34484e9097fd9036dd577028423355cb5f5bc -# rev for newlib : 1a646ad7970a2cd3a1c931af4217cc17fc576116..65d34484e9097fd9036dd577028423355cb5f5bc (4 commits) ++ cur_rev=c4aa56bbf26f297d4faf1bae80822c0d820a5d44 +++ git -C newlib rev-list --count 65d34484e9097fd9036dd577028423355cb5f5bc..c4aa56bbf26f297d4faf1bae80822c0d820a5d44 +# rev for newlib : 65d34484e9097fd9036dd577028423355cb5f5bc..c4aa56bbf26f297d4faf1bae80822c0d820a5d44 (19 commits) -+ c_commits=4 -+ echo '# rev for newlib : 1a646ad7970a2cd3a1c931af4217cc17fc576116..65d34484e9097fd9036dd577028423355cb5f5bc (4 commits)' ++ c_commits=19 ++ echo '# rev for newlib : 65d34484e9097fd9036dd577028423355cb5f5bc..c4aa56bbf26f297d4faf1bae80822c0d820a5d44 (19 commits)' + echo '' + setup_stages_to_run + '[' ignore = onregression ']' @@ -245,27 +247,25 @@ + post_icommits=false + '[' ignore = ignore ']' + post_mail=false -# generate_extra_details -# post_interesting_commits -Init stage ran successfully. + generate_dashboard=false + post_dashboard=false + print_commits_f=print_commits + print_result_f=print_result + print_config_f=print_config + print_last_icommit_f=print_last_icommit ++ generate_extra_details_f=generate_extra_details + case "$ci_project" in + print_result_f=bmk_print_result + print_config_f=bmk_print_config -+ generate_extra_details -+ set -euf -o pipefail -+ echo '# generate_extra_details' ++ generate_extra_details_f=bmk_generate_extra_details + post_interesting_commits init +# post_interesting_commits + set -euf -o pipefail + echo '# post_interesting_commits' + local stage=init + '[' multiple_components '!=' single_commit ']' + return +Init stage ran successfully. + '[' init '!=' full ']' + echo 'Init stage ran successfully.' + exit 0 diff --git a/jenkins/rewrite.log b/jenkins/rewrite.log index 4965699..3370d76 100644 --- a/jenkins/rewrite.log +++ b/jenkins/rewrite.log @@ -1,27 +1,27 @@ ++ pwd ++ cat -+ remote_exec 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' ./jenkins-scripts/round-robin-baseline.sh '@@rr[top_artifacts]' artifacts __build_script tcwg_bmk-build.sh __push_base_artifacts true __rewrite_base_artifacts true __rewrite_num 100 ++ remote_exec 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ./jenkins-scripts/round-robin-baseline.sh '@@rr[top_artifacts]' artifacts __build_script tcwg_bmk-build.sh __push_base_artifacts true __rewrite_base_artifacts true __rewrite_num 100 + set -euf -o pipefail + local host -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -d: -f 1 -+ host=build-02.tcwglab ++ host=build-05.tcwglab + local port -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 2 + port= + local dir -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 3 -+ dir=/home/tcwg-buildslave/workspace/tcwg_bmk_1 ++ dir=/home/tcwg-buildslave/workspace/tcwg_bmk_0 + local opts -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 4 -+ opts=-p51077 ++ opts=-p51655 + local env_vars -++ echo 'build-02.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_1:-p51077:ssh_host=build-02.tcwglab ssh_port=51077' +++ echo 'build-05.tcwglab::/home/tcwg-buildslave/workspace/tcwg_bmk_0:-p51655:ssh_host=build-05.tcwglab ssh_port=51655' ++ cut -s -d: -f 5 -+ env_vars='ssh_host=build-02.tcwglab ssh_port=51077' ++ env_vars='ssh_host=build-05.tcwglab ssh_port=51655' + shift + local -a cmd + cmd=() @@ -58,5 +58,5 @@ + for i in "$@" + cmd+=("$(printf '%q' "$i")") ++ printf %q 100 -++ printf %q /home/tcwg-buildslave/workspace/tcwg_bmk_1 -+ ssh -p51077 build-02.tcwglab 'export ssh_host=build-02.tcwglab ssh_port=51077 && cd /home/tcwg-buildslave/workspace/tcwg_bmk_1 && exec ./jenkins-scripts/round-robin-baseline.sh @@rr\[top_artifacts\] artifacts __build_script tcwg_bmk-build.sh __push_base_artifacts true __rewrite_base_artifacts true __rewrite_num 100' +++ printf %q /home/tcwg-buildslave/workspace/tcwg_bmk_0 ++ ssh -p51655 build-05.tcwglab 'export ssh_host=build-05.tcwglab ssh_port=51655 && cd /home/tcwg-buildslave/workspace/tcwg_bmk_0 && exec ./jenkins-scripts/round-robin-baseline.sh @@rr\[top_artifacts\] artifacts __build_script tcwg_bmk-build.sh __push_base_artifacts true __rewrite_base_artifacts true __rewrite_num 100' diff --git a/jenkins/run-build.env b/jenkins/run-build.env index 1db5e39..a9c2f1e 100644 --- a/jenkins/run-build.env +++ b/jenkins/run-build.env @@ -1,15 +1,15 @@ -build_name="#55" +build_name="#62" docker_opts=(--distro default --ssh_info true ) source build_container.sh trap "cleanup_all_containers" EXIT -build_name="#55-binutils-gcc-newlib" +build_name="#62-binutils-gcc-newlib" branch_opt=(==rr\[binutils_git\] git://sourceware.org/git/binutils-gdb.git#master ==rr\[gcc_git\] https://github.com/gcc-mirror/gcc.git#master ==rr\[newlib_git\] git://sourceware.org/git/newlib-cygwin.git#master ) -build_name="#55-binutils-gcc-newlib-R1" +build_name="#62-binutils-gcc-newlib-R1" diff --git a/manifest.sh b/manifest.sh index 0244523..47e54ad 100644 --- a/manifest.sh +++ b/manifest.sh @@ -1,4 +1,4 @@ -declare -g "jenkins_scripts_rev=2ec1a6363957f53f2082af20db78979f82b9ee42" +declare -g "jenkins_scripts_rev=fd1841679e5130ca495be5e830d34b267022ebc4" # Artifacts directory # Recording parameters to manifest: artifacts/manifest.sh rr[ci_project]="tcwg_bmk-code_size-coremark" @@ -7,7 +7,7 @@ declare -g "bmk_branch=master" declare -g "scripts_branch=master" rr[mode]="build" rr[update_baseline]="onsuccess" -declare -g "BUILD_URL=https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/" +declare -g "BUILD_URL=https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/62/" declare -g "SQUAD_GRP=tcwg" rr[binutils_git]="git://sourceware.org/git/binutils-gdb.git#master" rr[gcc_git]="https://github.com/gcc-mirror/gcc.git#master" diff --git a/notify/extra-bisect-params b/notify/extra-bisect-params new file mode 100644 index 0000000..fa6c7c9 --- /dev/null +++ b/notify/extra-bisect-params @@ -0,0 +1 @@ +extra_build_params= diff --git a/notify/jira/comments.txt b/notify/jira/comments.txt index 2fd6124..a8cf25a 100644 --- a/notify/jira/comments.txt +++ b/notify/jira/comments.txt @@ -1,3 +1,3 @@ [GNU-689] No change -Details: https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/artifact/artifacts/notify/mail-body.txt/*view*/ +Details: https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/62/artifact/artifacts/notify/mail-body.txt/*view*/ diff --git a/notify/mail-body.txt b/notify/mail-body.txt index 447cfb3..8c28f96 100644 --- a/notify/mail-body.txt +++ b/notify/mail-body.txt @@ -1,29 +1,28 @@ -[Linaro-TCWG-CI] No change after commit: 191 commits in binutils,gcc,newlib -Dear contributor, our automatic CI has detected problems related to your patch. -Please find below some details about it. +Dear contributor, our automatic CI has detected problems related to your patch(es). +Please find some details below. If you have any questions, please follow up on linaro-toolchain@lists.linaro.org mailing list. In CI config tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO after: - | binutils commits: - | 6feae66da1d652a50c1759bae46128087f7dfab0 [gdb/build, c++20] Handle deprecated std::allocator::construct - | 9246b7bd6dfeb273f9be7648acffddfe19f966ff [gdb/build] Return const reference in target_read_auxv - | 2b9ed6db3fb08feab70857dc7eb94fbe6a45e069 [gdb/build, c++20] Fix invalid conversion in test_symbols - | 5bd5fecdd25eda1335796df8d77511f62bbd1898 [gdb/build, c++20] Fix deprecated implicit capture of this - | 63b87362a5800890ccc5ca8494a9e0443472ef99 [gdb/build, c++20] Fix DISABLE_COPY_AND_ASSIGN use in ui_out_emit_type - | ... and 41 more - | gcc commits: - | 17d670dbca16d8ccb502c5d82c67981b1ba937af testsuite: Remove unused dg-line in ce8cdf5bcf96a2db6d7b9f656fc9ba58d7942a83 - | 93f803d53b5ccaabded9d7b4512b54da81c1c616 fixincludes: Update darwin_flt_eval_method for macOS 14 - | 0beac9209f0ae230b34ad31e76e7b0b633a5fb21 build: Allow for Xcode 15 ld -v output - | 51d702f3baf73aa4016b9798045d13318074ca1e libstdc++: Disable PCH for tests that rely on include order - | 91315f23ba127ea4d1a584023bae34e143f6eb8c libstdc++: Fix testsuite no_pch directive - | ... and 136 more - | newlib commits: - | 65d34484e9097fd9036dd577028423355cb5f5bc Cygwin: shared: Fix access permissions setting in open_shared(). - | 2ee8de782b809c83c4261cc6e7e17bdaf31cff96 Cygwin: pty: Add missing pinfo check in transfer_input(). - | 46c4a9072436b01f9239bbac2e9a24bc08755026 Cygwin: cXXrtomb, mbrtcXX: use function-specific internal state - | b5111e46424b693e04bc0e964a01f871a71c26ef struct _reent: add state for unicode functions + | 588 commits in binutils,gcc,newlib + | 41770089162 gdbserver: i387_cache_to_xsave: fix copy dest of zmm registers + | 06ef1876687 Automatic date update in version.in + | 7fdd4fcee1c config: Fix host -rdynamic detection for build != host != target + | b47a4f92de5 Fix "usage" errors for some MI varobj commands + | dfab07b9ead x86: unindent most of set_cpu_arch() + | ... and 209 more commits in binutils + | 4e2d53c9434 LoongArch: Implement 128-bit floating point functions in gcc. + | 80907b03c8e Daily bump. + | 6f06152541d Fortran: runtime bounds-checking in presence of array constructors [PR31059] + | e7b26744404 analyzer: Add support of placement new and improved operator new [PR105948,PR94355] + | d3dd69706af testsuite: Fix analyzer_cpython_plugin.c declarations, PR testsuite/111264 + | ... and 350 more commits in gcc + | c4aa56bbf Cygwin: cpuinfo: Linux 6.5 additions + | 2a4af3661 Cygwin: Implement sound mixer device. + | 3daedf267 Cygwin: document latest sys/cpuset.h fix + | ac4699fdf Cygwin: sys/cpuset.h: use internal base types + | d27e9fb29 Cygwin: sys/cpuset.h: add cpuset-specific external functions + | ... and 14 more commits in newlib No change @@ -42,6 +41,6 @@ This benchmarking CI is work-in-progress, and we welcome feedback and suggestion -----------------8<--------------------------8<--------------------------8<-------------------------- The information below can be used to reproduce a debug environment: -Current build : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/artifact/artifacts -Reference build : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/53/artifact/artifacts +Current build : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/62/artifact/artifacts +Reference build : https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/55/artifact/artifacts diff --git a/notify/mail-recipients.txt b/notify/mail-recipients.txt index e69de29..aa219ef 100644 --- a/notify/mail-recipients.txt +++ b/notify/mail-recipients.txt @@ -0,0 +1 @@ +bcc:tcwg-validation@linaro.org diff --git a/notify/mail-subject.txt b/notify/mail-subject.txt index c272faa..57c24a3 100644 --- a/notify/mail-subject.txt +++ b/notify/mail-subject.txt @@ -1 +1 @@ -[Linaro-TCWG-CI] No change after commit: 191 commits in binutils,gcc,newlib +[Linaro-TCWG-CI] 588 commits in binutils,gcc,newlib: No change diff --git a/notify/output-bmk-results.log b/notify/output-bmk-results.log new file mode 100644 index 0000000..d412a4d --- /dev/null +++ b/notify/output-bmk-results.log @@ -0,0 +1,214 @@ + --- modulename: output-bmk-results, funcname: <module> +<string>(1): --- modulename: output-bmk-results, funcname: main +output-bmk-results.py(279): results_csv = sys.argv[1] +output-bmk-results.py(280): variability_file = sys.argv[2] +output-bmk-results.py(281): run_step_artifacts_dir = sys.argv[3] +output-bmk-results.py(282): metric = sys.argv[4] +output-bmk-results.py(283): mode = sys.argv[5] +output-bmk-results.py(284): details = sys.argv[6] +output-bmk-results.py(286): merged_df = read_results_csv(results_csv) + --- modulename: output-bmk-results, funcname: read_results_csv +output-bmk-results.py(269): df = pd.read_csv(results_csv) +output-bmk-results.py(270): df = df.fillna(-1) +output-bmk-results.py(272): for metric in get_comparable_metrics(df): + --- modulename: output-bmk-results, funcname: get_comparable_metrics +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ + --- modulename: output-bmk-results, funcname: <genexpr> +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ + --- modulename: output-bmk-results, funcname: <genexpr> +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ + --- modulename: output-bmk-results, funcname: <genexpr> +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ + --- modulename: output-bmk-results, funcname: <genexpr> +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ + --- modulename: output-bmk-results, funcname: <genexpr> +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ + --- modulename: output-bmk-results, funcname: <genexpr> +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(191): & metric_utils.comparable_metrics +output-bmk-results.py(190): return set(metric[len("rel_"):] for metric in df.columns[2:] if metric.startswith("rel_")) \ +output-bmk-results.py(273): df["rel_" + metric] = df["rel_" + metric].astype("int") +output-bmk-results.py(274): df[metric + "_x"] = df[metric + "_x"].astype("int") +output-bmk-results.py(275): df[metric + "_y"] = df[metric + "_y"].astype("int") +output-bmk-results.py(272): for metric in get_comparable_metrics(df): +output-bmk-results.py(273): df["rel_" + metric] = df["rel_" + metric].astype("int") +output-bmk-results.py(274): df[metric + "_x"] = df[metric + "_x"].astype("int") +output-bmk-results.py(275): df[metric + "_y"] = df[metric + "_y"].astype("int") +output-bmk-results.py(272): for metric in get_comparable_metrics(df): +output-bmk-results.py(273): df["rel_" + metric] = df["rel_" + metric].astype("int") +output-bmk-results.py(274): df[metric + "_x"] = df[metric + "_x"].astype("int") +output-bmk-results.py(275): df[metric + "_y"] = df[metric + "_y"].astype("int") +output-bmk-results.py(272): for metric in get_comparable_metrics(df): +output-bmk-results.py(273): df["rel_" + metric] = df["rel_" + metric].astype("int") +output-bmk-results.py(274): df[metric + "_x"] = df[metric + "_x"].astype("int") +output-bmk-results.py(275): df[metric + "_y"] = df[metric + "_y"].astype("int") +output-bmk-results.py(272): for metric in get_comparable_metrics(df): +output-bmk-results.py(276): return df +output-bmk-results.py(287): read_specific_variability_file(variability_file) + --- modulename: output-bmk-results, funcname: read_specific_variability_file +output-bmk-results.py(51): if not os.path.exists(bmk_specific_filename): +output-bmk-results.py(53): specific_variability = pd.read_csv(bmk_specific_filename, index_col=False) +output-bmk-results.py(288): output_bmk_results(merged_df, run_step_artifacts_dir, metric, mode, details) + --- modulename: output-bmk-results, funcname: output_bmk_results +output-bmk-results.py(240): f_regr = Outfile("{0}/results.regressions".format(run_step_artifacts), "w") + --- modulename: output-bmk-results, funcname: __init__ +output-bmk-results.py(19): self.filename=filename +output-bmk-results.py(20): self.predicate=predicate +output-bmk-results.py(21): if predicate: +output-bmk-results.py(22): self.outf = open(filename, mode) +output-bmk-results.py(23): self.csvwriter = csv.writer(self.outf) +output-bmk-results.py(241): f_ebp = Outfile("{0}/extra-bisect-params".format(run_step_artifacts), "w") + --- modulename: output-bmk-results, funcname: __init__ +output-bmk-results.py(19): self.filename=filename +output-bmk-results.py(20): self.predicate=predicate +output-bmk-results.py(21): if predicate: +output-bmk-results.py(22): self.outf = open(filename, mode) +output-bmk-results.py(23): self.csvwriter = csv.writer(self.outf) +output-bmk-results.py(242): f_skip = Outfile("{0}/any.skipped".format(run_step_artifacts), "w", predicate=(details=="verbose")) + --- modulename: output-bmk-results, funcname: __init__ +output-bmk-results.py(19): self.filename=filename +output-bmk-results.py(20): self.predicate=predicate +output-bmk-results.py(21): if predicate: +output-bmk-results.py(22): self.outf = open(filename, mode) +output-bmk-results.py(23): self.csvwriter = csv.writer(self.outf) +output-bmk-results.py(244): f_ebp.write("extra_build_params=") + --- modulename: output-bmk-results, funcname: write +output-bmk-results.py(36): if not self.predicate or not self.outf: +output-bmk-results.py(38): self.outf.write(string) +output-bmk-results.py(248): df = merged_df[merged_df["benchmark"] != "Mean"] +output-bmk-results.py(251): exe_df = df[df["symbol"].str.endswith("_base.default")] +output-bmk-results.py(252): sym_df = df[~df["symbol"].str.endswith("_base.default")] +output-bmk-results.py(254): output_bmk_results_1(exe_df, "exe", "regression", f_regr, f_skip, f_ebp, run_step_artifacts, metric, mode, details) + --- modulename: output-bmk-results, funcname: output_bmk_results_1 +output-bmk-results.py(202): f_out = Outfile("{0}/{1}.{2}".format(run_step_artifacts, sym_type, change_kind), "w", predicate=(details=="verbose")) + --- modulename: output-bmk-results, funcname: __init__ +output-bmk-results.py(19): self.filename=filename +output-bmk-results.py(20): self.predicate=predicate +output-bmk-results.py(21): if predicate: +output-bmk-results.py(22): self.outf = open(filename, mode) +output-bmk-results.py(23): self.csvwriter = csv.writer(self.outf) +output-bmk-results.py(204): rel_metric = "rel_" + metric +output-bmk-results.py(205): out_df = results_df[results_df[rel_metric] != -1] +output-bmk-results.py(208): for index, row in out_df.iterrows(): +output-bmk-results.py(237): f_out.close() + --- modulename: output-bmk-results, funcname: close +output-bmk-results.py(29): if not self.outf: +output-bmk-results.py(31): self.outf.close() +output-bmk-results.py(32): if os.stat(self.filename).st_size == 0: +output-bmk-results.py(33): os.remove(self.filename) +output-bmk-results.py(255): output_bmk_results_1(exe_df, "exe", "improvement", None, f_skip, None, run_step_artifacts, metric, mode, details) + --- modulename: output-bmk-results, funcname: output_bmk_results_1 +output-bmk-results.py(202): f_out = Outfile("{0}/{1}.{2}".format(run_step_artifacts, sym_type, change_kind), "w", predicate=(details=="verbose")) + --- modulename: output-bmk-results, funcname: __init__ +output-bmk-results.py(19): self.filename=filename +output-bmk-results.py(20): self.predicate=predicate +output-bmk-results.py(21): if predicate: +output-bmk-results.py(22): self.outf = open(filename, mode) +output-bmk-results.py(23): self.csvwriter = csv.writer(self.outf) +output-bmk-results.py(204): rel_metric = "rel_" + metric +output-bmk-results.py(205): out_df = results_df[results_df[rel_metric] != -1] +output-bmk-results.py(208): for index, row in out_df.iterrows(): +output-bmk-results.py(237): f_out.close() + --- modulename: output-bmk-results, funcname: close +output-bmk-results.py(29): if not self.outf: +output-bmk-results.py(31): self.outf.close() +output-bmk-results.py(32): if os.stat(self.filename).st_size == 0: +output-bmk-results.py(33): os.remove(self.filename) +output-bmk-results.py(257): output_bmk_results_1(sym_df, "symbol", "regression", f_regr, f_skip, f_ebp, run_step_artifacts, metric, mode, details) + --- modulename: output-bmk-results, funcname: output_bmk_results_1 +output-bmk-results.py(202): f_out = Outfile("{0}/{1}.{2}".format(run_step_artifacts, sym_type, change_kind), "w", predicate=(details=="verbose")) + --- modulename: output-bmk-results, funcname: __init__ +output-bmk-results.py(19): self.filename=filename +output-bmk-results.py(20): self.predicate=predicate +output-bmk-results.py(21): if predicate: +output-bmk-results.py(22): self.outf = open(filename, mode) +output-bmk-results.py(23): self.csvwriter = csv.writer(self.outf) +output-bmk-results.py(204): rel_metric = "rel_" + metric +output-bmk-results.py(205): out_df = results_df[results_df[rel_metric] != -1] +output-bmk-results.py(208): for index, row in out_df.iterrows(): +output-bmk-results.py(210): threshold = get_threshold(sym_type, metric, mode, row["benchmark"], row["symbol"]) + --- modulename: output-bmk-results, funcname: get_threshold +output-bmk-results.py(98): if metric == "sample": +output-bmk-results.py(108): if metric == "num_vect_loops" or metric == "num_sve_loops": +output-bmk-results.py(111): return default_threshold[(change_kind,metric,mode)] +output-bmk-results.py(212): print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\ +output-bmk-results.py(213): .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold)) +output-bmk-results.py(212): print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\ +DEBUG: checking symbol.regression : coremark,coremark : size=0% (threshold=10%) +output-bmk-results.py(216): if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold): + --- modulename: output-bmk-results, funcname: is_entry_regression +output-bmk-results.py(167): if metric in metric_utils.higher_regress_metrics: +output-bmk-results.py(168): return (result - 100 > threshold) +output-bmk-results.py(217): continue +output-bmk-results.py(208): for index, row in out_df.iterrows(): +output-bmk-results.py(237): f_out.close() + --- modulename: output-bmk-results, funcname: close +output-bmk-results.py(29): if not self.outf: +output-bmk-results.py(31): self.outf.close() +output-bmk-results.py(32): if os.stat(self.filename).st_size == 0: +output-bmk-results.py(33): os.remove(self.filename) +output-bmk-results.py(258): output_bmk_results_1(sym_df, "symbol", "improvement", None, f_skip, None, run_step_artifacts, metric, mode, details) + --- modulename: output-bmk-results, funcname: output_bmk_results_1 +output-bmk-results.py(202): f_out = Outfile("{0}/{1}.{2}".format(run_step_artifacts, sym_type, change_kind), "w", predicate=(details=="verbose")) + --- modulename: output-bmk-results, funcname: __init__ +output-bmk-results.py(19): self.filename=filename +output-bmk-results.py(20): self.predicate=predicate +output-bmk-results.py(21): if predicate: +output-bmk-results.py(22): self.outf = open(filename, mode) +output-bmk-results.py(23): self.csvwriter = csv.writer(self.outf) +output-bmk-results.py(204): rel_metric = "rel_" + metric +output-bmk-results.py(205): out_df = results_df[results_df[rel_metric] != -1] +output-bmk-results.py(208): for index, row in out_df.iterrows(): +output-bmk-results.py(210): threshold = get_threshold(sym_type, metric, mode, row["benchmark"], row["symbol"]) + --- modulename: output-bmk-results, funcname: get_threshold +output-bmk-results.py(98): if metric == "sample": +output-bmk-results.py(108): if metric == "num_vect_loops" or metric == "num_sve_loops": +output-bmk-results.py(111): return default_threshold[(change_kind,metric,mode)] +output-bmk-results.py(212): print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\ +output-bmk-results.py(213): .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold)) +output-bmk-results.py(212): print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\ +DEBUG: checking symbol.improvement : coremark,coremark : size=0% (threshold=10%) +output-bmk-results.py(216): if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold): + --- modulename: output-bmk-results, funcname: is_entry_improvement +output-bmk-results.py(176): if metric in metric_utils.higher_regress_metrics: +output-bmk-results.py(177): return (100 - result > threshold) +output-bmk-results.py(217): continue +output-bmk-results.py(208): for index, row in out_df.iterrows(): +output-bmk-results.py(237): f_out.close() + --- modulename: output-bmk-results, funcname: close +output-bmk-results.py(29): if not self.outf: +output-bmk-results.py(31): self.outf.close() +output-bmk-results.py(32): if os.stat(self.filename).st_size == 0: +output-bmk-results.py(33): os.remove(self.filename) +output-bmk-results.py(260): f_ebp.write("\n") + --- modulename: output-bmk-results, funcname: write +output-bmk-results.py(36): if not self.predicate or not self.outf: +output-bmk-results.py(38): self.outf.write(string) +output-bmk-results.py(262): f_skip.close() + --- modulename: output-bmk-results, funcname: close +output-bmk-results.py(29): if not self.outf: +output-bmk-results.py(31): self.outf.close() +output-bmk-results.py(32): if os.stat(self.filename).st_size == 0: +output-bmk-results.py(33): os.remove(self.filename) +output-bmk-results.py(263): f_regr.close() + --- modulename: output-bmk-results, funcname: close +output-bmk-results.py(29): if not self.outf: +output-bmk-results.py(31): self.outf.close() +output-bmk-results.py(32): if os.stat(self.filename).st_size == 0: +output-bmk-results.py(33): os.remove(self.filename) +output-bmk-results.py(264): f_ebp.close() + --- modulename: output-bmk-results, funcname: close +output-bmk-results.py(29): if not self.outf: +output-bmk-results.py(31): self.outf.close() +output-bmk-results.py(32): if os.stat(self.filename).st_size == 0: +output-bmk-results.py(289): return 0 diff --git a/notify/summary.txt b/notify/summary.txt deleted file mode 100644 index b743d14..0000000 --- a/notify/summary.txt +++ /dev/null @@ -1 +0,0 @@ -No change @@ -8,5 +8,5 @@ -6 # build_abe stage2 -- --set gcc_override_configure=--disable-libsanitizer --set gcc_override_configure=--disable-multilib --set gcc_override_configure=--with-cpu=cortex-m4 --set gcc_override_configure=--with-mode=thumb --set gcc_override_configure=--with-float=hard: -5 -# benchmark -- -O3_LTO_mthumb artifacts/results_id: +# benchmark -- -O3_LTO_mthumb: 1 diff --git a/results-vs-prev/bmk-specific-variability.csv b/results-vs-prev/bmk-specific-variability.csv new file mode 100644 index 0000000..02f715e --- /dev/null +++ b/results-vs-prev/bmk-specific-variability.csv @@ -0,0 +1 @@ +size_variation_average,num_vect_loops_variation_average,num_sve_loops_variation_average,benchmark,symbol,sample_variation_average diff --git a/results-vs-prev/compare-results-internal.csv b/results-vs-prev/compare-results-internal.csv index 7d3a838..a20ff79 100644 --- a/results-vs-prev/compare-results-internal.csv +++ b/results-vs-prev/compare-results-internal.csv @@ -4,4 +4,4 @@ Mean,average-all-tests,100,100,n/a,n/a,n/a,15161,15161,405,405,-1,-1,-1,-1,-1,-1 Mean,mean,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1,-1,-1 Mean,geomean-successful-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1,-1,-1 Mean,geomean-all-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1,-1,-1 -coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72300,72252,-1,-1,-1,-1,-1,-1 +coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72252,72316,-1,-1,-1,-1,-1,-1 diff --git a/results-vs-prev/csv-results-0/md5sum.csv b/results-vs-prev/csv-results-0/md5sum.csv index 820a9e5..966f952 100644 --- a/results-vs-prev/csv-results-0/md5sum.csv +++ b/results-vs-prev/csv-results-0/md5sum.csv @@ -1 +1,2 @@ benchmark,symbol,symbol_md5sum
+coremark,coremark,-1
diff --git a/results-vs-prev/csv-results-0/results.csv b/results-vs-prev/csv-results-0/results.csv index 84eb73a..5e2d751 100644 --- a/results-vs-prev/csv-results-0/results.csv +++ b/results-vs-prev/csv-results-0/results.csv @@ -4,7 +4,7 @@ Mean,average-all-tests,15161,405,-1,-1,-1 Mean,mean,15160,27,-1,-1,-1 Mean,geomean-successful-tests,15160,27,-1,-1,-1 Mean,geomean-all-tests,15160,27,-1,-1,-1 -coremark,coremark,15161,72300,-1,-1,-1 +coremark,coremark,15161,72252,-1,-1,-1 coremark,[.] abort,-1,14,-1,-1,-1 coremark,[.] ADC1_2_IRQHandler,-1,2,-1,-1,-1 coremark,[.] ADC3_IRQHandler,-1,2,-1,-1,-1 @@ -189,7 +189,7 @@ coremark,[.] _lseek,-1,4,-1,-1,-1 coremark,[.] _lseek_r,-1,44,-1,-1,-1 coremark,[.] __lshift,-1,240,-1,-1,-1 coremark,[.] __ltdf2,-1,130,-1,-1,-1 -coremark,[.] main,-1,5460,-1,-1,-1 +coremark,[.] main,-1,5412,-1,-1,-1 coremark,[.] __malloc_lock,-1,12,-1,-1,-1 coremark,[.] _malloc_r,-1,1384,-1,-1,-1 coremark,[.] _malloc_trim_r,-1,184,-1,-1,-1 diff --git a/results-vs-prev/csv-results-0/size.csv b/results-vs-prev/csv-results-0/size.csv index fbe3d23..733d651 100644 --- a/results-vs-prev/csv-results-0/size.csv +++ b/results-vs-prev/csv-results-0/size.csv @@ -1,5 +1,5 @@ benchmark,symbol,size
-coremark,coremark,72300
+coremark,coremark,72252
coremark,[.] abort,14
coremark,[.] ADC1_2_IRQHandler,2
coremark,[.] ADC3_IRQHandler,2
@@ -184,7 +184,7 @@ coremark,[.] _lseek,4 coremark,[.] _lseek_r,44
coremark,[.] __lshift,240
coremark,[.] __ltdf2,130
-coremark,[.] main,5460
+coremark,[.] main,5412
coremark,[.] __malloc_lock,12
coremark,[.] _malloc_r,1384
coremark,[.] _malloc_trim_r,184
diff --git a/results-vs-prev/csv-results-1/md5sum.csv b/results-vs-prev/csv-results-1/md5sum.csv index 820a9e5..966f952 100644 --- a/results-vs-prev/csv-results-1/md5sum.csv +++ b/results-vs-prev/csv-results-1/md5sum.csv @@ -1 +1,2 @@ benchmark,symbol,symbol_md5sum
+coremark,coremark,-1
diff --git a/results-vs-prev/csv-results-1/results.csv b/results-vs-prev/csv-results-1/results.csv index 5e2d751..6e4b32c 100644 --- a/results-vs-prev/csv-results-1/results.csv +++ b/results-vs-prev/csv-results-1/results.csv @@ -4,7 +4,7 @@ Mean,average-all-tests,15161,405,-1,-1,-1 Mean,mean,15160,27,-1,-1,-1 Mean,geomean-successful-tests,15160,27,-1,-1,-1 Mean,geomean-all-tests,15160,27,-1,-1,-1 -coremark,coremark,15161,72252,-1,-1,-1 +coremark,coremark,15161,72316,-1,-1,-1 coremark,[.] abort,-1,14,-1,-1,-1 coremark,[.] ADC1_2_IRQHandler,-1,2,-1,-1,-1 coremark,[.] ADC3_IRQHandler,-1,2,-1,-1,-1 @@ -125,7 +125,7 @@ coremark,[.] _fstat,-1,28,-1,-1,-1 coremark,[.] _fstat_r,-1,44,-1,-1,-1 coremark,[.] _fwalk_sglue,-1,68,-1,-1,-1 coremark,[.] __gedf2,-1,138,-1,-1,-1 -coremark,[.] get_arg,-1,3008,-1,-1,-1 +coremark,[.] get_arg,-1,3072,-1,-1,-1 coremark,[.] _getenv_r,-1,16,-1,-1,-1 coremark,[.] __get_locale_env,-1,80,-1,-1,-1 coremark,[.] _getpid,-1,4,-1,-1,-1 diff --git a/results-vs-prev/csv-results-1/size.csv b/results-vs-prev/csv-results-1/size.csv index 733d651..9e1e4fd 100644 --- a/results-vs-prev/csv-results-1/size.csv +++ b/results-vs-prev/csv-results-1/size.csv @@ -1,5 +1,5 @@ benchmark,symbol,size
-coremark,coremark,72252
+coremark,coremark,72316
coremark,[.] abort,14
coremark,[.] ADC1_2_IRQHandler,2
coremark,[.] ADC3_IRQHandler,2
@@ -120,7 +120,7 @@ coremark,[.] _fstat,28 coremark,[.] _fstat_r,44
coremark,[.] _fwalk_sglue,68
coremark,[.] __gedf2,138
-coremark,[.] get_arg,3008
+coremark,[.] get_arg,3072
coremark,[.] _getenv_r,16
coremark,[.] __get_locale_env,80
coremark,[.] _getpid,4
diff --git a/results-vs-prev/csvs2table-results-brief.csv b/results-vs-prev/csvs2table-results-brief.csv index 53e5104..933d92b 100644 --- a/results-vs-prev/csvs2table-results-brief.csv +++ b/results-vs-prev/csvs2table-results-brief.csv @@ -4,4 +4,4 @@ Mean,geomean-successful-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1, Mean,geomean-all-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1,-1,-1 Mean,average-successful-tests,100,100,n/a,n/a,n/a,15161,15161,405,405,-1,-1,-1,-1,-1,-1 Mean,average-all-tests,100,100,n/a,n/a,n/a,15161,15161,405,405,-1,-1,-1,-1,-1,-1 -coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72300,72252,-1,-1,-1,-1,-1,-1 +coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72252,72316,-1,-1,-1,-1,-1,-1 diff --git a/results-vs-prev/csvs2table-results-full.csv b/results-vs-prev/csvs2table-results-full.csv index 53e5104..933d92b 100644 --- a/results-vs-prev/csvs2table-results-full.csv +++ b/results-vs-prev/csvs2table-results-full.csv @@ -4,4 +4,4 @@ Mean,geomean-successful-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1, Mean,geomean-all-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1,-1,-1 Mean,average-successful-tests,100,100,n/a,n/a,n/a,15161,15161,405,405,-1,-1,-1,-1,-1,-1 Mean,average-all-tests,100,100,n/a,n/a,n/a,15161,15161,405,405,-1,-1,-1,-1,-1,-1 -coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72300,72252,-1,-1,-1,-1,-1,-1 +coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72252,72316,-1,-1,-1,-1,-1,-1 diff --git a/results-vs-prev/csvs2table-results-internal.csv b/results-vs-prev/csvs2table-results-internal.csv index 53e5104..933d92b 100644 --- a/results-vs-prev/csvs2table-results-internal.csv +++ b/results-vs-prev/csvs2table-results-internal.csv @@ -4,4 +4,4 @@ Mean,geomean-successful-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1, Mean,geomean-all-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1,-1,-1 Mean,average-successful-tests,100,100,n/a,n/a,n/a,15161,15161,405,405,-1,-1,-1,-1,-1,-1 Mean,average-all-tests,100,100,n/a,n/a,n/a,15161,15161,405,405,-1,-1,-1,-1,-1,-1 -coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72300,72252,-1,-1,-1,-1,-1,-1 +coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72252,72316,-1,-1,-1,-1,-1,-1 diff --git a/results-vs-prev/csvs2table-results.csv b/results-vs-prev/csvs2table-results.csv index 53e5104..933d92b 100644 --- a/results-vs-prev/csvs2table-results.csv +++ b/results-vs-prev/csvs2table-results.csv @@ -4,4 +4,4 @@ Mean,geomean-successful-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1, Mean,geomean-all-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1,-1,-1 Mean,average-successful-tests,100,100,n/a,n/a,n/a,15161,15161,405,405,-1,-1,-1,-1,-1,-1 Mean,average-all-tests,100,100,n/a,n/a,n/a,15161,15161,405,405,-1,-1,-1,-1,-1,-1 -coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72300,72252,-1,-1,-1,-1,-1,-1 +coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72252,72316,-1,-1,-1,-1,-1,-1 diff --git a/results-vs-prev/results-internal.csv b/results-vs-prev/results-internal.csv index 53e5104..933d92b 100644 --- a/results-vs-prev/results-internal.csv +++ b/results-vs-prev/results-internal.csv @@ -4,4 +4,4 @@ Mean,geomean-successful-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1, Mean,geomean-all-tests,100,100,n/a,n/a,n/a,15160,15160,27,27,-1,-1,-1,-1,-1,-1 Mean,average-successful-tests,100,100,n/a,n/a,n/a,15161,15161,405,405,-1,-1,-1,-1,-1,-1 Mean,average-all-tests,100,100,n/a,n/a,n/a,15161,15161,405,405,-1,-1,-1,-1,-1,-1 -coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72300,72252,-1,-1,-1,-1,-1,-1 +coremark,coremark,100,100,n/a,n/a,n/a,15161,15161,72252,72316,-1,-1,-1,-1,-1,-1 diff --git a/results-vs-prev/tcwg-benchmark-results.log b/results-vs-prev/tcwg-benchmark-results.log index 34aa69f..f9c71af 100644 --- a/results-vs-prev/tcwg-benchmark-results.log +++ b/results-vs-prev/tcwg-benchmark-results.log @@ -7,13 +7,13 @@ + j=0 + for i in "${results[@]}" + rm -rf results-0 -+ '[' -d bkp-01.tcwglab:/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/38691 ']' -+ rsync -az --delete bkp-01.tcwglab:/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/38691/ results-0/ ++ '[' -d base-artifacts/annex/bmk-data ']' ++ ln -s base-artifacts/annex/bmk-data results-0 + csv_results_dir=artifacts/results-vs-prev/csv-results-0 + mkdir -p artifacts/results-vs-prev/csv-results-0 -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/gather-metrics.sh --results_dir results-0/ --csv_results_dir artifacts/results-vs-prev/csv-results-0 ++metrics perf --hw_tag stm32 --has_perf_logs no --verbose true --num-symbols 0 -++ dirname /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/gather-metrics.sh -+ bmk_scripts=/home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/gather-metrics.sh --results_dir results-0/ --csv_results_dir artifacts/results-vs-prev/csv-results-0 ++metrics perf --hw_tag stm32 --has_perf_logs no --verbose true --num-symbols 0 +++ dirname /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/gather-metrics.sh ++ bmk_scripts=/home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts + results_dir=undef + csv_results_dir=undef + hw_tag=undef @@ -90,13 +90,13 @@ + '[' 1 -eq 1 ']' + cat results-0/dev-01.tcwglab/results.csv + cut -d, -f 1-3 -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/fixup-perf-csv.py artifacts/results-vs-prev/csv-results-0/perf-tmp.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/fixup-perf-csv.py artifacts/results-vs-prev/csv-results-0/perf-tmp.csv + rm artifacts/results-vs-prev/csv-results-0/perf-tmp.csv + '[' xno = xyes ']' + bmk_name=coremark + metrics=("${metrics[@]:1}") + merge_opts=("$csv_results_dir/perf.csv") -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/merge-metric-csvs.py artifacts/results-vs-prev/csv-results-0/perf.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/merge-metric-csvs.py artifacts/results-vs-prev/csv-results-0/perf.csv + j=1 + for i in "${results[@]}" + rm -rf results-1 @@ -104,9 +104,9 @@ + ln -s artifacts/annex/bmk-data results-1 + csv_results_dir=artifacts/results-vs-prev/csv-results-1 + mkdir -p artifacts/results-vs-prev/csv-results-1 -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/gather-metrics.sh --results_dir results-1/ --csv_results_dir artifacts/results-vs-prev/csv-results-1 ++metrics perf --hw_tag stm32 --has_perf_logs no --verbose true --num-symbols 0 -++ dirname /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/gather-metrics.sh -+ bmk_scripts=/home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/gather-metrics.sh --results_dir results-1/ --csv_results_dir artifacts/results-vs-prev/csv-results-1 ++metrics perf --hw_tag stm32 --has_perf_logs no --verbose true --num-symbols 0 +++ dirname /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/gather-metrics.sh ++ bmk_scripts=/home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts + results_dir=undef + csv_results_dir=undef + hw_tag=undef @@ -181,23 +181,23 @@ + mapfile -t this_csv ++ find results-1/ -name results.csv -a '!' -path '*/csv_results/*' + '[' 1 -eq 1 ']' -+ cut -d, -f 1-3 + cat results-1/dev-01.tcwglab/results.csv -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/fixup-perf-csv.py artifacts/results-vs-prev/csv-results-1/perf-tmp.csv ++ cut -d, -f 1-3 ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/fixup-perf-csv.py artifacts/results-vs-prev/csv-results-1/perf-tmp.csv + rm artifacts/results-vs-prev/csv-results-1/perf-tmp.csv + '[' xno = xyes ']' + bmk_name=coremark + metrics=("${metrics[@]:1}") + merge_opts=("$csv_results_dir/perf.csv") -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/merge-metric-csvs.py artifacts/results-vs-prev/csv-results-1/perf.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/merge-metric-csvs.py artifacts/results-vs-prev/csv-results-1/perf.csv + j=2 -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/gen_interesting_symbols.py --perf_csv=artifacts/results-vs-prev/csv-results-1/perf.csv --out_csv=artifacts/results-vs-prev/interesting-symbols.csv --threshold_interesting=10 ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/gen_interesting_symbols.py --perf_csv=artifacts/results-vs-prev/csv-results-1/perf.csv --out_csv=artifacts/results-vs-prev/interesting-symbols.csv --threshold_interesting=10 + csvs= + for i in "${results[@]}" + csv_results_dir=artifacts/results-vs-prev/csv-results-0 -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/gather-metrics.sh --results_dir results-0/ --csv_results_dir artifacts/results-vs-prev/csv-results-0 --hw_tag stm32 --has_perf_logs no --verbose true --num-symbols 0 --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv -++ dirname /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/gather-metrics.sh -+ bmk_scripts=/home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/gather-metrics.sh --results_dir results-0/ --csv_results_dir artifacts/results-vs-prev/csv-results-0 --hw_tag stm32 --has_perf_logs no --verbose true --num-symbols 0 --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv +++ dirname /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/gather-metrics.sh ++ bmk_scripts=/home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts + results_dir=undef + csv_results_dir=undef + hw_tag=undef @@ -274,32 +274,32 @@ + '[' 1 -eq 1 ']' + cat results-0/dev-01.tcwglab/results.csv + cut -d, -f 1-3 -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/fixup-perf-csv.py artifacts/results-vs-prev/csv-results-0/perf-tmp.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/fixup-perf-csv.py artifacts/results-vs-prev/csv-results-0/perf-tmp.csv + rm artifacts/results-vs-prev/csv-results-0/perf-tmp.csv + '[' xno = xyes ']' + bmk_name=coremark + metrics=("${metrics[@]:1}") + merge_opts=("$csv_results_dir/perf.csv") + for metric in "${metrics[@]}" -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/size-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-0/size.csv --perf_csv artifacts/results-vs-prev/csv-results-0/perf.csv --results_dir results-0/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/size-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-0/size.csv --perf_csv artifacts/results-vs-prev/csv-results-0/perf.csv --results_dir results-0/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv + merge_opts+=("$csv_results_dir/$metric.csv") + for metric in "${metrics[@]}" -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/vect-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-0/vect.csv --perf_csv artifacts/results-vs-prev/csv-results-0/perf.csv --results_dir results-0/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/vect-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-0/vect.csv --perf_csv artifacts/results-vs-prev/csv-results-0/perf.csv --results_dir results-0/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv + merge_opts+=("$csv_results_dir/$metric.csv") + for metric in "${metrics[@]}" -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/sve-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-0/sve.csv --perf_csv artifacts/results-vs-prev/csv-results-0/perf.csv --results_dir results-0/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/sve-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-0/sve.csv --perf_csv artifacts/results-vs-prev/csv-results-0/perf.csv --results_dir results-0/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv + merge_opts+=("$csv_results_dir/$metric.csv") + for metric in "${metrics[@]}" -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/md5sum-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-0/md5sum.csv --perf_csv artifacts/results-vs-prev/csv-results-0/perf.csv --results_dir results-0/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/md5sum-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-0/md5sum.csv --perf_csv artifacts/results-vs-prev/csv-results-0/perf.csv --results_dir results-0/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv + merge_opts+=("$csv_results_dir/$metric.csv") -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/merge-metric-csvs.py artifacts/results-vs-prev/csv-results-0/perf.csv artifacts/results-vs-prev/csv-results-0/size.csv artifacts/results-vs-prev/csv-results-0/vect.csv artifacts/results-vs-prev/csv-results-0/sve.csv artifacts/results-vs-prev/csv-results-0/md5sum.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/merge-metric-csvs.py artifacts/results-vs-prev/csv-results-0/perf.csv artifacts/results-vs-prev/csv-results-0/size.csv artifacts/results-vs-prev/csv-results-0/vect.csv artifacts/results-vs-prev/csv-results-0/sve.csv artifacts/results-vs-prev/csv-results-0/md5sum.csv + csvs=' artifacts/results-vs-prev/csv-results-0/results.csv' + num=1 + for i in "${results[@]}" + csv_results_dir=artifacts/results-vs-prev/csv-results-1 -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/gather-metrics.sh --results_dir results-1/ --csv_results_dir artifacts/results-vs-prev/csv-results-1 --hw_tag stm32 --has_perf_logs no --verbose true --num-symbols 0 --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv -++ dirname /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/gather-metrics.sh -+ bmk_scripts=/home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/gather-metrics.sh --results_dir results-1/ --csv_results_dir artifacts/results-vs-prev/csv-results-1 --hw_tag stm32 --has_perf_logs no --verbose true --num-symbols 0 --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv +++ dirname /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/gather-metrics.sh ++ bmk_scripts=/home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts + results_dir=undef + csv_results_dir=undef + hw_tag=undef @@ -376,38 +376,38 @@ + '[' 1 -eq 1 ']' + cat results-1/dev-01.tcwglab/results.csv + cut -d, -f 1-3 -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/fixup-perf-csv.py artifacts/results-vs-prev/csv-results-1/perf-tmp.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/fixup-perf-csv.py artifacts/results-vs-prev/csv-results-1/perf-tmp.csv + rm artifacts/results-vs-prev/csv-results-1/perf-tmp.csv + '[' xno = xyes ']' + bmk_name=coremark + metrics=("${metrics[@]:1}") + merge_opts=("$csv_results_dir/perf.csv") + for metric in "${metrics[@]}" -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/size-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-1/size.csv --perf_csv artifacts/results-vs-prev/csv-results-1/perf.csv --results_dir results-1/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/size-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-1/size.csv --perf_csv artifacts/results-vs-prev/csv-results-1/perf.csv --results_dir results-1/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv + merge_opts+=("$csv_results_dir/$metric.csv") + for metric in "${metrics[@]}" -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/vect-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-1/vect.csv --perf_csv artifacts/results-vs-prev/csv-results-1/perf.csv --results_dir results-1/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/vect-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-1/vect.csv --perf_csv artifacts/results-vs-prev/csv-results-1/perf.csv --results_dir results-1/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv + merge_opts+=("$csv_results_dir/$metric.csv") + for metric in "${metrics[@]}" -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/sve-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-1/sve.csv --perf_csv artifacts/results-vs-prev/csv-results-1/perf.csv --results_dir results-1/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/sve-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-1/sve.csv --perf_csv artifacts/results-vs-prev/csv-results-1/perf.csv --results_dir results-1/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv + merge_opts+=("$csv_results_dir/$metric.csv") + for metric in "${metrics[@]}" -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/md5sum-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-1/md5sum.csv --perf_csv artifacts/results-vs-prev/csv-results-1/perf.csv --results_dir results-1/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/md5sum-data-to-csv.py --bmk_name coremark --out_csv_file artifacts/results-vs-prev/csv-results-1/md5sum.csv --perf_csv artifacts/results-vs-prev/csv-results-1/perf.csv --results_dir results-1/ --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv + merge_opts+=("$csv_results_dir/$metric.csv") -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/merge-metric-csvs.py artifacts/results-vs-prev/csv-results-1/perf.csv artifacts/results-vs-prev/csv-results-1/size.csv artifacts/results-vs-prev/csv-results-1/vect.csv artifacts/results-vs-prev/csv-results-1/sve.csv artifacts/results-vs-prev/csv-results-1/md5sum.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/merge-metric-csvs.py artifacts/results-vs-prev/csv-results-1/perf.csv artifacts/results-vs-prev/csv-results-1/size.csv artifacts/results-vs-prev/csv-results-1/vect.csv artifacts/results-vs-prev/csv-results-1/sve.csv artifacts/results-vs-prev/csv-results-1/md5sum.csv + csvs=' artifacts/results-vs-prev/csv-results-0/results.csv artifacts/results-vs-prev/csv-results-1/results.csv' + num=2 -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/csvs2table.py -p 10 --relative artifacts/results-vs-prev/csv-results-0/results.csv artifacts/results-vs-prev/csv-results-1/results.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/csvs2table.py -p 10 --relative artifacts/results-vs-prev/csv-results-0/results.csv artifacts/results-vs-prev/csv-results-1/results.csv + cat artifacts/results-vs-prev/csvs2table-results-internal.csv + c++filt -p ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/csvs2table.py -p 0 --relative artifacts/results-vs-prev/csv-results-0/results.csv artifacts/results-vs-prev/csv-results-1/results.csv + c++filt -p -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/csvs2table.py -p 0 --relative artifacts/results-vs-prev/csv-results-0/results.csv artifacts/results-vs-prev/csv-results-1/results.csv -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/csvs2table.py -p 99 --relative artifacts/results-vs-prev/csv-results-0/results.csv artifacts/results-vs-prev/csv-results-1/results.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/csvs2table.py -p 99 --relative artifacts/results-vs-prev/csv-results-0/results.csv artifacts/results-vs-prev/csv-results-1/results.csv + c++filt -p + '[' x--relative == x--relative ']' + '[' 2 == 2 ']' -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/compare-results.py artifacts/results-vs-prev/csv-results-0/results.csv artifacts/results-vs-prev/csv-results-1/results.csv --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv -+ /home/tcwg-buildslave/workspace/tcwg_bmk_1/jenkins-scripts/../bmk-scripts/diff-bmk-results.py artifacts/results-vs-prev/compare-results-internal.csv artifacts/results-vs-prev/csvs2table-results-internal.csv true ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/compare-results.py artifacts/results-vs-prev/csv-results-0/results.csv artifacts/results-vs-prev/csv-results-1/results.csv --interesting_symbols artifacts/results-vs-prev/interesting-symbols.csv ++ /home/tcwg-buildslave/workspace/tcwg_bmk_0/jenkins-scripts/../bmk-scripts/diff-bmk-results.py artifacts/results-vs-prev/compare-results-internal.csv artifacts/results-vs-prev/csvs2table-results-internal.csv true + grep -Fxq 'Same results' artifacts/results-vs-prev/cmp-results.diff + rm artifacts/results-vs-prev/cmp-results.diff + cp artifacts/results-vs-prev/csvs2table-results-internal.csv artifacts/results-vs-prev/results-internal.csv diff --git a/results_id b/results_id deleted file mode 100644 index 440dfe4..0000000 --- a/results_id +++ /dev/null @@ -1 +0,0 @@ -stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/38907 |