0: init: #1: 1: [TCWG CI] No change after baseline build: no new commits

BUILD_URL: https://ci.linaro.org/job/tcwg_bmk-code_size-coremark--gnu_eabi-arm_eabi-master-O3_LTO-build/1/

After baseline build

Below reproducer instructions can be used to re-build both "first_bad" and "last_good" cross-toolchains used in this bisection.  Naturally, the scripts will fail when triggerring benchmarking jobs if you don\'t have access to Linaro TCWG CI.

Configuration:
- Benchmark: EEMBC CoreMark
- Toolchain: GCC + Newlib + GNU LD
- Version: all components were built from their tip of trunk
- Target: arm-eabi
- Compiler flags: -O3 -flto -mthumb
- Hardware:

This benchmarking CI is work-in-progress, and we welcome feedback and suggestions at linaro-toolchain@lists.linaro.org .  In our improvement plans is to add support for SPEC CPU2017 benchmarks and provide "perf report/annotate" data behind these reports.

1 files changed, 193 insertions, 0 deletions

diff --git a/08-benchmark/benchmark.log b/08-benchmark/benchmark.log
new file mode 100644
index 0000000..52b5416
--- /dev/null
+++ b/08-benchmark/benchmark.log
@@ -0,0 +1,193 @@
+Started TCWG Benchmark #27203
+Started from command line by tcwg-buildslave@linaro.org
+Running as SYSTEM
+[EnvInject] - Loading node environment variables.
+Building remotely on tcwg-bmk-bkp-01 (tcwg-bmk-coordinator tcwg-parallel-jobs tcwg) in workspace /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_5
+[ssh-agent] Looking for ssh-agent implementation...
+[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
+$ ssh-agent
+SSH_AUTH_SOCK=/tmp/ssh-XXXXXXkp8GmE/agent.31038
+SSH_AGENT_PID=31040
+[ssh-agent] Started.
+Running ssh-add (command line suppressed)
+Identity added: /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_5_tmp/private_key_13433819560354569945.key (/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_5_tmp/private_key_13433819560354569945.key)
+[ssh-agent] Using credentials tcwg-benchmark (benchmark for TCWG machines)
+The recommended git tool is: NONE
+No credentials specified
+ > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_5/jenkins-scripts/.git # timeout=10
+Fetching changes from the remote Git repository
+ > /usr/bin/git config remote.origin.url https://git.linaro.org/toolchain/jenkins-scripts.git # timeout=10
+Cleaning workspace
+ > /usr/bin/git rev-parse --verify HEAD # timeout=10
+Resetting working tree
+ > /usr/bin/git reset --hard # timeout=10
+ > /usr/bin/git clean -fdx # timeout=10
+Pruning obsolete local branches
+Fetching upstream changes from https://git.linaro.org/toolchain/jenkins-scripts.git
+ > /usr/bin/git --version # timeout=10
+ > git --version # 'git version 2.34.1'
+ > /usr/bin/git fetch --tags --force --progress --prune -- https://git.linaro.org/toolchain/jenkins-scripts.git +refs/heads/*:refs/remotes/origin/* +refs/changes/*:refs/changes/* # timeout=10
+ > /usr/bin/git rev-parse origin/master^{commit} # timeout=10
+Checking out Revision ea53665f7249e6e0bebdddc04da3cc440ff35fd4 (origin/master)
+ > /usr/bin/git config core.sparsecheckout # timeout=10
+ > /usr/bin/git checkout -f ea53665f7249e6e0bebdddc04da3cc440ff35fd4 # timeout=10
+Commit message: "tcwg_bmk-build.sh: Fix samples-variability generation"
+ > /usr/bin/git rev-list --no-walk ea53665f7249e6e0bebdddc04da3cc440ff35fd4 # timeout=10
+The recommended git tool is: NONE
+No credentials specified
+ > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_5/bmk-scripts/.git # timeout=10
+Fetching changes from the remote Git repository
+ > /usr/bin/git config remote.origin.url https://git.linaro.org/toolchain/bmk-scripts.git # timeout=10
+Cleaning workspace
+ > /usr/bin/git rev-parse --verify HEAD # timeout=10
+Resetting working tree
+ > /usr/bin/git reset --hard # timeout=10
+ > /usr/bin/git clean -fdx # timeout=10
+Pruning obsolete local branches
+Fetching upstream changes from https://git.linaro.org/toolchain/bmk-scripts.git
+ > /usr/bin/git --version # timeout=10
+ > git --version # 'git version 2.34.1'
+ > /usr/bin/git fetch --tags --force --progress --prune -- https://git.linaro.org/toolchain/bmk-scripts.git +refs/heads/*:refs/remotes/origin/* +refs/changes/*:refs/changes/* # timeout=10
+ > /usr/bin/git rev-parse origin/master^{commit} # timeout=10
+Checking out Revision 6a4264908385693deeb5d4ae8a8d2e9d1be93a2b (origin/master)
+ > /usr/bin/git config core.sparsecheckout # timeout=10
+ > /usr/bin/git checkout -f 6a4264908385693deeb5d4ae8a8d2e9d1be93a2b # timeout=10
+Commit message: "output-bmk-results.py,samples-variability.py: Generate and use automatic thresholds for exe/functions"
+ > /usr/bin/git rev-list --no-walk 6a4264908385693deeb5d4ae8a8d2e9d1be93a2b # timeout=10
+No emails were triggered.
+New run name is '#27203-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64)'
+[tcwg-benchmark-tcwg-bmk-bkp-01_5] $ /bin/bash /tmp/jenkins4531687500358350781.sh
++ rm -rf artifacts
++ mkdir -p artifacts/jenkins
++ has_perf_logs=yes
++ case "$bmk_hw:$image_arch" in
++ hw_tag=stm32
++ has_perf_logs=no
+++ sed -e s/@build_num@/27203/g -e s/@hw_tag@/stm32/g
+++ echo stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/@build_num@
++ results_id=stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203
++ idle_boards=0
++ total_boards=0
+++ set +f
+++ ls -tr /home/tcwg-benchmark/boards/tcwg-bmk-stm32-01.lock
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 31158
++ flock -en -E 124 9
++ total_boards=1
++ '[' 0 = 124 ']'
++ idle_boards=1
++ n_boards=1
++ '[' 1 -lt 1 ']'
++ count=1
++ read -a bmks
+++ ./bmk-scripts/break-up-bmks.sh --bench_list coremark --bmk_hw stm32 --n_boards 1 --run_profile parallel --board_selection balance
++ cat
++ count=2
++ read -a bmks
++ cat
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #111553 started.
+TCWG Benchmark_backend #111553-27203+1-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64) completed. Result was SUCCESS
+[tcwg-benchmark-tcwg-bmk-bkp-01_5] $ /bin/bash /tmp/jenkins14227653356666571158.sh
++ . artifacts/bmk-info
+++ results_id=stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203
+++ hw_tag=stm32
+++ has_perf_logs=no
++ results_dir=/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203
++ csv_results_dir=/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results
++ rm -rf /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results
++ mkdir /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results
++ ./bmk-scripts/gather-metrics.sh --results_dir /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203 --csv_results_dir /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results --hw_tag stm32 --has_perf_logs no
+++ dirname ./bmk-scripts/gather-metrics.sh
++ bmk_scripts=./bmk-scripts
++ results_dir=undef
++ csv_results_dir=undef
++ hw_tag=undef
++ has_perf_logs=undef
++ metrics=()
++ verbose=false
++ test 8 -gt 0
++ case $1 in
++ results_dir=/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203
++ shift
++ shift
++ test 6 -gt 0
++ case $1 in
++ csv_results_dir=/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results
++ shift
++ shift
++ test 4 -gt 0
++ case $1 in
++ hw_tag=stm32
++ shift
++ shift
++ test 2 -gt 0
++ case $1 in
++ has_perf_logs=no
++ shift
++ shift
++ test 0 -gt 0
++ check_option /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203 'results_dir not set.'
++ local var=/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203
++ local 'msg=results_dir not set.'
++ '[' x/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203 = xundef ']'
++ check_option /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results 'csv_results_dir not set.'
++ local var=/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results
++ local 'msg=csv_results_dir not set.'
++ '[' x/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results = xundef ']'
++ check_option stm32 'hw_tag not set.'
++ local var=stm32
++ local 'msg=hw_tag not set.'
++ '[' xstm32 = xundef ']'
++ check_option no 'has_perf_logs not set.'
++ local var=no
++ local 'msg=has_perf_logs not set.'
++ '[' xno = xundef ']'
++ '[' 0 = 0 ']'
++ metrics=(perf size vect sve md5sum)
++ mkdir -p /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results
++ false
++ num_entries_opt=' '
++ gather_perf_data no stm32 /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203 /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results
++ local has_perf_logs=no
++ local hw_tag=stm32
++ local results_dir=/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203
++ local csv_results_dir=/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results
++ '[' xno = xyes ']'
++ mapfile -t this_csv
+++ find /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203 -name results.csv -a '!' -path '/home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/*'
++ '[' 1 -eq 1 ']'
++ cat /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/dev-01.tcwglab/results.csv
++ cut -d, -f 1-3
++ '[' xno = xyes ']'
++ bmk_name=coremark
++ metrics=("${metrics[@]:1}")
++ merge_opts=("$csv_results_dir/perf.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/size-data-to-csv.py --bmk_name coremark --out_csv_file /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/size.csv --perf_csv /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203
++ merge_opts+=("$csv_results_dir/$metric.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/vect-data-to-csv.py --bmk_name coremark --out_csv_file /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/vect.csv --perf_csv /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203
++ merge_opts+=("$csv_results_dir/$metric.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/sve-data-to-csv.py --bmk_name coremark --out_csv_file /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/sve.csv --perf_csv /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203
++ merge_opts+=("$csv_results_dir/$metric.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/md5sum-data-to-csv.py --bmk_name coremark --out_csv_file /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/md5sum.csv --perf_csv /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203
++ merge_opts+=("$csv_results_dir/$metric.csv")
++ ./bmk-scripts/merge-metric-csvs.py /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/perf.csv /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/size.csv /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/vect.csv /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/sve.csv /home/tcwg-benchmark/results-stm32/tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build/27203/csv_results/md5sum.csv
+New run name is '#27203-tcwg_bmk-code_size-coremark/gnu_eabi-arm_eabi-master-O3_LTO-build (stm32:amd64)'
+$ ssh-agent -k
+unset SSH_AUTH_SOCK;
+unset SSH_AGENT_PID;
+echo Agent pid 31040 killed;
+[ssh-agent] Stopped.
+Archiving artifacts
+Email was triggered for: Success
+Sending email for trigger: Success
+#27202-tcwg_bmk-code_vect-spec2k6/gnu-arm-master-O3_LTO-bisect (sq:armhf) is still in progress; ignoring for purposes of comparison
+Failed to create e-mail address for ERROR:,File,'artifacts/jenkins/mail-recipients.txt',does,not,exist
+#27202-tcwg_bmk-code_vect-spec2k6/gnu-arm-master-O3_LTO-bisect (sq:armhf) is still in progress; ignoring for purposes of comparison
+An attempt to send an e-mail to empty list of recipients, ignored.
+Finished: SUCCESS