init: #17: 1: [TCWG CI] https://ci.linaro.org/job/tcwg_bmk-code_speed-cpu2017rate--llvm-arm-master-O3_LTO-build/17/

Results :
  | # reset_artifacts:
  | -10
  | # build_bmk_llvm:
  | -3
  | # benchmark -- -O3_LTO_marm:
  | 1

check_regression status : 0

3 files changed, 639 insertions, 0 deletions

diff --git a/03-benchmark/benchmark-build.log b/03-benchmark/benchmark-build.log
new file mode 100644
index 0000000..a01b9c9
--- /dev/null
+++ b/03-benchmark/benchmark-build.log
@@ -0,0 +1,320 @@
+Started TCWG Benchmark #28295
+Started from command line by tcwg-buildslave@linaro.org
+Running as SYSTEM
+[EnvInject] - Loading node environment variables.
+Building remotely on tcwg-bmk-bkp-01 (tcwg-bmk-coordinator tcwg-parallel-jobs tcwg) in workspace /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2
+[ssh-agent] Looking for ssh-agent implementation...
+[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
+$ ssh-agent
+SSH_AUTH_SOCK=/tmp/ssh-XXXXXXOPFzp0/agent.48898
+SSH_AGENT_PID=48900
+[ssh-agent] Started.
+Running ssh-add (command line suppressed)
+Identity added: /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2_tmp/private_key_3654387032541407572.key (/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2_tmp/private_key_3654387032541407572.key)
+[ssh-agent] Using credentials tcwg-benchmark (benchmark for TCWG machines)
+The recommended git tool is: NONE
+No credentials specified
+ > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2/jenkins-scripts/.git # timeout=10
+Fetching changes from the remote Git repository
+ > /usr/bin/git config remote.origin.url https://git.linaro.org/toolchain/jenkins-scripts.git # timeout=10
+Cleaning workspace
+ > /usr/bin/git rev-parse --verify HEAD # timeout=10
+Resetting working tree
+ > /usr/bin/git reset --hard # timeout=10
+ > /usr/bin/git clean -fdx # timeout=10
+Pruning obsolete local branches
+Fetching upstream changes from https://git.linaro.org/toolchain/jenkins-scripts.git
+ > /usr/bin/git --version # timeout=10
+ > git --version # 'git version 2.34.1'
+ > /usr/bin/git fetch --tags --force --progress --prune -- https://git.linaro.org/toolchain/jenkins-scripts.git +refs/heads/*:refs/remotes/origin/* +refs/changes/*:refs/changes/* # timeout=10
+ > /usr/bin/git rev-parse origin/master^{commit} # timeout=10
+Checking out Revision db9d4afdaa02cbc127011b8180484cf17b49d02e (origin/master)
+ > /usr/bin/git config core.sparsecheckout # timeout=10
+ > /usr/bin/git checkout -f db9d4afdaa02cbc127011b8180484cf17b49d02e # timeout=10
+Commit message: "ound-robin-notify.sh: mainy improve debug traces"
+ > /usr/bin/git rev-list --no-walk db9d4afdaa02cbc127011b8180484cf17b49d02e # timeout=10
+The recommended git tool is: NONE
+No credentials specified
+ > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2/bmk-scripts/.git # timeout=10
+Fetching changes from the remote Git repository
+ > /usr/bin/git config remote.origin.url https://git.linaro.org/toolchain/bmk-scripts.git # timeout=10
+Cleaning workspace
+ > /usr/bin/git rev-parse --verify HEAD # timeout=10
+Resetting working tree
+ > /usr/bin/git reset --hard # timeout=10
+ > /usr/bin/git clean -fdx # timeout=10
+Pruning obsolete local branches
+Fetching upstream changes from https://git.linaro.org/toolchain/bmk-scripts.git
+ > /usr/bin/git --version # timeout=10
+ > git --version # 'git version 2.34.1'
+ > /usr/bin/git fetch --tags --force --progress --prune -- https://git.linaro.org/toolchain/bmk-scripts.git +refs/heads/*:refs/remotes/origin/* +refs/changes/*:refs/changes/* # timeout=10
+ > /usr/bin/git rev-parse origin/master^{commit} # timeout=10
+Checking out Revision 6d19f8bf6f898623cccc69247567ee5d3261634d (origin/master)
+ > /usr/bin/git config core.sparsecheckout # timeout=10
+ > /usr/bin/git checkout -f 6d19f8bf6f898623cccc69247567ee5d3261634d # timeout=10
+Commit message: "break-up-bmks.sh: Remove workaround for noisy SPEC2k6 benchmarks"
+ > /usr/bin/git rev-list --no-walk 6d19f8bf6f898623cccc69247567ee5d3261634d # timeout=10
+No emails were triggered.
+New run name is '#28295-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf)'
+[tcwg-benchmark-tcwg-bmk-bkp-01_2] $ /bin/bash /tmp/jenkins10486732173065526112.sh
++ rm -rf artifacts
++ mkdir -p artifacts/jenkins
++ has_perf_logs=yes
++ case "$bmk_hw:$image_arch" in
++ hw_tag=tk1_32
+++ echo tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/@build_num@
+++ sed -e s/@build_num@/28295/g -e s/@hw_tag@/tk1_32/g
++ results_id=tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ idle_boards=0
++ total_boards=0
+++ set +f
+++ ls -tr /home/tcwg-benchmark/boards/tcwg-bmk-tk1-01.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-02.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-03.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-04.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-05.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-06.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-07.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-08.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-09.lock
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49019
++ flock -en -E 124 9
++ total_boards=1
++ '[' 0 = 124 ']'
++ idle_boards=1
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49020
++ flock -en -E 124 9
++ total_boards=2
++ '[' 0 = 124 ']'
++ idle_boards=2
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49021
++ flock -en -E 124 9
++ total_boards=3
++ '[' 0 = 124 ']'
++ idle_boards=3
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49022
++ flock -en -E 124 9
++ total_boards=4
++ '[' 0 = 124 ']'
++ idle_boards=4
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49023
++ flock -en -E 124 9
++ total_boards=5
++ '[' 0 = 124 ']'
++ idle_boards=5
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49024
++ flock -en -E 124 9
++ total_boards=6
++ '[' 0 = 124 ']'
++ idle_boards=6
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49025
++ flock -en -E 124 9
++ total_boards=7
++ '[' 0 = 124 ']'
++ idle_boards=7
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49026
++ flock -en -E 124 9
++ total_boards=8
++ '[' 0 = 124 ']'
++ idle_boards=8
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49027
++ flock -en -E 124 9
++ total_boards=9
++ '[' 0 = 124 ']'
++ idle_boards=9
++ n_boards=9
++ '[' 9 -lt 1 ']'
++ count=1
++ read -a bmks
+++ ./bmk-scripts/break-up-bmks.sh --bench_list spec2017_rate_nofortran --bmk_hw tk1 --n_boards 9 --run_profile serial --board_selection balance
++ cat
++ count=2
++ read -a bmks
++ cat
++ count=3
++ read -a bmks
++ cat
++ count=4
++ read -a bmks
++ cat
++ count=5
++ read -a bmks
++ cat
++ count=6
++ read -a bmks
++ cat
++ count=7
++ read -a bmks
++ cat
++ count=8
++ read -a bmks
++ cat
++ count=9
++ read -a bmks
++ cat
++ count=10
++ read -a bmks
++ cat
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113746 started.
+TCWG Benchmark_backend #113746-28295+1-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113747-28295+2-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113747-28295+2-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113748-28295+3-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113748-28295+3-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113749-28295+4-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113749-28295+4-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113750-28295+5-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113750-28295+5-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113751-28295+6-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113751-28295+6-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113752-28295+7-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113752-28295+7-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113753-28295+8-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113753-28295+8-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113754-28295+9-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113754-28295+9-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+[tcwg-benchmark-tcwg-bmk-bkp-01_2] $ /bin/bash /tmp/jenkins9785641721429605972.sh
++ . artifacts/bmk-info
+++ results_id=tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
+++ hw_tag=tk1_32
+++ has_perf_logs=yes
++ results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ csv_results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ rm -rf /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ mkdir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ ./bmk-scripts/gather-metrics.sh --results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295 --csv_results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results --hw_tag tk1_32 --has_perf_logs yes
+++ dirname ./bmk-scripts/gather-metrics.sh
++ bmk_scripts=./bmk-scripts
++ results_dir=undef
++ csv_results_dir=undef
++ hw_tag=undef
++ has_perf_logs=undef
++ interesting_symbols=
++ metrics=()
++ verbose=false
++ test 8 -gt 0
++ case $1 in
++ results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ shift
++ shift
++ test 6 -gt 0
++ case $1 in
++ csv_results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ shift
++ shift
++ test 4 -gt 0
++ case $1 in
++ hw_tag=tk1_32
++ shift
++ shift
++ test 2 -gt 0
++ case $1 in
++ has_perf_logs=yes
++ shift
++ shift
++ test 0 -gt 0
++ check_option /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295 'results_dir not set.'
++ local var=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ local 'msg=results_dir not set.'
++ '[' x/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295 = xundef ']'
++ check_option /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results 'csv_results_dir not set.'
++ local var=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ local 'msg=csv_results_dir not set.'
++ '[' x/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results = xundef ']'
++ check_option tk1_32 'hw_tag not set.'
++ local var=tk1_32
++ local 'msg=hw_tag not set.'
++ '[' xtk1_32 = xundef ']'
++ check_option yes 'has_perf_logs not set.'
++ local var=yes
++ local 'msg=has_perf_logs not set.'
++ '[' xyes = xundef ']'
++ '[' 0 = 0 ']'
++ metrics=(perf size vect sve md5sum)
++ mkdir -p /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ false
++ num_entries_opt=' '
++ gather_perf_data yes tk1_32 /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295 /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ local has_perf_logs=yes
++ local hw_tag=tk1_32
++ local results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ local csv_results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ '[' xyes = xyes ']'
++ ./bmk-scripts/perfdatadir2csv.sh --buildid-dir local --format sample --sort-field sample --perf-bin /usr/lib/linux-tools/tk1_32/perf --results-dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ '[' xyes = xyes ']'
++ bmk_name=spec
++ metrics=("${metrics[@]:1}")
++ merge_opts=("$csv_results_dir/perf.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/size-data-to-csv.py --bmk_name spec --out_csv_file /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/size.csv --perf_csv /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
+Warning: Executable not found for benchmark 508.namd_r
+Warning: Executable not found for benchmark 525.x264_r
+Warning: Executable not found for benchmark 510.parest_r
+Warning: Executable not found for benchmark 511.povray_r
+Warning: Executable not found for benchmark 526.blender_r
+Warning: Executable not found for benchmark 520.omnetpp_r
+Warning: Executable not found for benchmark 544.nab_r
+Warning: Executable not found for benchmark 538.imagick_r
+Warning: Executable not found for benchmark 502.gcc_r
+Warning: Executable not found for benchmark 500.perlbench_r
++ merge_opts+=("$csv_results_dir/$metric.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/vect-data-to-csv.py --bmk_name spec --out_csv_file /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/vect.csv --perf_csv /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ merge_opts+=("$csv_results_dir/$metric.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/sve-data-to-csv.py --bmk_name spec --out_csv_file /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/sve.csv --perf_csv /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
+Warning: Executable not found for benchmark 508.namd_r
+Warning: Executable not found for benchmark 525.x264_r
+Warning: Executable not found for benchmark 510.parest_r
+Warning: Executable not found for benchmark 511.povray_r
+Warning: Executable not found for benchmark 526.blender_r
+Warning: Executable not found for benchmark 520.omnetpp_r
+Warning: Executable not found for benchmark 544.nab_r
+Warning: Executable not found for benchmark 538.imagick_r
+Warning: Executable not found for benchmark 502.gcc_r
+Warning: Executable not found for benchmark 500.perlbench_r
++ merge_opts+=("$csv_results_dir/$metric.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/md5sum-data-to-csv.py --bmk_name spec --out_csv_file /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/md5sum.csv --perf_csv /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
+Traceback (most recent call last):
+  File "/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2/./bmk-scripts/md5sum-data-to-csv.py", line 92, in <module>
+    main()
+  File "/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2/./bmk-scripts/md5sum-data-to-csv.py", line 84, in main
+    sym_to_md5sum, exe_md5sum = calculate_md5sum(exe.path, symbols, interesting_symbols)
+  File "/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2/./bmk-scripts/md5sum-data-to-csv.py", line 37, in calculate_md5sum
+    if not interesting_symbols.issubset(set(sym_to_md5sum.keys())):
+AttributeError: 'dict' object has no attribute 'issubset'
+New run name is '#28295-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf)'
+$ ssh-agent -k
+unset SSH_AUTH_SOCK;
+unset SSH_AGENT_PID;
+echo Agent pid 48900 killed;
+[ssh-agent] Stopped.
+Archiving artifacts
+Email was triggered for: Success
+Sending email for trigger: Success
+#28294-tcwg_bmk-qc_speed-cpu2017rate/llvm-aarch64-master-O2_LTO-build (qc:arm64) is still in progress; ignoring for purposes of comparison
+Failed to create e-mail address for ERROR:,File,'artifacts/jenkins/mail-recipients.txt',does,not,exist
+#28294-tcwg_bmk-qc_speed-cpu2017rate/llvm-aarch64-master-O2_LTO-build (qc:arm64) is still in progress; ignoring for purposes of comparison
+An attempt to send an e-mail to empty list of recipients, ignored.
+Finished: SUCCESS
+Completed TCWG Benchmark #28295-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) : SUCCESS
diff --git a/03-benchmark/benchmark.log b/03-benchmark/benchmark.log
new file mode 100644
index 0000000..bf08d28
--- /dev/null
+++ b/03-benchmark/benchmark.log
@@ -0,0 +1,319 @@
+Started TCWG Benchmark #28295
+Started from command line by tcwg-buildslave@linaro.org
+Running as SYSTEM
+[EnvInject] - Loading node environment variables.
+Building remotely on tcwg-bmk-bkp-01 (tcwg-bmk-coordinator tcwg-parallel-jobs tcwg) in workspace /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2
+[ssh-agent] Looking for ssh-agent implementation...
+[ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine)
+$ ssh-agent
+SSH_AUTH_SOCK=/tmp/ssh-XXXXXXOPFzp0/agent.48898
+SSH_AGENT_PID=48900
+[ssh-agent] Started.
+Running ssh-add (command line suppressed)
+Identity added: /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2_tmp/private_key_3654387032541407572.key (/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2_tmp/private_key_3654387032541407572.key)
+[ssh-agent] Using credentials tcwg-benchmark (benchmark for TCWG machines)
+The recommended git tool is: NONE
+No credentials specified
+ > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2/jenkins-scripts/.git # timeout=10
+Fetching changes from the remote Git repository
+ > /usr/bin/git config remote.origin.url https://git.linaro.org/toolchain/jenkins-scripts.git # timeout=10
+Cleaning workspace
+ > /usr/bin/git rev-parse --verify HEAD # timeout=10
+Resetting working tree
+ > /usr/bin/git reset --hard # timeout=10
+ > /usr/bin/git clean -fdx # timeout=10
+Pruning obsolete local branches
+Fetching upstream changes from https://git.linaro.org/toolchain/jenkins-scripts.git
+ > /usr/bin/git --version # timeout=10
+ > git --version # 'git version 2.34.1'
+ > /usr/bin/git fetch --tags --force --progress --prune -- https://git.linaro.org/toolchain/jenkins-scripts.git +refs/heads/*:refs/remotes/origin/* +refs/changes/*:refs/changes/* # timeout=10
+ > /usr/bin/git rev-parse origin/master^{commit} # timeout=10
+Checking out Revision db9d4afdaa02cbc127011b8180484cf17b49d02e (origin/master)
+ > /usr/bin/git config core.sparsecheckout # timeout=10
+ > /usr/bin/git checkout -f db9d4afdaa02cbc127011b8180484cf17b49d02e # timeout=10
+Commit message: "ound-robin-notify.sh: mainy improve debug traces"
+ > /usr/bin/git rev-list --no-walk db9d4afdaa02cbc127011b8180484cf17b49d02e # timeout=10
+The recommended git tool is: NONE
+No credentials specified
+ > /usr/bin/git rev-parse --resolve-git-dir /home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2/bmk-scripts/.git # timeout=10
+Fetching changes from the remote Git repository
+ > /usr/bin/git config remote.origin.url https://git.linaro.org/toolchain/bmk-scripts.git # timeout=10
+Cleaning workspace
+ > /usr/bin/git rev-parse --verify HEAD # timeout=10
+Resetting working tree
+ > /usr/bin/git reset --hard # timeout=10
+ > /usr/bin/git clean -fdx # timeout=10
+Pruning obsolete local branches
+Fetching upstream changes from https://git.linaro.org/toolchain/bmk-scripts.git
+ > /usr/bin/git --version # timeout=10
+ > git --version # 'git version 2.34.1'
+ > /usr/bin/git fetch --tags --force --progress --prune -- https://git.linaro.org/toolchain/bmk-scripts.git +refs/heads/*:refs/remotes/origin/* +refs/changes/*:refs/changes/* # timeout=10
+ > /usr/bin/git rev-parse origin/master^{commit} # timeout=10
+Checking out Revision 6d19f8bf6f898623cccc69247567ee5d3261634d (origin/master)
+ > /usr/bin/git config core.sparsecheckout # timeout=10
+ > /usr/bin/git checkout -f 6d19f8bf6f898623cccc69247567ee5d3261634d # timeout=10
+Commit message: "break-up-bmks.sh: Remove workaround for noisy SPEC2k6 benchmarks"
+ > /usr/bin/git rev-list --no-walk 6d19f8bf6f898623cccc69247567ee5d3261634d # timeout=10
+No emails were triggered.
+New run name is '#28295-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf)'
+[tcwg-benchmark-tcwg-bmk-bkp-01_2] $ /bin/bash /tmp/jenkins10486732173065526112.sh
++ rm -rf artifacts
++ mkdir -p artifacts/jenkins
++ has_perf_logs=yes
++ case "$bmk_hw:$image_arch" in
++ hw_tag=tk1_32
+++ echo tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/@build_num@
+++ sed -e s/@build_num@/28295/g -e s/@hw_tag@/tk1_32/g
++ results_id=tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ idle_boards=0
++ total_boards=0
+++ set +f
+++ ls -tr /home/tcwg-benchmark/boards/tcwg-bmk-tk1-01.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-02.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-03.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-04.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-05.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-06.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-07.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-08.lock /home/tcwg-benchmark/boards/tcwg-bmk-tk1-09.lock
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49019
++ flock -en -E 124 9
++ total_boards=1
++ '[' 0 = 124 ']'
++ idle_boards=1
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49020
++ flock -en -E 124 9
++ total_boards=2
++ '[' 0 = 124 ']'
++ idle_boards=2
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49021
++ flock -en -E 124 9
++ total_boards=3
++ '[' 0 = 124 ']'
++ idle_boards=3
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49022
++ flock -en -E 124 9
++ total_boards=4
++ '[' 0 = 124 ']'
++ idle_boards=4
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49023
++ flock -en -E 124 9
++ total_boards=5
++ '[' 0 = 124 ']'
++ idle_boards=5
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49024
++ flock -en -E 124 9
++ total_boards=6
++ '[' 0 = 124 ']'
++ idle_boards=6
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49025
++ flock -en -E 124 9
++ total_boards=7
++ '[' 0 = 124 ']'
++ idle_boards=7
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49026
++ flock -en -E 124 9
++ total_boards=8
++ '[' 0 = 124 ']'
++ idle_boards=8
++ for lock in $(set +f; ls -tr $HOME/boards/tcwg-bmk-$bmk_hw-*.lock)
++ res=0
++ wait 49027
++ flock -en -E 124 9
++ total_boards=9
++ '[' 0 = 124 ']'
++ idle_boards=9
++ n_boards=9
++ '[' 9 -lt 1 ']'
++ count=1
++ read -a bmks
+++ ./bmk-scripts/break-up-bmks.sh --bench_list spec2017_rate_nofortran --bmk_hw tk1 --n_boards 9 --run_profile serial --board_selection balance
++ cat
++ count=2
++ read -a bmks
++ cat
++ count=3
++ read -a bmks
++ cat
++ count=4
++ read -a bmks
++ cat
++ count=5
++ read -a bmks
++ cat
++ count=6
++ read -a bmks
++ cat
++ count=7
++ read -a bmks
++ cat
++ count=8
++ read -a bmks
++ cat
++ count=9
++ read -a bmks
++ cat
++ count=10
++ read -a bmks
++ cat
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113746 started.
+TCWG Benchmark_backend #113746-28295+1-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113747-28295+2-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113747-28295+2-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113748-28295+3-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113748-28295+3-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113749-28295+4-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113749-28295+4-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113750-28295+5-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113750-28295+5-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113751-28295+6-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113751-28295+6-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113752-28295+7-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113752-28295+7-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113753-28295+8-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113753-28295+8-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+Waiting for the completion of TCWG Benchmark_backend
+TCWG Benchmark_backend #113754-28295+9-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) started.
+TCWG Benchmark_backend #113754-28295+9-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf) completed. Result was SUCCESS
+[tcwg-benchmark-tcwg-bmk-bkp-01_2] $ /bin/bash /tmp/jenkins9785641721429605972.sh
++ . artifacts/bmk-info
+++ results_id=tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
+++ hw_tag=tk1_32
+++ has_perf_logs=yes
++ results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ csv_results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ rm -rf /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ mkdir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ ./bmk-scripts/gather-metrics.sh --results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295 --csv_results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results --hw_tag tk1_32 --has_perf_logs yes
+++ dirname ./bmk-scripts/gather-metrics.sh
++ bmk_scripts=./bmk-scripts
++ results_dir=undef
++ csv_results_dir=undef
++ hw_tag=undef
++ has_perf_logs=undef
++ interesting_symbols=
++ metrics=()
++ verbose=false
++ test 8 -gt 0
++ case $1 in
++ results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ shift
++ shift
++ test 6 -gt 0
++ case $1 in
++ csv_results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ shift
++ shift
++ test 4 -gt 0
++ case $1 in
++ hw_tag=tk1_32
++ shift
++ shift
++ test 2 -gt 0
++ case $1 in
++ has_perf_logs=yes
++ shift
++ shift
++ test 0 -gt 0
++ check_option /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295 'results_dir not set.'
++ local var=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ local 'msg=results_dir not set.'
++ '[' x/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295 = xundef ']'
++ check_option /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results 'csv_results_dir not set.'
++ local var=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ local 'msg=csv_results_dir not set.'
++ '[' x/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results = xundef ']'
++ check_option tk1_32 'hw_tag not set.'
++ local var=tk1_32
++ local 'msg=hw_tag not set.'
++ '[' xtk1_32 = xundef ']'
++ check_option yes 'has_perf_logs not set.'
++ local var=yes
++ local 'msg=has_perf_logs not set.'
++ '[' xyes = xundef ']'
++ '[' 0 = 0 ']'
++ metrics=(perf size vect sve md5sum)
++ mkdir -p /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ false
++ num_entries_opt=' '
++ gather_perf_data yes tk1_32 /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295 /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ local has_perf_logs=yes
++ local hw_tag=tk1_32
++ local results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ local csv_results_dir=/home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results
++ '[' xyes = xyes ']'
++ ./bmk-scripts/perfdatadir2csv.sh --buildid-dir local --format sample --sort-field sample --perf-bin /usr/lib/linux-tools/tk1_32/perf --results-dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ '[' xyes = xyes ']'
++ bmk_name=spec
++ metrics=("${metrics[@]:1}")
++ merge_opts=("$csv_results_dir/perf.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/size-data-to-csv.py --bmk_name spec --out_csv_file /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/size.csv --perf_csv /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
+Warning: Executable not found for benchmark 508.namd_r
+Warning: Executable not found for benchmark 525.x264_r
+Warning: Executable not found for benchmark 510.parest_r
+Warning: Executable not found for benchmark 511.povray_r
+Warning: Executable not found for benchmark 526.blender_r
+Warning: Executable not found for benchmark 520.omnetpp_r
+Warning: Executable not found for benchmark 544.nab_r
+Warning: Executable not found for benchmark 538.imagick_r
+Warning: Executable not found for benchmark 502.gcc_r
+Warning: Executable not found for benchmark 500.perlbench_r
++ merge_opts+=("$csv_results_dir/$metric.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/vect-data-to-csv.py --bmk_name spec --out_csv_file /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/vect.csv --perf_csv /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
++ merge_opts+=("$csv_results_dir/$metric.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/sve-data-to-csv.py --bmk_name spec --out_csv_file /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/sve.csv --perf_csv /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
+Warning: Executable not found for benchmark 508.namd_r
+Warning: Executable not found for benchmark 525.x264_r
+Warning: Executable not found for benchmark 510.parest_r
+Warning: Executable not found for benchmark 511.povray_r
+Warning: Executable not found for benchmark 526.blender_r
+Warning: Executable not found for benchmark 520.omnetpp_r
+Warning: Executable not found for benchmark 544.nab_r
+Warning: Executable not found for benchmark 538.imagick_r
+Warning: Executable not found for benchmark 502.gcc_r
+Warning: Executable not found for benchmark 500.perlbench_r
++ merge_opts+=("$csv_results_dir/$metric.csv")
++ for metric in "${metrics[@]}"
++ ./bmk-scripts/md5sum-data-to-csv.py --bmk_name spec --out_csv_file /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/md5sum.csv --perf_csv /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295/csv_results/perf.csv --results_dir /home/tcwg-benchmark/results-tk1_32/tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build/28295
+Traceback (most recent call last):
+  File "/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2/./bmk-scripts/md5sum-data-to-csv.py", line 92, in <module>
+    main()
+  File "/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2/./bmk-scripts/md5sum-data-to-csv.py", line 84, in main
+    sym_to_md5sum, exe_md5sum = calculate_md5sum(exe.path, symbols, interesting_symbols)
+  File "/home/tcwg-benchmark/workspace/tcwg-benchmark-tcwg-bmk-bkp-01_2/./bmk-scripts/md5sum-data-to-csv.py", line 37, in calculate_md5sum
+    if not interesting_symbols.issubset(set(sym_to_md5sum.keys())):
+AttributeError: 'dict' object has no attribute 'issubset'
+New run name is '#28295-tcwg_bmk-code_speed-cpu2017rate/llvm-arm-master-O3_LTO-build (tk1:armhf)'
+$ ssh-agent -k
+unset SSH_AUTH_SOCK;
+unset SSH_AGENT_PID;
+echo Agent pid 48900 killed;
+[ssh-agent] Stopped.
+Archiving artifacts
+Email was triggered for: Success
+Sending email for trigger: Success
+#28294-tcwg_bmk-qc_speed-cpu2017rate/llvm-aarch64-master-O2_LTO-build (qc:arm64) is still in progress; ignoring for purposes of comparison
+Failed to create e-mail address for ERROR:,File,'artifacts/jenkins/mail-recipients.txt',does,not,exist
+#28294-tcwg_bmk-qc_speed-cpu2017rate/llvm-aarch64-master-O2_LTO-build (qc:arm64) is still in progress; ignoring for purposes of comparison
+An attempt to send an e-mail to empty list of recipients, ignored.
+Finished: SUCCESS
diff --git a/03-benchmark/console.log.xz b/03-benchmark/console.log.xz
new file mode 100644
index 0000000..859e5b8
--- /dev/null
+++ b/03-benchmark/console.log.xz