onsuccess: #62: 1: [TCWG CI] https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-O3_LTO-build/62/

Results :
  | # reset_artifacts:
  | -10
  | # build_bmk_llvm:
  | -3
  | # benchmark -- -O3_LTO:
  | 1

check_regression status : 0

13 files changed, 28 insertions, 151 deletions

diff --git a/notify/exe.regression b/notify/exe.regression
deleted file mode 100644
index f6fb8f3..0000000
--- a/notify/exe.regression
+++ /dev/null
@@ -1 +0,0 @@
-2,602.gcc_s,sgcc_base.default,602.gcc_s grew in size by 2%,602.gcc_s grew in size by 2% from 10908217 to 11129353 bytes

diff --git a/notify/extra-bisect-params b/notify/extra-bisect-params
index ed56839..fa6c7c9 100644
--- a/notify/extra-bisect-params
+++ b/notify/extra-bisect-params
@@ -1 +1 @@
-extra_build_params=++benchmarks 602.gcc_s 
+extra_build_params=
diff --git a/notify/jira/comments.txt b/notify/jira/comments.txt
index 6bcec47..2a63aeb 100644
--- a/notify/jira/comments.txt
+++ b/notify/jira/comments.txt
@@ -1,8 +1,3 @@
-[LLVM-922]
-602.gcc_s grew in size by 2%
-Details: https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-O3_LTO-build/61/artifact/artifacts/notify/mail-body.txt/*view*/
-
 [LLVM-651]
-https://linaro.atlassian.net/browse/LLVM-922
-602.gcc_s grew in size by 2%
-Details: https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-O3_LTO-build/61/artifact/artifacts/notify/mail-body.txt/*view*/
+No change
+Details: https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-O3_LTO-build/62/artifact/artifacts/notify/mail-body.txt/*view*/
diff --git a/notify/jira/components b/notify/jira/components
deleted file mode 100644
index e822653..0000000
--- a/notify/jira/components
+++ /dev/null
@@ -1 +0,0 @@
-CI,LLVM
diff --git a/notify/jira/description b/notify/jira/description
deleted file mode 100644
index 418d160..0000000
--- a/notify/jira/description
+++ /dev/null
@@ -1,24 +0,0 @@
-commit llvmorg-18-init-3041-g386aa2ab9d19
-Author: Alexandros Lamprineas <alexandros.lamprineas@arm.com>
-Date:   Mon Aug 21 12:58:52 2023 +0100
-
-    [FuncSpec] Increase the maximum number of times the specializer can run.
-    
-    * Changes the default value of FuncSpecMaxIters from 1 to 10.
-      This allows specialization of recursive functions.
-    * Adds an option to control the maximum codesize growth per function.
-    * Measured ~45% performance uplift for SPEC2017:548.exchange2_r on
-      AWS Graviton3.
-... 2 lines of the commit log omitted.
-
-* tcwg_bmk-code_size-cpu2017fast
-** llvm-aarch64-master-O2_LTO
-*** No change
-** llvm-aarch64-master-O3_LTO
-*** 602.gcc_s grew in size by 2%
-*** https://git.linaro.org/toolchain/ci/interesting-commits.git/plain/llvm/sha1/386aa2ab9d19c783deb9fbfb3b9be14754ba8789/tcwg_bmk-code_size-cpu2017fast/llvm-aarch64-master-O3_LTO/details.txt
-*** https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-O3_LTO-build/61/
-* tcwg_bmk-code_size-cpu2017rate
-** llvm-arm-master-O2_LTO
-*** No change
-*** https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--llvm-arm-master-O2_LTO-build/54/
diff --git a/notify/jira/key b/notify/jira/key
deleted file mode 100644
index c2a9e73..0000000
--- a/notify/jira/key
+++ /dev/null
@@ -1 +0,0 @@
-LLVM-922
diff --git a/notify/jira/startdate b/notify/jira/startdate
deleted file mode 100644
index 2e04c2f..0000000
--- a/notify/jira/startdate
+++ /dev/null
@@ -1 +0,0 @@
-2023-08-22
diff --git a/notify/jira/summary b/notify/jira/summary
deleted file mode 100644
index 2075573..0000000
--- a/notify/jira/summary
+++ /dev/null
@@ -1 +0,0 @@
-llvmorg-18-init-3041-g386aa2ab9d19: 602.gcc_s grew in size by 2%
diff --git a/notify/jira/yaml b/notify/jira/yaml
deleted file mode 100644
index 43ee4a5..0000000
--- a/notify/jira/yaml
+++ /dev/null
@@ -1,32 +0,0 @@
-- Project: LLVM
-  IssueType: Sub-task
-  Key: LLVM-922
-  Summary: |
-    llvmorg-18-init-3041-g386aa2ab9d19: 602.gcc_s grew in size by 2%
-  Components: CI,LLVM
-  Start date: 2023-08-22
-  Description: |
-    commit llvmorg-18-init-3041-g386aa2ab9d19
-    Author: Alexandros Lamprineas <alexandros.lamprineas@arm.com>
-    Date:   Mon Aug 21 12:58:52 2023 +0100
-    
-        [FuncSpec] Increase the maximum number of times the specializer can run.
-        
-        * Changes the default value of FuncSpecMaxIters from 1 to 10.
-          This allows specialization of recursive functions.
-        * Adds an option to control the maximum codesize growth per function.
-        * Measured ~45% performance uplift for SPEC2017:548.exchange2_r on
-          AWS Graviton3.
-    ... 2 lines of the commit log omitted.
-    
-    * tcwg_bmk-code_size-cpu2017fast
-    ** llvm-aarch64-master-O2_LTO
-    *** No change
-    ** llvm-aarch64-master-O3_LTO
-    *** 602.gcc_s grew in size by 2%
-    *** https://git.linaro.org/toolchain/ci/interesting-commits.git/plain/llvm/sha1/386aa2ab9d19c783deb9fbfb3b9be14754ba8789/tcwg_bmk-code_size-cpu2017fast/llvm-aarch64-master-O3_LTO/details.txt
-    *** https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-O3_LTO-build/61/
-    * tcwg_bmk-code_size-cpu2017rate
-    ** llvm-arm-master-O2_LTO
-    *** No change
-    *** https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--llvm-arm-master-O2_LTO-build/54/
diff --git a/notify/mail-body.txt b/notify/mail-body.txt
index 87fc8d9..96b145c 100644
--- a/notify/mail-body.txt
+++ b/notify/mail-body.txt
@@ -4,21 +4,15 @@ Please find some details below.  If you have any questions, please follow up on
 
 In CI config tcwg_bmk-code_size-cpu2017fast/llvm-aarch64-master-O3_LTO after:
 
-  | commit llvmorg-18-init-3041-g386aa2ab9d19
-  | Author: Alexandros Lamprineas <alexandros.lamprineas@arm.com>
-  | Date:   Mon Aug 21 12:58:52 2023 +0100
-  | 
-  |     [FuncSpec] Increase the maximum number of times the specializer can run.
-  |     
-  |     * Changes the default value of FuncSpecMaxIters from 1 to 10.
-  |       This allows specialization of recursive functions.
-  |     * Adds an option to control the maximum codesize growth per function.
-  |     * Measured ~45% performance uplift for SPEC2017:548.exchange2_r on
-  |       AWS Graviton3.
-  | ... 2 lines of the commit log omitted.
-
-the following benchmarks grew in size by more than 1%:
-- 602.gcc_s grew in size by 2% from 10908217 to 11129353 bytes

+  | 1579 commits in llvm
+  | aa2adc1283ec [mlir][index] Fix side effect modeling for division by zero ops
+  | b3a5f5394f1f [mlir] Add `empty` to `StringAttr`
+  | 8e3883a43b8d [mlir][ub] Fix typo in `ub.poison` op documentation (NFC)
+  | 17f747b30433 [polly] Dynamic libraries are not supported on Cygwin
+  | efec733bf5bb Revert "[lit] Echo full RUN lines in case of external shells"
+  | ... and 1574 more commits in llvm
+
+No change
 
 Below reproducer instructions can be used to re-build both "first_bad" and "last_good" cross-toolchains used in this bisection.  Naturally, the scripts will fail when triggerring benchmarking jobs if you don\'t have access to Linaro TCWG CI.
 
@@ -35,25 +29,6 @@ This benchmarking CI is work-in-progress, and we welcome feedback and suggestion
 -----------------8<--------------------------8<--------------------------8<--------------------------
 The information below can be used to reproduce a debug environment:
 
-Current build   : https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-O3_LTO-build/61/artifact/artifacts
-Reference build : https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-O3_LTO-build/60/artifact/artifacts
-
-Reproduce last good and first bad builds: https://git.linaro.org/toolchain/ci/interesting-commits.git/plain/llvm/sha1/386aa2ab9d19c783deb9fbfb3b9be14754ba8789/tcwg_bmk-code_size-cpu2017fast/llvm-aarch64-master-O3_LTO/reproduction_instructions.txt
-
-Full commit : https://github.com/llvm/llvm-project/commit/386aa2ab9d19c783deb9fbfb3b9be14754ba8789
-
-Latest bug report status : https://linaro.atlassian.net/browse/LLVM-922
-
-List of configurations that regressed due to this commit :
-* tcwg_bmk-code_size-cpu2017fast
-** llvm-aarch64-master-O2_LTO
-*** No change
-** llvm-aarch64-master-O3_LTO
-*** 602.gcc_s grew in size by 2%
-*** https://git.linaro.org/toolchain/ci/interesting-commits.git/plain/llvm/sha1/386aa2ab9d19c783deb9fbfb3b9be14754ba8789/tcwg_bmk-code_size-cpu2017fast/llvm-aarch64-master-O3_LTO/details.txt
-*** https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-O3_LTO-build/61/
-* tcwg_bmk-code_size-cpu2017rate
-** llvm-arm-master-O2_LTO
-*** No change
-*** https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017rate--llvm-arm-master-O2_LTO-build/54/
+Current build   : https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-O3_LTO-build/62/artifact/artifacts
+Reference build : https://ci.linaro.org/job/tcwg_bmk-code_size-cpu2017fast--llvm-aarch64-master-O3_LTO-build/61/artifact/artifacts
 
diff --git a/notify/mail-subject.txt b/notify/mail-subject.txt
index 72b57aa..160aae2 100644
--- a/notify/mail-subject.txt
+++ b/notify/mail-subject.txt
@@ -1 +1 @@
-[Linaro-TCWG-CI] llvmorg-18-init-3041-g386aa2ab9d19: 602.gcc_s grew in size by 2%
+[Linaro-TCWG-CI] 1579 commits in llvm: No change
diff --git a/notify/output-bmk-results.log b/notify/output-bmk-results.log
index 6986a14..62f6576 100644
--- a/notify/output-bmk-results.log
+++ b/notify/output-bmk-results.log
@@ -138,7 +138,7 @@ output-bmk-results.py(111):     return default_threshold[(change_kind,metric,mod
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
 output-bmk-results.py(213):              .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold))
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
-DEBUG: checking exe.regression : 511.povray_r,povray_r_base.default : size=-1% (threshold=1%)
+DEBUG: checking exe.regression : 511.povray_r,povray_r_base.default : size=0% (threshold=1%)
 output-bmk-results.py(216):         if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold):
  --- modulename: output-bmk-results, funcname: is_entry_regression
 output-bmk-results.py(167):     if metric in metric_utils.higher_regress_metrics:
@@ -183,45 +183,12 @@ output-bmk-results.py(111):     return default_threshold[(change_kind,metric,mod
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
 output-bmk-results.py(213):              .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold))
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
-DEBUG: checking exe.regression : 602.gcc_s,sgcc_base.default : size=-2% (threshold=1%)
+DEBUG: checking exe.regression : 602.gcc_s,sgcc_base.default : size=0% (threshold=1%)
 output-bmk-results.py(216):         if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold):
  --- modulename: output-bmk-results, funcname: is_entry_regression
 output-bmk-results.py(167):     if metric in metric_utils.higher_regress_metrics:
 output-bmk-results.py(168):         return (result - 100 > threshold)
-output-bmk-results.py(219):         percent_change, short_diag, long_diag = get_short_long_diag(row, metric, sym_type, change_kind)
- --- modulename: output-bmk-results, funcname: get_short_long_diag
-output-bmk-results.py(114):     bmk = row["benchmark"]
-output-bmk-results.py(115):     rel_value = row["rel_" + metric]
-output-bmk-results.py(116):     prev_value = row[metric + "_x"]
-output-bmk-results.py(117):     curr_value = row[metric + "_y"]
-output-bmk-results.py(119):     if metric == "sample":
-output-bmk-results.py(136):     suffix = ""
-output-bmk-results.py(137):     if metric == "sample":
-output-bmk-results.py(141):     elif metric == "size":
-output-bmk-results.py(142):         prefix_regression = "grew in size by"
-output-bmk-results.py(143):         prefix_improvement = "reduced in size by"
-output-bmk-results.py(144):         suffix = "bytes"
-output-bmk-results.py(151):     if sym_type=="symbol":
-output-bmk-results.py(154):       item=bmk
-output-bmk-results.py(156):     short_diag = "{0} {1} {2}%".format(item, locals()["prefix_" + change_kind], abs(rel_value - 100))
-output-bmk-results.py(157):     long_diag = "{0} from {1} to {2} {3}".format(short_diag, prev_value, curr_value, suffix)
-output-bmk-results.py(158):     return abs(rel_value - 100), short_diag, long_diag
-output-bmk-results.py(223):         if metric == "sample" \
-output-bmk-results.py(230):         print("DEBUG: *** {0},{1} : {2}".format(row["benchmark"], row["symbol"], long_diag))
-DEBUG: *** 602.gcc_s,sgcc_base.default : 602.gcc_s grew in size by 2% from 10908217 to 11129353 bytes
-output-bmk-results.py(232):         f_out.write_csv((percent_change, row["benchmark"], row["symbol"], short_diag, long_diag))
- --- modulename: output-bmk-results, funcname: write_csv
-output-bmk-results.py(41):     if not self.predicate or not self.csvwriter:
-output-bmk-results.py(43):     self.csvwriter.writerow(arr)
-output-bmk-results.py(233):         if change_kind == "regression":
-output-bmk-results.py(234):             f_regr.write("# {0},{1}\n".format(row["symbol"], long_diag))
- --- modulename: output-bmk-results, funcname: write
-output-bmk-results.py(36):     if not self.predicate or not self.outf:
-output-bmk-results.py(38):     self.outf.write(string)
-output-bmk-results.py(235):             f_ebp.write("++benchmarks {0} ".format(row["benchmark"]))
- --- modulename: output-bmk-results, funcname: write
-output-bmk-results.py(36):     if not self.predicate or not self.outf:
-output-bmk-results.py(38):     self.outf.write(string)
+output-bmk-results.py(217):             continue
 output-bmk-results.py(208):     for index, row in out_df.iterrows():
 output-bmk-results.py(210):         threshold = get_threshold(sym_type, metric, mode, row["benchmark"], row["symbol"])
  --- modulename: output-bmk-results, funcname: get_threshold
@@ -393,6 +360,7 @@ output-bmk-results.py(237):     f_out.close()
 output-bmk-results.py(29):     if not self.outf:
 output-bmk-results.py(31):     self.outf.close()
 output-bmk-results.py(32):     if os.stat(self.filename).st_size == 0:
+output-bmk-results.py(33):        os.remove(self.filename)
 output-bmk-results.py(255):     output_bmk_results_1(exe_df, "exe", "improvement", None, f_skip, None, run_step_artifacts, metric, mode, details)
  --- modulename: output-bmk-results, funcname: output_bmk_results_1
 output-bmk-results.py(202):     f_out = Outfile("{0}/{1}.{2}".format(run_step_artifacts, sym_type, change_kind), "w", predicate=(details=="verbose"))
@@ -443,7 +411,7 @@ output-bmk-results.py(111):     return default_threshold[(change_kind,metric,mod
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
 output-bmk-results.py(213):              .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold))
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
-DEBUG: checking exe.improvement : 511.povray_r,povray_r_base.default : size=-1% (threshold=1%)
+DEBUG: checking exe.improvement : 511.povray_r,povray_r_base.default : size=0% (threshold=1%)
 output-bmk-results.py(216):         if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold):
  --- modulename: output-bmk-results, funcname: is_entry_improvement
 output-bmk-results.py(176):     if metric in metric_utils.higher_regress_metrics:
@@ -488,7 +456,7 @@ output-bmk-results.py(111):     return default_threshold[(change_kind,metric,mod
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
 output-bmk-results.py(213):              .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold))
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
-DEBUG: checking exe.improvement : 602.gcc_s,sgcc_base.default : size=-2% (threshold=1%)
+DEBUG: checking exe.improvement : 602.gcc_s,sgcc_base.default : size=0% (threshold=1%)
 output-bmk-results.py(216):         if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold):
  --- modulename: output-bmk-results, funcname: is_entry_improvement
 output-bmk-results.py(176):     if metric in metric_utils.higher_regress_metrics:
@@ -686,7 +654,7 @@ output-bmk-results.py(111):     return default_threshold[(change_kind,metric,mod
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
 output-bmk-results.py(213):              .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold))
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
-DEBUG: checking symbol.regression : 607.cactuBSSN_s,libomp.so : size=0% (threshold=10%)
+DEBUG: checking symbol.regression : 607.cactuBSSN_s,libomp.so : size=-1% (threshold=10%)
 output-bmk-results.py(216):         if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold):
  --- modulename: output-bmk-results, funcname: is_entry_regression
 output-bmk-results.py(167):     if metric in metric_utils.higher_regress_metrics:
@@ -701,7 +669,7 @@ output-bmk-results.py(111):     return default_threshold[(change_kind,metric,mod
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
 output-bmk-results.py(213):              .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold))
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
-DEBUG: checking symbol.regression : 619.lbm_s,libomp.so : size=0% (threshold=10%)
+DEBUG: checking symbol.regression : 619.lbm_s,libomp.so : size=-1% (threshold=10%)
 output-bmk-results.py(216):         if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold):
  --- modulename: output-bmk-results, funcname: is_entry_regression
 output-bmk-results.py(167):     if metric in metric_utils.higher_regress_metrics:
@@ -731,7 +699,7 @@ output-bmk-results.py(111):     return default_threshold[(change_kind,metric,mod
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
 output-bmk-results.py(213):              .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold))
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
-DEBUG: checking symbol.regression : 644.nab_s,libomp.so : size=0% (threshold=10%)
+DEBUG: checking symbol.regression : 644.nab_s,libomp.so : size=-1% (threshold=10%)
 output-bmk-results.py(216):         if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold):
  --- modulename: output-bmk-results, funcname: is_entry_regression
 output-bmk-results.py(167):     if metric in metric_utils.higher_regress_metrics:
@@ -764,7 +732,7 @@ output-bmk-results.py(111):     return default_threshold[(change_kind,metric,mod
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
 output-bmk-results.py(213):              .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold))
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
-DEBUG: checking symbol.improvement : 607.cactuBSSN_s,libomp.so : size=0% (threshold=10%)
+DEBUG: checking symbol.improvement : 607.cactuBSSN_s,libomp.so : size=-1% (threshold=10%)
 output-bmk-results.py(216):         if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold):
  --- modulename: output-bmk-results, funcname: is_entry_improvement
 output-bmk-results.py(176):     if metric in metric_utils.higher_regress_metrics:
@@ -779,7 +747,7 @@ output-bmk-results.py(111):     return default_threshold[(change_kind,metric,mod
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
 output-bmk-results.py(213):              .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold))
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
-DEBUG: checking symbol.improvement : 619.lbm_s,libomp.so : size=0% (threshold=10%)
+DEBUG: checking symbol.improvement : 619.lbm_s,libomp.so : size=-1% (threshold=10%)
 output-bmk-results.py(216):         if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold):
  --- modulename: output-bmk-results, funcname: is_entry_improvement
 output-bmk-results.py(176):     if metric in metric_utils.higher_regress_metrics:
@@ -809,7 +777,7 @@ output-bmk-results.py(111):     return default_threshold[(change_kind,metric,mod
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
 output-bmk-results.py(213):              .format(sym_type, change_kind, row["benchmark"], row["symbol"], metric, 100-row["rel_" + metric], threshold))
 output-bmk-results.py(212):         print("DEBUG: checking {0}.{1} : {2},{3} : {4}={5}% (threshold={6}%)"\
-DEBUG: checking symbol.improvement : 644.nab_s,libomp.so : size=0% (threshold=10%)
+DEBUG: checking symbol.improvement : 644.nab_s,libomp.so : size=-1% (threshold=10%)
 output-bmk-results.py(216):         if not is_entry_xxx[change_kind](metric, row["rel_" + metric], threshold):
  --- modulename: output-bmk-results, funcname: is_entry_improvement
 output-bmk-results.py(176):     if metric in metric_utils.higher_regress_metrics:
@@ -837,6 +805,7 @@ output-bmk-results.py(263):     f_regr.close()
 output-bmk-results.py(29):     if not self.outf:
 output-bmk-results.py(31):     self.outf.close()
 output-bmk-results.py(32):     if os.stat(self.filename).st_size == 0:
+output-bmk-results.py(33):        os.remove(self.filename)
 output-bmk-results.py(264):     f_ebp.close()
  --- modulename: output-bmk-results, funcname: close
 output-bmk-results.py(29):     if not self.outf:
diff --git a/notify/results.regressions b/notify/results.regressions
deleted file mode 100644
index de1843b..0000000
--- a/notify/results.regressions
+++ /dev/null
@@ -1 +0,0 @@
-# sgcc_base.default,602.gcc_s grew in size by 2% from 10908217 to 11129353 bytes