summaryrefslogtreecommitdiff
path: root/notify/results.compare
blob: 521f8aa44b403192327e330a562e83f44417bd33 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
# Comparing directories
# REFERENCE: base-artifacts/sumfiles
# CURRENT:   artifacts/99-rewrite/artifacts.old/sumfiles

# Comparing 3 common sum files:
binutils.sum
gas.sum
ld.sum
Comparing:
REFERENCE:/tmp/gxx-sum1.32683
CURRENT:  /tmp/gxx-sum2.32683

                                             +---------+---------+
o  RUN STATUS:                               |   REF   |   RES   |
  +------------------------------------------+---------+---------+
  | Passes                            [PASS] |    2390 |    2393 |
  | Unexpected fails                  [FAIL] |       1 |       1 |
  | Errors                           [ERROR] |       0 |       0 |
  | Unexpected passes                [XPASS] |       0 |       0 |
  | Expected fails                   [XFAIL] |      12 |      12 |
  | Known fails                      [KFAIL] |       0 |       0 |
  | Unresolved                  [UNRESOLVED] |       0 |       0 |
  | Unsupported                [UNSUPPORTED] |     268 |     268 |
  | Untested                      [UNTESTED] |      20 |      20 |
  +------------------------------------------+---------+---------+

    REF PASS ratio: 0.892605
    RES PASS ratio: 0.892725
    ***** ERROR: REF PASS ratio is abnormally low *****
    ***** ERROR: RES PASS ratio is abnormally low *****

o  REGRESSIONS:
  +------------------------------------------+---------+
  +------------------------------------------+---------+
  | TOTAL_REGRESSIONS                        |       0 |
  +------------------------------------------+---------+


o  IMPROVEMENTS TO BE CHECKED:
  +------------------------------------------+---------+
  | New PASS                  [     => PASS] |       3 |
  +------------------------------------------+---------+
  | TOTAL_IMPROVEMENTS_TO_BE_CHECKED         |       3 |
  +------------------------------------------+---------+

  - New PASS                  [     => PASS]:

  Executed from: binutils:binutils-all/ar.exp
    binutils:binutils-all/ar.exp=replacing SOURCE_DATE_EPOCH deterministic member
    binutils:binutils-all/ar.exp=replacing deterministic member
    binutils:binutils-all/ar.exp=replacing non-deterministic member



# Regressions found
# Regressions in 3 common sum files found