summaryrefslogtreecommitdiff
path: root/notify/results.compare
blob: 482bf2e57e4a2a296ba68395aeb60ef84af94347 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
# Comparing directories
# REFERENCE: base-artifacts/sumfiles
# CURRENT:   artifacts/99-rewrite/artifacts.old/sumfiles

# Comparing 1 common sum files:
gdb.sum
Comparing:
REFERENCE:/tmp/gxx-sum1.2172803
CURRENT:  /tmp/gxx-sum2.2172803

                                             +---------+---------+
o  RUN STATUS:                               |   REF   |   RES   |
  +------------------------------------------+---------+---------+
  | Passes                            [PASS] |  114292 |  114276 |
  | Unexpected fails                  [FAIL] |      38 |      38 |
  | Errors                           [ERROR] |       0 |       0 |
  | Unexpected passes                [XPASS] |       0 |       0 |
  | Expected fails                   [XFAIL] |      80 |      75 |
  | Known fails                      [KFAIL] |     123 |     120 |
  | Unresolved                  [UNRESOLVED] |       0 |       0 |
  | Unsupported                [UNSUPPORTED] |     456 |     456 |
  | Untested                      [UNTESTED] |      36 |      36 |
  +------------------------------------------+---------+---------+

    REF PASS ratio: 0.994323
    RES PASS ratio: 0.994348
    ***** WARNING: No REF execution test FAILed. Check execution engine configuration. *****
    ***** WARNING: No RES execution test FAILed. Check execution engine configuration. *****

o  REGRESSIONS:
  +------------------------------------------+---------+
  +------------------------------------------+---------+
  | TOTAL_REGRESSIONS                        |       0 |
  +------------------------------------------+---------+


o  IMPROVEMENTS TO BE CHECKED:
  +------------------------------------------+---------+
  | PASS disappears           [PASS =>     ] |      25 |
  | New PASS                  [     => PASS] |       9 |
  | XFAIL disappears          [XFAIL=>     ] |       5 |
  | KFAIL disappears          [KFAIL=>     ] |       3 |
  +------------------------------------------+---------+
  | TOTAL_IMPROVEMENTS_TO_BE_CHECKED         |      42 |
  +------------------------------------------+---------+

  - PASS disappears           [PASS =>     ]:

  Executed from: gdb:gdb.base/step-over-syscall.exp
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=off: break marker
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=off: check_pc_after_cross_syscall: get hexadecimal valueof "$pc"
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=off: check_pc_after_cross_syscall: single step over clone final pc
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=off: continue to marker (clone)
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: break *clone
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: break marker
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: break on syscall insns
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: check_pc_after_cross_syscall: get hexadecimal valueof "$pc"
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: check_pc_after_cross_syscall: single step over clone final pc
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: continue to clone (1st time)
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: continue to clone (2nd time)
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: continue to clone (3rd time)
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: continue to syscall insn clone
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: delete break 1
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: fetch first stop pc
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: find syscall insn in clone
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: get hexadecimal valueof "$pc"
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: pc after stepi
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: pc after stepi matches insn addr after syscall
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: pc before/after syscall instruction
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: set displaced-stepping off during test setup
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: set displaced-stepping on
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: single step over clone
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: stepi clone insn
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: syscall number matches


  - New PASS                  [     => PASS]:

  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: attach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: attach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: attach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: attach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 7: attach
  Executed from: gdb:gdb.threads/process-dies-while-handling-bp.exp
    gdb:gdb.threads/process-dies-while-handling-bp.exp=gdb.threads/process-dies-while-handling-bp.exp: non_stop=off: cond_bp_target=0: inferior 1 exited
    gdb:gdb.threads/process-dies-while-handling-bp.exp=gdb.threads/process-dies-while-handling-bp.exp: non_stop=off: cond_bp_target=0: no threads left
    gdb:gdb.threads/process-dies-while-handling-bp.exp=gdb.threads/process-dies-while-handling-bp.exp: non_stop=on: cond_bp_target=1: inferior 1 exited
    gdb:gdb.threads/process-dies-while-handling-bp.exp=gdb.threads/process-dies-while-handling-bp.exp: non_stop=on: cond_bp_target=1: no threads left


  - XFAIL disappears          [XFAIL=>     ]:

  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: attach (EPERM)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: attach (EPERM)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: attach (EPERM)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 6: attach (EPERM)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 7: attach (EPERM)


  - KFAIL disappears          [KFAIL=>     ]:

  Executed from: gdb:gdb.base/step-over-syscall.exp
    gdb:gdb.base/step-over-syscall.exp=gdb.base/step-over-syscall.exp: clone: displaced=on: continue to marker (clone) (PRMS: gdb/19675)
  Executed from: gdb:gdb.threads/process-dies-while-handling-bp.exp
    gdb:gdb.threads/process-dies-while-handling-bp.exp=gdb.threads/process-dies-while-handling-bp.exp: non_stop=off: cond_bp_target=0: inferior 1 exited (prompt) (PRMS: gdb/18749)
    gdb:gdb.threads/process-dies-while-handling-bp.exp=gdb.threads/process-dies-while-handling-bp.exp: non_stop=on: cond_bp_target=1: inferior 1 exited (prompt) (PRMS: gdb/18749)



# Improvements found
# No regression found in 1 common sum files