summaryrefslogtreecommitdiff
path: root/notify/results.compare.txt
blob: 87a5a132f0b7f720af2133c5afb8db4a71fddcea (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
# Comparing directories
# REFERENCE: base-artifacts/sumfiles
# CURRENT:   artifacts/sumfiles

# Comparing 1 common sum files:
gdb.sum
Comparing:
REFERENCE:/tmp/gxx-sum1.1208638
CURRENT:  /tmp/gxx-sum2.1208638

                                             +---------+---------+
o  RUN STATUS:                               |   REF   |   RES   |
  +------------------------------------------+---------+---------+
  | Passes                            [PASS] |  115518 |  115490 |
  | Unexpected fails                  [FAIL] |     154 |     176 |
  | Errors                           [ERROR] |      14 |      20 |
  | Unexpected passes                [XPASS] |       0 |       0 |
  | Expected fails                   [XFAIL] |      75 |      75 |
  | Known fails                      [KFAIL] |     121 |     121 |
  | Unresolved                  [UNRESOLVED] |      10 |      13 |
  | Unsupported                [UNSUPPORTED] |     489 |     489 |
  | Untested                      [UNTESTED] |      34 |      34 |
  +------------------------------------------+---------+---------+

    REF PASS ratio: 0.993058
    RES PASS ratio: 0.992844
    ***** WARNING: No REF execution test FAILed. Check execution engine configuration. *****
    ***** WARNING: No RES execution test FAILed. Check execution engine configuration. *****

o  REGRESSIONS:
  +------------------------------------------+---------+
  | PASS now FAIL             [PASS => FAIL] |       1 |
  | ERROR appears             [     =>ERROR] |       5 |
  | FAIL appears              [     => FAIL] |      27 |
  | FAIL now UNRESOLVED       [FAIL =>UNRES] |       1 |
  | UNRESOLVED appears        [     =>UNRES] |       2 |
  +------------------------------------------+---------+
  | TOTAL_REGRESSIONS                        |      36 |
  +------------------------------------------+---------+

  - PASS now FAIL             [PASS => FAIL]:

  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: reset timer in the inferior


  - ERROR appears             [     =>ERROR]:

  Executed from: gdb:gdb.dap/pause.exp
    gdb:gdb.dap/pause.exp=eof reading json header
    gdb:gdb.dap/pause.exp=gdb.dap/pause.exp.
    gdb:gdb.dap/pause.exp=tcl error code NONE
    gdb:gdb.dap/pause.exp=timeout reading json header
  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=breakpoints not deleted


  - FAIL appears              [     => FAIL]:

  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: break at break_fn: 1 (the program is no longer running)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: break at break_fn: 2 (the program is no longer running)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: break at break_fn: 3 (the program is no longer running)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: detach (the program is no longer running)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: attach (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: break at break_fn: 1 (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: break at break_fn: 2 (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: break at break_fn: 3 (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: break break_fn (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: delete all breakpoints in delete_breakpoints (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: detach (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: no new threads (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: print seconds_left (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: reset timer in the inferior (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: set breakpoint always-inserted off (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: set breakpoint always-inserted on (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break at break_fn: 1 (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break at break_fn: 2 (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break at break_fn: 3 (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break break_fn (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: delete all breakpoints in delete_breakpoints (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: detach (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: no new threads (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: print seconds_left (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: reset timer in the inferior (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: set breakpoint always-inserted off (timeout)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: set breakpoint always-inserted on (timeout)


  - FAIL now UNRESOLVED       [FAIL =>UNRES]:

  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 4: attach (timeout)


  - UNRESOLVED appears        [     =>UNRES]:

  Executed from: gdb:gdb.dap/pause.exp
    gdb:gdb.dap/pause.exp=gdb.dap/pause.exp' aborted due to Tcl error
  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: attach (timeout)



o  IMPROVEMENTS TO BE CHECKED:
  +------------------------------------------+---------+
  | PASS disappears           [PASS =>     ] |      27 |
  | FAIL disappears           [FAIL =>     ] |       5 |
  +------------------------------------------+---------+
  | TOTAL_IMPROVEMENTS_TO_BE_CHECKED         |      32 |
  +------------------------------------------+---------+

  - PASS disappears           [PASS =>     ]:

  Executed from: gdb:gdb.dap/pause.exp
    gdb:gdb.dap/pause.exp=gdb.dap/pause.exp: exceptions in log file
    gdb:gdb.dap/pause.exp=gdb.dap/pause.exp: gdb command canceled
    gdb:gdb.dap/pause.exp=gdb.dap/pause.exp: gdb command failed
    gdb:gdb.dap/pause.exp=gdb.dap/pause.exp: python command canceled
    gdb:gdb.dap/pause.exp=gdb.dap/pause.exp: python command failed
    gdb:gdb.dap/pause.exp=gdb.dap/pause.exp: shutdown success
  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: break at break_fn: 1
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: break at break_fn: 2
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: break at break_fn: 3
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 1: detach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: attach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: break at break_fn: 1
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: break at break_fn: 2
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: break at break_fn: 3
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: break break_fn
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: detach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: no new threads
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: print seconds_left
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: reset timer in the inferior
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: set breakpoint always-inserted off
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 2: set breakpoint always-inserted on
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: attach
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break break_fn
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: no new threads
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: print seconds_left
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: set breakpoint always-inserted off
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: set breakpoint always-inserted on


  - FAIL disappears           [FAIL =>     ]:

  Executed from: gdb:gdb.threads/attach-many-short-lived-threads.exp
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break at break_fn: 1 (the program is no longer running)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break at break_fn: 2 (the program is no longer running)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: break at break_fn: 3 (the program is no longer running)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: detach (the program is no longer running)
    gdb:gdb.threads/attach-many-short-lived-threads.exp=gdb.threads/attach-many-short-lived-threads.exp: iter 3: reset timer in the inferior



# Regressions found
# Regressions in 1 common sum files found