blob: a528e274d138f945a99dce263d7d32bf65f7e7e9 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
|
.. image:: ../images/Linaro-Logo_standard.png
:width: 9 cm
:align: right
.. include:: links.rst
.. class:: title
| 17.02 Member LCR for HiKey
| Test Report
.. class:: s-table
+-----------+----------------------------------+
| Date | 22.09.2016 |
+===========+==================================+
| Author | Naresh Kamboju, Linaro |
+-----------+----------------------------------+
| Approvers | Jakub Pavelek, Linaro |
| | |
| | YongQin Liu, Linaro |
+-----------+----------------------------------+
| Build | `Build Link <{{ build_link }}>`_ |
+-----------+----------------------------------+
| Release | `YYYY.MM <>`_ |
+-----------+----------------------------------+
.. raw:: pdf
PageBreak
Configuration
-------------
.. _`Kernel version`: {{ kernel_git_url }}
.. class:: s-table
+---------------------------------+-----------------------------------------------------------------------------------------------------------------+
| **Item** | **Explanation** |
+=================================+=================================================================================================================+
| Kernel | `Kernel version`_ |
+---------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Android version | Android Nougat {{ android_version }} |
+---------------------------------+-----------------------------------------------------------------------------------------------------------------+
| CTS version | `7.1_r1 <http://testdata.validation.linaro.org/cts/android-cts-7.1_r1.zip>`_ with patches for 8 subset plans |
+---------------------------------+-----------------------------------------------------------------------------------------------------------------+
| OP-TEE version | Stable release v2.2.0 |
| | |
| | Client - |
| | `{{ optee_client_commit_id }} <{{ optee_client_link }}>`_ |
| | |
| | OS - |
| | `{{ optee_os_commit_id }} <{{ optee_os_link }}>`_ |
| | |
| | Test - |
| | `{{ optee_test_commit_id }} <{{ optee_test_link }}>`_ |
+---------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Compiler | 64bit GCC version 4.9 20150123 (prerelease) (GCC) |
| | |
| | AOSP LLVM 3.8 clang-2690385 (based on LLVM 3.8.256229) |
+---------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Board Firmware Package for Juno | `UEFI - RPB #112 <http://builds.96boards.org/snapshots/reference-platform/components/uefi/112/release/hikey/>`_ |
+---------------------------------+-----------------------------------------------------------------------------------------------------------------+
Glossary
--------
+------+----------------------------------------------------------------+
| CTS | Android Compatibility Test Suite - Contains over 200.000 tests |
+------+----------------------------------------------------------------+
| LAVA | Linaro Automated Validation Architecture |
+------+----------------------------------------------------------------+
Pass-rate encodings
-------------------
.. class:: pass-rate-table
+-----------+
| 100% |
+-----------+
| 50% - 99% |
+-----------+
| 1% - 49% |
+-----------+
| 0% |
+-----------+
.. raw:: pdf
PageBreak
Focused CTS test results summary (arm64-v8a ABI)
------------------------------------------------
.. include:: cts-focused.rst
.. raw:: pdf
PageBreak
Full CTS Test Results summary (arm64-v8a ABI)
---------------------------------------------
CTS, Android compatibility test case suite runs over 200.000 test cases. Detailed CTS results are attached on `wiki page`_ for downloading.
To start complete CTS as a test plan run:
::
/android-cts/tools$ ./cts-tradefed
cts-tf > run cts --plan CTS --disable-reboot
To start CTS tests as individual package tests run:
::
/android-cts/tools$ ./cts-tradefed
cts-tf > run cts --module <MODULE_NAME> --disable-reboot
To run CTS test package as a plan:
::
/android-cts/tools$ ./cts-tradefed
cts-tf > run cts --plan <PLAN_NAME> --disable-reboot
.. include:: cts-summary.rst
.. raw:: pdf
PageBreak
LAVA Test Results
-----------------
Linaro’s automated testing are linked here - `LAVA Job 1 <{{ lava_url_basic }}>`_, `LAVA Job 2 <{{ lava_url_weekly }}>`_. LAVA results are also available attached on a `wiki page`_.
.. include:: lava.rst
.. raw:: pdf
PageBreak
Benchmarks
----------
Detailed results can be found in `qa-reports <{{ qa_reports_link }}>`_.
.. include:: benchmarks.rst
.. raw:: pdf
PageBreak
Open Bugs
---------
.. include:: bugs.rst
|
