[DOCS] conformance tables update (#22459)

This commit is contained in:
Karol Blaszczak 2024-01-29 13:45:44 +01:00 committed by GitHub
parent 9cd1afbe96
commit f52de9434b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
9 changed files with 17205 additions and 16624 deletions

View File

@ -7,163 +7,171 @@ Supported Operations - by Inference Devices
This page lists operations supported by OpenVINO inference devices. The table presents general information,
for a more detailed and most recent listing of operations that are implemented and tested:
.. button-link:: _static/download/operation_conformance_table_files/opset_report_omz_static.html
.. button-link:: _static/download/conformance_reports/opset_report_omz_static.html
:color: primary
:outline:
See the full conformance report table
See the full conformance report table (static)
.. button-link:: _static/download/conformance_reports/opset_report_omz_dynamic.html
:color: primary
:outline:
See the full conformance report table (dynamic)
================================= =============== ============== ================ ==================
Operations CPU (x86) GPU GNA CPU (Arm®)
================================= =============== ============== ================ ==================
Abs Supported** Supported Not Supported Supported
================================= =============== ============== ================ ==================
Abs Supported** Supported Not Supported Supported
Acos Supported** Supported Not Supported Supported****
Acosh Supported** Supported Not Supported Supported****
Activation-Clamp Supported*** Supported Supported Supported
Activation-ELU Supported*** Supported Not Supported Supported
Activation-Exp Supported*** Supported Supported Supported
Activation-Leaky ReLU Supported*** Supported Supported Not Supported
Activation-Not Supported*** Supported Not Supported Not Supported
Activation-PReLU Supported*** Supported Not Supported Supported
Activation-ReLU Supported*** Supported Supported Supported
Activation-ReLU6 Supported*** Supported Not Supported Not Supported
Activation-Sigmoid/Logistic Supported*** Supported Supported Supported
Activation-TanH Supported*** Supported Supported Supported
ArgMax Supported** Supported Not Supported Not Supported
Activation-Clamp Supported*** Supported Supported Supported
Activation-ELU Supported*** Supported Not Supported Supported
Activation-Exp Supported*** Supported Supported Supported
Activation-Leaky ReLU Supported*** Supported Supported Not Supported
Activation-Not Supported*** Supported Not Supported Not Supported
Activation-PReLU Supported*** Supported Not Supported Supported
Activation-ReLU Supported*** Supported Supported Supported
Activation-ReLU6 Supported*** Supported Not Supported Not Supported
Activation-Sigmoid/Logistic Supported*** Supported Supported Supported
Activation-TanH Supported*** Supported Supported Supported
ArgMax Supported** Supported Not Supported Not Supported
Asin Supported** Supported Not Supported Supported****
Asinh Supported** Supported Not Supported Supported****
Atan Supported** Supported Not Supported Supported****
Atanh Supported** Supported Not Supported Supported****
BatchNormalization Supported Supported Not Supported Supported
BinaryConvolution Supported Supported Not Supported Not Supported
Broadcast Supported** Supported Not Supported Supported
Ceil Supported** Supported Not Supported Supported
Concat Supported*** Supported Supported Supported
Const Supported Supported Supported Supported
Convolution-Dilated Supported Supported Not Supported Supported
Convolution-Dilated 3D Supported Supported Not Supported Not Supported
Convolution-Grouped Supported Supported Not Supported Supported
Convolution-Grouped 3D Supported Supported Not Supported Not Supported
Convolution-Ordinary Supported Supported Supported* Supported
Convolution-Ordinary 3D Supported Supported Not Supported Not Supported
BatchNormalization Supported Supported Not Supported Supported
BinaryConvolution Supported Supported Not Supported Not Supported
Broadcast Supported** Supported Not Supported Supported
Ceil Supported** Supported Not Supported Supported
Concat Supported*** Supported Supported Supported
Const Supported Supported Supported Supported
Convolution-Dilated Supported Supported Not Supported Supported
Convolution-Dilated 3D Supported Supported Not Supported Not Supported
Convolution-Grouped Supported Supported Not Supported Supported
Convolution-Grouped 3D Supported Supported Not Supported Not Supported
Convolution-Ordinary Supported Supported Supported* Supported
Convolution-Ordinary 3D Supported Supported Not Supported Not Supported
Cos Supported** Supported Not Supported Supported****
Cosh Supported** Supported Not Supported Supported****
Crop Supported Supported Supported Not Supported
Crop Supported Supported Supported Not Supported
CTCGreedyDecoder Supported** Supported** Not Supported Supported****
Deconvolution Supported Supported Not Supported Not Supported
Deconvolution 3D Supported Supported Not Supported Not Supported
DeformableConvolution Supported Supported Not Supported Not Supported
DepthToSpace Supported** Supported Not Supported Supported*
Deconvolution Supported Supported Not Supported Not Supported
Deconvolution 3D Supported Supported Not Supported Not Supported
DeformableConvolution Supported Supported Not Supported Not Supported
DepthToSpace Supported** Supported Not Supported Supported*
DetectionOutput Supported** Supported Not Supported Supported****
Eltwise-And Supported*** Supported Not Supported Supported
Eltwise-Add Supported*** Supported Not Supported Supported
Eltwise-Div Supported*** Supported Not Supported Supported
Eltwise-Equal Supported*** Supported Not Supported Supported*
Eltwise-And Supported*** Supported Not Supported Supported
Eltwise-Add Supported*** Supported Not Supported Supported
Eltwise-Div Supported*** Supported Not Supported Supported
Eltwise-Equal Supported*** Supported Not Supported Supported*
Eltwise-FloorMod Supported*** Supported Not Supported Supported****
Eltwise-Greater Supported*** Supported Not Supported Supported
Eltwise-GreaterEqual Supported*** Supported Not Supported Supported
Eltwise-Less Supported*** Supported Not Supported Supported*
Eltwise-LessEqual Supported*** Supported Not Supported Supported*
Eltwise-LogicalAnd Supported*** Supported Not Supported Supported
Eltwise-LogicalOr Supported*** Supported Not Supported Supported
Eltwise-LogicalXor Supported*** Supported Not Supported Supported
Eltwise-Max Supported*** Supported Not Supported Supported
Eltwise-Min Supported*** Supported Not Supported Supported
Eltwise-Mul Supported*** Supported Supported Supported
Eltwise-NotEqual Supported*** Supported Not Supported Supported*
Eltwise-Pow Supported*** Supported Not Supported Supported
Eltwise-Prod Supported*** Supported Supported Not Supported
Eltwise-SquaredDiff Supported*** Supported Not Supported Supported
Eltwise-Sub Supported*** Supported Supported Supported
Eltwise-Greater Supported*** Supported Not Supported Supported
Eltwise-GreaterEqual Supported*** Supported Not Supported Supported
Eltwise-Less Supported*** Supported Not Supported Supported*
Eltwise-LessEqual Supported*** Supported Not Supported Supported*
Eltwise-LogicalAnd Supported*** Supported Not Supported Supported
Eltwise-LogicalOr Supported*** Supported Not Supported Supported
Eltwise-LogicalXor Supported*** Supported Not Supported Supported
Eltwise-Max Supported*** Supported Not Supported Supported
Eltwise-Min Supported*** Supported Not Supported Supported
Eltwise-Mul Supported*** Supported Supported Supported
Eltwise-NotEqual Supported*** Supported Not Supported Supported*
Eltwise-Pow Supported*** Supported Not Supported Supported
Eltwise-Prod Supported*** Supported Supported Not Supported
Eltwise-SquaredDiff Supported*** Supported Not Supported Supported
Eltwise-Sub Supported*** Supported Supported Supported
Eltwise-Sum Supported*** Supported Supported Supported****
Erf Supported** Supported Not Supported Supported****
Exp Supported Supported Supported Supported
FakeQuantize Supported Not Supported Not Supported Supported*
Fill Supported** Not Supported Not Supported Not Supported
Flatten Supported Supported Not Supported Not Supported
Floor Supported** Supported Not Supported Supported
FullyConnected (Inner Product) Supported*** Supported Supported Supported
Gather Supported** Supported Not Supported Supported*
Exp Supported Supported Supported Supported
FakeQuantize Supported Not Supported Not Supported Supported*
Fill Supported** Not Supported Not Supported Not Supported
Flatten Supported Supported Not Supported Not Supported
Floor Supported** Supported Not Supported Supported
FullyConnected (Inner Product) Supported*** Supported Supported Supported
Gather Supported** Supported Not Supported Supported*
GatherTree Supported** Not Supported Not Supported Supported****
Gemm Supported Supported Not Supported Not Supported
GRN Supported** Supported** Not Supported Supported
Gemm Supported Supported Not Supported Not Supported
GRN Supported** Supported** Not Supported Supported
HardSigmoid Supported** Supported Not Supported Supported****
Interp Supported** Supported** Not Supported Supported*
Log Supported** Supported Supported Supported
LRN (Norm) Supported Supported Not Supported Supported*
LSTMCell Supported Supported Supported Supported
GRUCell Supported Supported Supported Supported
RNNCell Supported Supported Not Supported Supported
Interp Supported** Supported** Not Supported Supported*
Log Supported** Supported Supported Supported
LRN (Norm) Supported Supported Not Supported Supported*
LSTMCell Supported Supported Supported Supported
GRUCell Supported Supported Supported Supported
RNNCell Supported Supported Not Supported Supported
LSTMSequence Supported Supported Supported Supported****
GRUSequence Supported Supported Supported Supported****
RNNSequence Supported Supported Not Supported Supported****
LogSoftmax Supported** Supported Not Supported Supported
Memory Supported Not Supported Supported Not Supported
MVN Supported** Supported Not Supported Supported*
Neg Supported** Supported Not Supported Supported
LogSoftmax Supported** Supported Not Supported Supported
Memory Supported Not Supported Supported Not Supported
MVN Supported** Supported Not Supported Supported*
Neg Supported** Supported Not Supported Supported
NonMaxSuppression Supported** Not Supported Not Supported Supported****
Normalize Supported** Supported Not Supported Supported*
Normalize Supported** Supported Not Supported Supported*
OneHot Supported** Supported Not Supported Supported****
Pad Supported** Supported Not Supported Supported*
Permute Supported Supported Supported* Not Supported
Pooling(AVG,MAX) Supported Supported Supported Supported
Pooling(AVG,MAX) 3D Supported Supported Not Supported Supported*
Power Supported** Supported Supported* Supported
PowerFile Supported** Not Supported Not Supported Not Supported
PriorBox Supported** Supported Not Supported Supported
PriorBoxClustered Supported** Supported** Not Supported Supported
Pad Supported** Supported Not Supported Supported*
Permute Supported Supported Supported* Not Supported
Pooling(AVG,MAX) Supported Supported Supported Supported
Pooling(AVG,MAX) 3D Supported Supported Not Supported Supported*
Power Supported** Supported Supported* Supported
PowerFile Supported** Not Supported Not Supported Not Supported
PriorBox Supported** Supported Not Supported Supported
PriorBoxClustered Supported** Supported** Not Supported Supported
Proposal Supported** Supported Not Supported Supported****
PSROIPooling Supported** Supported Not Supported Supported****
Range Supported** Not Supported Not Supported Not Supported
Reciprocal Supported** Supported Not Supported Not Supported
Range Supported** Not Supported Not Supported Not Supported
Reciprocal Supported** Supported Not Supported Not Supported
ReduceAnd Supported** Supported Not Supported Supported****
ReduceL1 Supported** Supported Not Supported Supported
ReduceL2 Supported** Supported Not Supported Supported
ReduceLogSum Supported** Supported Not Supported Supported
ReduceLogSumExp Supported** Supported Not Supported Not Supported
ReduceMax Supported** Supported Not Supported Supported
ReduceMean Supported** Supported Not Supported Supported
ReduceMin Supported** Supported Not Supported Supported
ReduceL1 Supported** Supported Not Supported Supported
ReduceL2 Supported** Supported Not Supported Supported
ReduceLogSum Supported** Supported Not Supported Supported
ReduceLogSumExp Supported** Supported Not Supported Not Supported
ReduceMax Supported** Supported Not Supported Supported
ReduceMean Supported** Supported Not Supported Supported
ReduceMin Supported** Supported Not Supported Supported
ReduceOr Supported** Supported Not Supported Supported****
ReduceProd Supported** Supported Not Supported Supported
ReduceSum Supported** Supported Not Supported Supported
ReduceSumSquare Supported** Supported Not Supported Not Supported
ReduceProd Supported** Supported Not Supported Supported
ReduceSum Supported** Supported Not Supported Supported
ReduceSumSquare Supported** Supported Not Supported Not Supported
RegionYolo Supported** Supported Not Supported Supported****
ReorgYolo Supported** Supported Not Supported Supported
Resample Supported** Supported Not Supported Not Supported
Reshape Supported*** Supported Supported Supported
ReorgYolo Supported** Supported Not Supported Supported
Resample Supported** Supported Not Supported Not Supported
Reshape Supported*** Supported Supported Supported
ReverseSequence Supported** Supported Not Supported Supported****
RNN Supported Not Supported Not Supported Supported
RNN Supported Not Supported Not Supported Supported
ROIPooling Supported Supported* Not Supported Supported****
ScaleShift Supported*** Supported Supported Not Supported
ScatterUpdate Supported** Not Supported Not Supported Not Supported
Select Supported Supported Not Supported Supported
ScaleShift Supported*** Supported Supported Not Supported
ScatterUpdate Supported** Not Supported Not Supported Not Supported
Select Supported Supported Not Supported Supported
Selu Supported** Supported Not Supported Supported****
ShuffleChannels Supported** Supported Not Supported Supported
Sign Supported** Supported Not Supported Supported
Sin Supported** Supported Not Supported Supported
ShuffleChannels Supported** Supported Not Supported Supported
Sign Supported** Supported Not Supported Supported
Sin Supported** Supported Not Supported Supported
Sinh Supported** Supported Not Supported Supported****
SimplerNMS Supported** Supported Not Supported Not Supported
Slice Supported*** Supported Supported Not Supported
SoftMax Supported*** Supported Not Supported Supported
Softplus Supported** Supported Not Supported Supported
Softsign Supported** Supported Supported Not Supported
SpaceToDepth Supported** Not Supported Not Supported Supported*
SpatialTransformer Supported** Not Supported Not Supported Not Supported
Split Supported*** Supported Supported Supported
Squeeze Supported** Supported Supported Supported
StridedSlice Supported** Supported Not Supported Supported*
SimplerNMS Supported** Supported Not Supported Not Supported
Slice Supported*** Supported Supported Not Supported
SoftMax Supported*** Supported Not Supported Supported
Softplus Supported** Supported Not Supported Supported
Softsign Supported** Supported Supported Not Supported
SpaceToDepth Supported** Not Supported Not Supported Supported*
SpatialTransformer Supported** Not Supported Not Supported Not Supported
Split Supported*** Supported Supported Supported
Squeeze Supported** Supported Supported Supported
StridedSlice Supported** Supported Not Supported Supported*
Tan Supported** Supported Not Supported Supported****
TensorIterator Supported Not Supported Supported Supported
Tile Supported*** Supported** Not Supported Supported
TensorIterator Supported Not Supported Supported Supported
Tile Supported*** Supported** Not Supported Supported
TopK Supported** Supported Not Supported Supported****
Unpooling Not Supported Supported Not Supported Not Supported
Unsqueeze Supported** Supported Supported Supported
Upsampling Not Supported Supported Not Supported Not Supported
Unpooling Not Supported Supported Not Supported Not Supported
Unsqueeze Supported** Supported Supported Supported
Upsampling Not Supported Supported Not Supported Not Supported
================================= =============== ============== ================ ==================
| `*` - support is limited to the specific parameters. Refer to "Known Layer Limitations" section for the device :doc:`from the list of supported <openvino_docs_OV_UG_supported_plugins_Supported_Devices>`.
| `*` - support is limited to the specific parameters.
| `**` - support is implemented via :doc:`Extensibility mechanism <openvino_docs_Extensibility_UG_Intro>`.
| `***` - supports NCDHW layout.
| `****` - support is implemented via runtime reference.

View File

@ -241,13 +241,14 @@ OpenVINO™ Runtime
* Introducing string tensor support for Python API.
* Added support for the following:
* Create ov.Tensor from Python lists
* Create ov.Tensor from empty numpy arrays.
* Constants from empty numpy arrays.
* Autogenerated get/set methods for Node attributes.
* Inference functions (``InferRequest.infer/start_async``, ``CompiledModel.__call__`` etc.) support OVDict as the input.
* PILLOW interpolation modes bindings.
(`PR #21188 <https://github.com/openvinotoolkit/openvino/pull/21188>`__ external contribution: @meetpatel0963)
* PILLOW interpolation modes bindings. (`PR #21188 <https://github.com/openvinotoolkit/openvino/pull/21188>`__ external contribution: @meetpatel0963)
* Torchvision to :doc:`OpenVINO preprocessing <openvino_docs_OV_UG_string_tensors>`
converter documentation has been added to OpenVINO docs.

View File

@ -105,7 +105,6 @@
<thead>
<tr>
<th class="table-dark" style="text-align: left; vertical-align: middle !important;">Entity</th>
<th class="diagonal"><span class="th-devices">Devices</span><span class="th-sw-plugin">Plugins</span></th>
{% for device in devices %}
<th class="table-dark" colspan="2" style="text-align: center; vertical-align: middle !important;">{{ device }}</th>
{% endfor %}
@ -113,38 +112,35 @@
</thead>
<tbody style="text-align: center;">
{% for test_type in api_info %}
<td class="table-primary" style="text-align: left;" rowspan="{{ api_info[test_type].keys()|length + 1 }}" style="vertical-align: middle !important;">{{ test_type }}</td>
{% for sw_plugin in sw_plugins %}
<tr>
<td style="text-align: left;">{{sw_plugin}}</td>
{% for device in devices %}
{% if device in api_info[test_type][sw_plugin] %}
<td title="{{api_info[test_type][sw_plugin][device]['title']}}">
<span>Total:</span>
<span>{{ api_info[test_type][sw_plugin][device]['passrate'] }}</span>
{% if api_info[test_type][sw_plugin][device]['diff'] > 0 %}
(<span class="text-success font-weight-bold">+{{ api_info[test_type][sw_plugin][device]['diff'] }}</span>)
{% elif api_info[test_type][sw_plugin][device]['diff'] < 0 %}
(<span class="text-danger font-weight-bold">{{ api_info[test_type][sw_plugin][device]['diff'] }}</span>)
{% endif %}
%
</td>
<td title="{{api_info[test_type][sw_plugin][device]['rel_title']}}">
<span>Rel:</span>
<span>{{ api_info[test_type][sw_plugin][device]['rel_passrate'] }}</span>
{% if api_info[test_type][sw_plugin][device]['rel_diff'] > 0 %}
(<span class="text-success font-weight-bold">+{{ api_info[test_type][sw_plugin][device]['rel_diff'] }}</span>)
{% elif api_info[test_type][sw_plugin][device]['rel_diff'] < 0 %}
(<span class="text-danger font-weight-bold">{{ api_info[test_type][sw_plugin][device]['rel_diff'] }}</span>)
{% endif %}
%
</td>
{% else %}
<td colspan="2" style="text-align: center;" title="API conformanace wasn't run on {{device}} {{sw_plugin}}">NOT RUN</td>
{% endif %}
{% endfor %}
</tr>
{% endfor %}
<tr>
<td class="table-primary" style="text-align: left;" style="vertical-align: middle !important;">{{ test_type }}</td>
{% for device in devices %}
{% if device in api_info[test_type] %}
<td title="{{api_info[test_type][device]['title']}}">
<span>Total:</span>
<span>{{ api_info[test_type][device]['passrate'] }}</span>
{% if api_info[test_type][device]['diff'] > 0 %}
(<span class="text-success font-weight-bold">+{{ api_info[test_type][device]['diff'] }}</span>)
{% elif api_info[test_type][device]['diff'] < 0 %}
(<span class="text-danger font-weight-bold">{{ api_info[test_type][device]['diff'] }}</span>)
{% endif %}
%
</td>
<td title="{{api_info[test_type][device]['rel_title']}}">
<span>Rel:</span>
<span>{{ api_info[test_type][device]['rel_passrate'] }}</span>
{% if api_info[test_type][device]['rel_diff'] > 0 %}
(<span class="text-success font-weight-bold">+{{ api_info[test_type][device]['rel_diff'] }}</span>)
{% elif api_info[test_type][device]['rel_diff'] < 0 %}
(<span class="text-danger font-weight-bold">{{ api_info[test_type][device]['rel_diff'] }}</span>)
{% endif %}
%
</td>
{% else %}
<td colspan="2" style="text-align: center;" title="API conformanace wasn't run on {{device}} {{sw_plugin}}">NOT RUN</td>
{% endif %}
{% endfor %}
</tr>
{% endfor %}
</tbody>
</table>

View File

@ -32,7 +32,7 @@
<span><b>Passrates are based on relative weights each subgraphs! You can check absolute value in `General passrate` row!</b></span>
</div>
<div>
<span><b>Relative Passrate could be from 0 to 200% now! Relative weight of operation is calculated once for current set of models, but there are more then one tests per model. </b></span>
<span><b>Relative Passrate could be from 0 to 100% (Inference only)! Relative weight of operation is calculated once for current set of models, but there are more then one tests per model. </b></span>
</div>
<div>
<span><b>Status:</b></span>
@ -97,7 +97,7 @@
<table class="table table-hover" id="report">
<thead>
<tr>
<th class="table-dark" scope="col" style="position: sticky; top: 97px">Operation</th>
<th class="table-dark" scope="col" style="position: sticky; top: 97px">Operation ({OpName}-{FirstOpsetNumberContainsOp})</th>
{% for d in devices -%}
<th class="table-dark device {{ d }}" style="position: sticky; top: 97px">{{ d }}</th>
{% endfor %}

View File

@ -698,13 +698,6 @@ h2 {
opacity: 0.5;
}
.diagonal {
position: relative;
background: linear-gradient(to right top, #000000 0%,#000000 46.9%,#ffffff 47%,#ffffff 51%,#000000 51.1%,#000000 100%) !important;
background-color: transparent;
background-color: none !important;
}
.th-sw-plugin {
color: white;
}