openvino/tests/layer_tests
Georgy Krivoruchko 27c9ca749d
[ONNX] Switched to ONNX 1.15.0 (#20929)
* [ONNX] Switched to ONNX 1.15.0

* Updated usage of ONNX serialization API

* Updated xfailed lists

* Updated xfailed lists

* Added xfailed ML-operators

* Added xfailed float8 cases

* Fixing mo tests

* Reverted legacy tests

* Sets default opset version in layer tests

* Skipped test which breaks moving on 1.15

* Updated xfailed list

* Fixed typo and added more tests to skipped

* Added xfailed tests

* Reduced opset due to need to work on onnx 1.13

* Removed unnecessary xfails

* Skipped misaligned tests

* WA for old compiler build
2023-12-19 18:55:32 +00:00
..
common [ONNX] Switched to ONNX 1.15.0 (#20929) 2023-12-19 18:55:32 +00:00
jax_tests [JAX][TF Hub][TF FE] Support XlaConvV2 operation and add JAX test (#19466) 2023-08-29 12:28:12 +04:00
mo_python_api_tests [CI] [GHA] Introduce the Linux ARM64 workflow (#20809) 2023-12-05 12:14:02 +04:00
onnx_tests [ONNX] Switched to ONNX 1.15.0 (#20929) 2023-12-19 18:55:32 +00:00
ovc_python_api_tests Fixed verbose param. (#21234) 2023-11-22 17:32:20 +04:00
py_frontend_tests [PT FE] Add torch.int16 dtype support (#20735) 2023-10-30 10:12:55 +01:00
pytorch_tests [PT FE] ScaledDotProductAttention fix issue with other float dtypes (#21638) 2023-12-18 14:32:54 +04:00
tensorflow2_keras_tests [TF FE] Switch on ConvLSTM2D layer tests in pre-commit (#21520) 2023-12-07 13:46:58 +00:00
tensorflow_lite_tests [CI] [GHA] Introduce macOS ARM64 as a matrix parameter in the macOS pipeline (#20363) 2023-10-23 15:06:22 +04:00
tensorflow_tests [TF FE][Opset13] Enable Multinomial operator in TF frontend (#20646) 2023-12-18 12:00:04 +01:00
.gitignore Add layer tests (#5789) 2021-06-16 12:50:16 +03:00
CMakeLists.txt Updated copyright headers (#15124) 2023-01-16 11:02:17 +04:00
README.md Refactor of renaming ov libraries for layer tests with key --use_new_frontend (#12846) 2022-09-20 13:43:37 +04:00
conftest.py [PT FE] Add aten::_native_multi_head_attention (#17550) 2023-06-05 10:55:03 +02:00
pytest.ini [TF FE][Opset13] Enable Multinomial operator in TF frontend (#20646) 2023-12-18 12:00:04 +01:00
requirements.txt [CI] [GHA] Extract test jobs into reusable workflows (#21395) 2023-12-07 23:44:45 +04:00

README.md

Layer tests

This folder layer tests framework code and test files.

Getting Started

Pre-requisites

  • OpenVINO should be configured as usual.

Setup

  • Install requirements:
    pip3 install -r requirements.txt
    
  • Set up environment variables for layer tests (if you use wheel package path to python api could be removed):
    export PYTHONPATH="path_to_openvino"/tests/layer_tests/:"path_to_openvino"/tools/mo:"path to python api"
    
  • If there is need to use specific libs it is possible to specify path to them using OV_LIBRARY_PATH env variable
    export OV_LIBRARY_PATH="path_to_libs"
    
  • To parametrize tests by device and precision (optional)
    export TEST_DEVICE="CPU;GPU"
    export TEST_PRECISION="FP32;FP16"
    

Run tests

py.test