openvino/tests/layer_tests
Andrey Kashchikhin 2e33019e68
[CI] [GHA] Align pipelines (#20388)
* add ONNX layer tests

* add parallelism for pytest; add missing stages to win; align execution steps

* add missng shell option

* add missing dep, update marker

* align stages and execution commands; rm parallelization

* enable trigger

* add missing export; rm not-applicable stage from mac and win pipeline

* add missing requirement, rm not-applicable stage

* add missing test parameters

* try to pi onnxruntime version; skip mxnet on mac; correct vars in win

* rm constraint

* skip on win

* use xfail

* remove always(), rm trigger for mac

* return push trigger for mac
2023-10-13 23:48:15 +04:00
..
common [TF FE] Support TF 2.14 and add OnesLike translator (#20385) 2023-10-11 15:24:32 +04:00
jax_tests [JAX][TF Hub][TF FE] Support XlaConvV2 operation and add JAX test (#19466) 2023-08-29 12:28:12 +04:00
mo_python_api_tests [PT FE] Separate tracing and scripting modes (#19676) 2023-09-12 12:40:20 +04:00
onnx_tests [CI] [GHA] Align pipelines (#20388) 2023-10-13 23:48:15 +04:00
ovc_python_api_tests Added support of shapes and types from original FW in ov.convert_model() (#20009) 2023-09-26 17:41:01 +04:00
py_frontend_tests [PT FE] Implement override_all_inputs, override_all_outputs (#19642) 2023-09-08 22:31:49 +02:00
pytorch_tests [PT FE]: support aten::erf and aten::adaptive_avg_pool1d (#20350) 2023-10-11 17:33:32 +04:00
tensorflow2_keras_tests [tests] switch layer tests to FP16 on pre-commit (#19090) 2023-08-21 16:03:47 +04:00
tensorflow_lite_tests [TF FE] Support TF 2.14 and add OnesLike translator (#20385) 2023-10-11 15:24:32 +04:00
tensorflow_tests [TF FE] Support TF 2.14 and add OnesLike translator (#20385) 2023-10-11 15:24:32 +04:00
.gitignore Add layer tests (#5789) 2021-06-16 12:50:16 +03:00
CMakeLists.txt Updated copyright headers (#15124) 2023-01-16 11:02:17 +04:00
README.md Refactor of renaming ov libraries for layer tests with key --use_new_frontend (#12846) 2022-09-20 13:43:37 +04:00
conftest.py [PT FE] Add aten::_native_multi_head_attention (#17550) 2023-06-05 10:55:03 +02:00
pytest.ini Torchfx backend (#18244) 2023-07-26 16:23:42 +02:00
requirements.txt [CI] [GHA] Align pipelines (#20388) 2023-10-13 23:48:15 +04:00

README.md

Layer tests

This folder layer tests framework code and test files.

Getting Started

Pre-requisites

  • OpenVINO should be configured as usual.

Setup

  • Install requirements:
    pip3 install -r requirements.txt
    
  • Set up environment variables for layer tests (if you use wheel package path to python api could be removed):
    export PYTHONPATH="path_to_openvino"/tests/layer_tests/:"path_to_openvino"/tools/mo:"path to python api"
    
  • If there is need to use specific libs it is possible to specify path to them using OV_LIBRARY_PATH env variable
    export OV_LIBRARY_PATH="path_to_libs"
    
  • To parametrize tests by device and precision (optional)
    export TEST_DEVICE="CPU;GPU"
    export TEST_PRECISION="FP32;FP16"
    

Run tests

py.test