openvino/tests/layer_tests
Andrey Kashchikhin b67cff7cd5
[CI] [GHA] Introduce macOS ARM64 as a matrix parameter in the macOS pipeline (#20363)
* add m1 mac pipelines as a matrix parameter

* Update mac.yml

disable java_api because of macos arm64 - Java is not available on macOS arm64 runners

* Update mac.yml

added always condition for all tests

* Update mac.yml

* Update mac.yml

* Update mac.yml

* Update setup.py

temp commit

* Update tools/openvino_dev/setup.py

* use matrix for var

* add mxnet to extras only for x86_64

* skip failing tests

* use xfail for Python tests; add missing filter for transformations tests

* skip CPU func tests on x86_64 mac; skip some tests from CPU func tests on arm mac

* Update mac.yml

* skip tests on mac arm

* skip tests on darwin; apply review

* add more skips for python and c++ tests

* skip tf tests

* skip more tf tests; skip more Python UT stages

* rm alwayses, rm triggers, add nightly trigger

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-23 15:06:22 +04:00
..
common [TF FE] Support TF 2.14 and add OnesLike translator (#20385) 2023-10-11 15:24:32 +04:00
jax_tests [JAX][TF Hub][TF FE] Support XlaConvV2 operation and add JAX test (#19466) 2023-08-29 12:28:12 +04:00
mo_python_api_tests [CI] [GHA] Introduce macOS ARM64 as a matrix parameter in the macOS pipeline (#20363) 2023-10-23 15:06:22 +04:00
onnx_tests [CI] [GHA] Introduce macOS ARM64 as a matrix parameter in the macOS pipeline (#20363) 2023-10-23 15:06:22 +04:00
ovc_python_api_tests Added support of shapes and types from original FW in ov.convert_model() (#20009) 2023-09-26 17:41:01 +04:00
py_frontend_tests [PT FE] Implement override_all_inputs, override_all_outputs (#19642) 2023-09-08 22:31:49 +02:00
pytorch_tests [CI] [GHA] Introduce macOS ARM64 as a matrix parameter in the macOS pipeline (#20363) 2023-10-23 15:06:22 +04:00
tensorflow2_keras_tests [tests] switch layer tests to FP16 on pre-commit (#19090) 2023-08-21 16:03:47 +04:00
tensorflow_lite_tests [CI] [GHA] Introduce macOS ARM64 as a matrix parameter in the macOS pipeline (#20363) 2023-10-23 15:06:22 +04:00
tensorflow_tests [CI] [GHA] Introduce macOS ARM64 as a matrix parameter in the macOS pipeline (#20363) 2023-10-23 15:06:22 +04:00
.gitignore Add layer tests (#5789) 2021-06-16 12:50:16 +03:00
CMakeLists.txt Updated copyright headers (#15124) 2023-01-16 11:02:17 +04:00
README.md Refactor of renaming ov libraries for layer tests with key --use_new_frontend (#12846) 2022-09-20 13:43:37 +04:00
conftest.py [PT FE] Add aten::_native_multi_head_attention (#17550) 2023-06-05 10:55:03 +02:00
pytest.ini Torchfx backend (#18244) 2023-07-26 16:23:42 +02:00
requirements.txt [CI] [GHA] Align pipelines (#20388) 2023-10-13 23:48:15 +04:00

README.md

Layer tests

This folder layer tests framework code and test files.

Getting Started

Pre-requisites

  • OpenVINO should be configured as usual.

Setup

  • Install requirements:
    pip3 install -r requirements.txt
    
  • Set up environment variables for layer tests (if you use wheel package path to python api could be removed):
    export PYTHONPATH="path_to_openvino"/tests/layer_tests/:"path_to_openvino"/tools/mo:"path to python api"
    
  • If there is need to use specific libs it is possible to specify path to them using OV_LIBRARY_PATH env variable
    export OV_LIBRARY_PATH="path_to_libs"
    
  • To parametrize tests by device and precision (optional)
    export TEST_DEVICE="CPU;GPU"
    export TEST_PRECISION="FP32;FP16"
    

Run tests

py.test