Commit Graph

744 Commits

Author SHA1 Message Date
Andrey Kashchikhin 2e33019e68
[CI] [GHA] Align pipelines (#20388)
* add ONNX layer tests

* add parallelism for pytest; add missing stages to win; align execution steps

* add missng shell option

* add missing dep, update marker

* align stages and execution commands; rm parallelization

* enable trigger

* add missing export; rm not-applicable stage from mac and win pipeline

* add missing requirement, rm not-applicable stage

* add missing test parameters

* try to pi onnxruntime version; skip mxnet on mac; correct vars in win

* rm constraint

* skip on win

* use xfail

* remove always(), rm trigger for mac

* return push trigger for mac
2023-10-13 23:48:15 +04:00
Ekaterina Aidova 9bedafb560
[PT FE]: support aten::erf and aten::adaptive_avg_pool1d (#20350)
* [PT FE]: support aten::erf and aten::adaptive_avg_pool1d

* align adaptive avg pools for different sizes

* refactor adaptive max pool
2023-10-11 17:33:32 +04:00
Przemyslaw Wysocki 3403e6c028
Add torch lower bound (#20362) 2023-10-11 14:22:26 +02:00
Roman Kazantsev 0bb6450398
[TF FE] Support TF 2.14 and add OnesLike translator (#20385)
* [TF FE] Support TF 2.14 and add OnesLike translator

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Update tests constraints

* Update open_model_zoo

* Adopt TF Lite test to 2.14 TF

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Support TF Lite layer tests for diffrent TF versions

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-10-11 15:24:32 +04:00
Ilya Lavrenov 35308ce34d
Use np.float32 instead of np.float (#20377) 2023-10-11 03:29:56 +04:00
Ilya Lavrenov df55e282e3
Update tensorflow requirement in /src/bindings/python (#20372)
Updates the requirements on [tensorflow](https://github.com/tensorflow/tensorflow) to permit the latest version.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v1.15.5...v2.14.0)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-11 02:18:14 +04:00
Ilya Lavrenov b3ead62631
Fixed numpy deprecation error (#20375) 2023-10-11 00:38:23 +04:00
Andrey Kashchikhin 3ebadc14d1
[CI] [GHA] mac pipeline review leftovers; small cleanup of the Linux pipeline (#20353)
* skip gna-related tests on mac; rm unused in pipelines

* rm unused env var

* use if instead of commenting out

* add name

* return pr trigger

* rm pr trigger
2023-10-10 17:10:46 +04:00
Ekaterina Aidova 0dcde7f7bc
[PT FE]: support aten::pixel_unshuffle (#20325) 2023-10-10 15:18:35 +04:00
Ekaterina Aidova a5b6606132
[PT FE]: support aten::amax, aten::amin, aten::clip, aten::clamp_ (#20338) 2023-10-10 11:05:10 +00:00
Andrey Kashchikhin 1454e77bbf
[CI] [GHA] Introduce GHA macOS Pipeline (#20212)
* start transferring

* start with samples

* start with initial two stages

* change name

* skip pytorch tests; rm unused comments

* rm setupvars sourcing; make test steps similar to those in linux pipeline

* add missing options and setupvars sourcing

* add skips for mac

* install wheels directly

* add deployment target

* add skips for pytorch layer tests; experiment with samples

* do not exclude files for archives; set rpath

* apply comments; rm unnecessary stages

* Update mac.yml

fixed MO Python API tests

* Update .github/workflows/mac.yml

* Update openvino.cmake

add LC_RPATH to libopenvino.dylib

* Update src/cmake/openvino.cmake

* Update CMakeLists.txt

reverted changes in samples build

* Update openvino.cmake

removed rpath changes

* add setupvars

* disable pr trigger

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-10 14:43:09 +04:00
Maxim Vafin 0fec05ecf2
Mark models according to last validation and fix some problems in models (#20324)
* Mark models according to last validation and fix some problems in models

* Update tests/model_hub_tests/torch_tests/hf_transformers_models
2023-10-10 11:23:23 +02:00
Ekaterina Aidova 67a62186ee
support aten::channel_shuffle (#20240)
* support aten::channel_shuffle

* remove getting rank
2023-10-10 08:16:26 +02:00
Maxim Vafin feaf05cc5f
[PT FE] Support aten::max_poolnd_with_indices (#20322) 2023-10-10 08:00:02 +02:00
Ilya Lavrenov ead4b8a0ec
Moved cmake functions, variables to API 2.0 naming style (#20281)
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU
2023-10-09 22:30:32 +04:00
Mikhail Ryzhov 7e7b6482aa
[GHA][HF] Switch python nightly tests to github runners (#20286)
* switched runners to GHA

* excluded timm models from nightly scope

* added sudo steps

* switched precommit too
2023-10-07 02:22:32 +04:00
Ekaterina Aidova bb2c2fab6c
[PT FE]: support aten::log1p, fixes for where and linalg_norm (#20167)
* [PT FE]: support aten::log1p, fixes for where and linalg_norm

* clarify norm behaviour
2023-10-06 08:26:12 +00:00
Maxim Vafin 6664164ce4
Fix results validation (#20246)
* Fix results validation

* Remove pt quantization

* Apply suggestions from code review

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Refactor requirements

* Revert "Refactor requirements"

This reverts commit f78fe3d774.

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-10-05 18:31:06 +04:00
Roman Kazantsev 747a799e8b
[PyTorch FE] Set upper-bound for PyTorch (#20251)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-10-05 11:53:06 +04:00
Maxim Vafin 35e72251e9
[PT FE] Add support for aten::numpy_T and aten::feature_dropout (#20136)
* Add support for aten::numpy_t and aten::feature_dropout

* Update tests/layer_tests/pytorch_tests/test_transpose.py

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>

---------

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>
2023-10-03 09:52:29 +00:00
Vitaliy Urusovskij 78ef7e85c9
Return missed `return pmc;` (#20118) 2023-10-02 14:01:18 +04:00
Roman Kazantsev b409ea1930
[TF FE] Support TF1 While Control flow (#20105)
* [TF FE] Support TF1 While Control flow

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply code-style fix

* Update API for OpPlace to store back edge

* Fix build: no rvalue by reference passing

* Fix build issue: correct type

* Fix TF FE unit-tests

* Apply code-review feedback: remove unused vars

* Fix fusing complicated case of TF1 While

* Remove unused variable

* Update MO unit test

* Fix layer tests for While

* Handle Switch and NextIteration nodes connected directly

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-10-02 09:56:10 +04:00
Maxim Vafin f38b5f4f06
[PT FE] Support moving TupleConstruct inside If body (#20081)
* Support moving TupleConstruct inside If body

* Fix win build

---------

Co-authored-by: Alina Kladieva <alina.kladieva@intel.com>
2023-09-28 23:11:09 +02:00
Maxim Vafin 64cc3a96bb
Restrict version of pytorch-quantization (#20137) 2023-09-28 23:11:41 +04:00
Mikhail Ryzhov f85a276782
[GHA] Azure pip cache (#20029)
* switched PyTorch_Models

* fixed root issue

* upgrade pip

* set bash environments

* install pip deps

* added git installation

* added g++ deps

* added python-dev package

* get particular python-dev package

* fixed package name

* removed python-dev

* cython dep

* debug

* fixed inlude path

* test cache

* set home dir

* changed disk space calculation

* crosspipeline pip cache

* added tag for source builded deps

* immutable deps

* use commit id instead of tag

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* fixed logs upload condition

* removed pip upgrade

* changed  detectotron version

* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* changed wheel installation way

* reset onednn

* added cleanup workload

* cleanup test

* fixed reqs install

* test cache depending on pip version

* syntax fix

* env overwriting test

* test env output

* fixed set env step

* move pip cahc initialization to step

* changed pip ver regexp

* set custom pip cahce for each step

* cleanup code and enabled test cleanup job

* test cleanup 2

* speedup removal

* check existed dir

* Enabled cache for samples job

* removed debug job

* changed way how to get pip ver

* improved pip version extration

* revert omz

* switched PyTorch_Models

* fixed root issue

* upgrade pip

* set bash environments

* install pip deps

* added git installation

* added g++ deps

* added python-dev package

* get particular python-dev package

* fixed package name

* removed python-dev

* cython dep

* debug

* fixed inlude path

* test cache

* set home dir

* changed disk space calculation

* crosspipeline pip cache

* added tag for source builded deps

* immutable deps

* use commit id instead of tag

* Update .github/workflows/linux.yml

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* fixed logs upload condition

* removed pip upgrade

* changed  detectotron version

* Update tests/model_hub_tests/torch_tests/requirements_secondary.txt

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* changed wheel installation way

* added cleanup workload

* reset onednn

* cleanup test

* fixed reqs install

* test cache depending on pip version

* syntax fix

* env overwriting test

* test env output

* fixed set env step

* move pip cahc initialization to step

* changed pip ver regexp

* set custom pip cahce for each step

* cleanup code and enabled test cleanup job

* test cleanup 2

* speedup removal

* check existed dir

* Enabled cache for samples job

* removed debug job

* changed way how to get pip ver

* improved pip version extration

* revert omz

* review fixes

* remove  cache files using atime

* mtime->atime

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-28 22:21:32 +04:00
Maxim Vafin 84d98d8bf7
[PT FE] Add support for aten::pixel_shuffle (#20124)
* [PT FE] Add support for aten::pixel_shuffle

* Add comments

* Update src/frontends/pytorch/src/op/pixel_shuffle.cpp
2023-09-28 19:09:54 +02:00
Maxim Vafin fea6db1a5f
[PT FE] Fix issue when cat input is folded to tensor (#20090)
* [PT FE] Fix issue when cat input is folded to tensor

* CHeck real first input

* Update src/frontends/pytorch/src/op/cat.cpp
2023-09-28 10:52:09 +02:00
Ilya Lavrenov 8349849e1c
Use FindPython3.cmake (#19847)
* Use FindPython3.cmake

* Fixed compilation on macOS 14 with new core development tools

* Try to use Python3_SOABI instead of PYTHON_MODULE_EXTENSION

* Use Development.Module

* Keep specifying only Python3_EXECUTABLE

* Print PYTHON_MODULE_EXTENSION

* Added check for minimal cmake version for python API

* Returned Python3_INCLUDE_DIR for cross-compilation case

* Try to allow cmake older than 3.18

* Use build python interpreter to check cython dependency

* revert changes in .ci/openvino-onnx/Dockerfile

* removed unused code

* Fixed issue with variables scope

* Experiment: remove include dirs

* Corrected docs

* Use pybind11 function to set extension

* Revert "Experiment: remove include dirs"

This reverts commit 6f7f90211c.

* Refactor ConvolutionBackpropDataLayerTest, ConvolutionLayerTest, DeformableConvolutionLayerTest (#19810)

* Refactor ConvolutionBackpropDataLayerTest

* Refactor ConvolutionLayerTest

* Refactor DeformableConvolutionLayerTest

* Apply comments

* Apply comments

* Fix

* Updated minimum cmake version for Windows

* Simplified check

* Removed useless message status

* Use puiblic option

---------

Co-authored-by: Oleg Pipikin <oleg.pipikin@intel.com>
2023-09-26 20:57:29 +02:00
Anastasiia Pnevskaia 2bbfe7b44d
Added support of shapes and types from original FW in ov.convert_model() (#20009)
* Added support of shapes and types from paddle, torch and tf.

* Removed changes from requirements.

* Corrected test.

* Moved helper methods to utils.

* Separated tests by frameworks.

* Removed changes from complex_params test.
2023-09-26 17:41:01 +04:00
Ilya Lavrenov 85145cd60c
Refactored Linix GHA pipeline (#20021)
* Refactored Linix GHA pipeline

* Move ONNX tests to Unit

* Install tests together with openvino

* Added checks for GNA usage in docs python snippets

* Install openssl for working pip

* Disabled onnx_dyn_shapes_expand_1_dyn_shape ONNX test

* exclude dyn shapes from onnx

* Migrated samples tests

* Fixed ONNX tests

* caches for PT tests dependencies

* Build Contrib separately from main OpenVINO

* More fixes

* Added python install for samples stage

* Installed manifests for ONNX FE tests

* Try to avoid libgl1 dependency in tests

* Clean-up

* Fixed issue with manifests in ONNX tests
2023-09-25 17:00:30 +04:00
Maxim Vafin f735999e7b
Improve testing for hf models (#20017) 2023-09-22 20:10:33 +00:00
Ekaterina Aidova c76475288b
[PT FE]: support aten::scatter_reduce and extend aten::scatter (#19980)
* [PT FE]: support aten::scatter_reduce and extend aten::scatter out arg support

* create mapping inside function
2023-09-22 15:05:33 +04:00
Pavel Esir 9271b79540
[OVC] do not parse inputs for py_api (#19742)
* [OVC] do not parse inputs

* fix unit-tests

* remove redundant lines, add test case

* add one more unit-test

* skip None values

* replace str with List in test_mo_import_from_memory

* corrected type hints, added a safety assert
2023-09-22 15:05:21 +04:00
Ekaterina Aidova 26d18c924b
[PT FE]: support aten::broadcast_tensors (#19994)
* broadcast tensors

* [PT FE]: support aten::broadcast_tensors

* apply review comments

* remove add
2023-09-22 13:54:44 +04:00
Maxim Vafin 2151e5f979
[PT FE] Add tests for timm models (#19997)
* Add tests for timm models

* Apply suggestions from code review

* Some improvements

* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-22 10:34:07 +02:00
Ekaterina Aidova 8d59fcd34f
[PT FE]: extend logical operations support (#19981)
* [PT FE]: extend logical operations support

* tests

* more tests
2023-09-22 10:11:36 +04:00
Ekaterina Aidova fde054e4a6
[PT FE]: support aten::minimum aten::maximum (#19996) 2023-09-22 09:30:57 +04:00
Maxim Vafin 058b45e608
[PT FE] Fix aten::repeat regression (#19991)
* Revert "[PT FE] Simplify repeat operation (#19926)"

This reverts commit f926e0e392.

* Fix aten::repeats regression

* Simplify

* Update src/frontends/pytorch/src/op_table.cpp

* Add impacted model
2023-09-21 23:58:09 +02:00
Maxim Vafin 02f5b7a7e3
[PT FE] Add huggingface hub tests (#19858)
* [PT FE] Add huggingface hub tests

* Update requirements.txt

* natten can't be installed

* Remove librosa

* Add xfail and skip marks

* Remove t5

* Free up space

* Apply suggestions from code review

* Report free space

* Clean pip cache

* Temporarily disable det2 models

* More du info

* Remove tmp info

* More du stats

* Fix du report

* Optimize du

* Ignore error

* Finalize changes

* Update tests/model_hub_tests/torch_tests/test_transformers.py
2023-09-21 17:30:17 +02:00
Vitaliy Urusovskij b00fbd04c5
Fix `StressMemLeaksTests` with several models (#19986)
* Fix `StressMemLeaksTests` with several models

* Fix OMZ branch name in `get_testdata.py`
2023-09-21 15:59:18 +02:00
Maxim Vafin 37d54bcb42
[PT FE] Support prim::TupleIndex operation (#19978)
* [PT FE] Support prim::TupleIndex

* Update src/frontends/pytorch/src/op/tuple_index.cpp

* Update src/frontends/pytorch/src/op/tuple_index.cpp
2023-09-21 15:57:42 +02:00
Ekaterina Aidova 2c88fbf798
[PT FE]: support mixed precision in aten::min/max (#19936)
* [PT FE]: support mixed precision in aten::min/max

* fix eltwise dtype alignment for float16
2023-09-20 11:26:18 +04:00
Anastasiia Pnevskaia 215a2f435b
tf.Graph decoder accuracy fixes (#19903)
* Fixed outputs passing from decoder.

* Fixed get_variable method.

* Code style.

* Removed xfails from precommit models.

* Minor fix.

* Comment fixed.

* Added test.
2023-09-19 19:04:24 +02:00
dependabot[bot] 472ad39a9d
Update numpy requirement from <1.26,>=1.16.6 to >=1.16.6,<1.27 in /tests (#19938)
Updates the requirements on [numpy](https://github.com/numpy/numpy) to permit the latest version.
- [Release notes](https://github.com/numpy/numpy/releases)
- [Changelog](https://github.com/numpy/numpy/blob/main/doc/RELEASE_WALKTHROUGH.rst)
- [Commits](https://github.com/numpy/numpy/compare/v1.16.6...v1.26.0)

---
updated-dependencies:
- dependency-name: numpy
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-09-19 18:18:42 +04:00
Roman Kazantsev a139fb48b7
[TF FE][JAX] Add upper bound for jax dependencies (#19943)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-19 14:00:54 +04:00
Vitaliy Urusovskij 6b5a22a656
Add `bert-base-ner` in MemLeak tests (#19817)
* Add `bert-base-ner` in MemLeak tests

* Fix segfault caused by `fillTensorRandom()`
2023-09-19 11:27:23 +04:00
Roman Kazantsev 6556d07c32
[TF FE][Tests] Fix sporadic failure in CTCLoss test (#19920) 2023-09-18 20:25:44 +00:00
Maxim Vafin c10b45fe9e
[PT FE] Fix issue with http error when using torch.hub (#19901)
* [PT FE] Fix issue with http error when using torch.hub

* Mark failing models as xfail

* Remove incorrect model names
2023-09-18 17:04:39 +02:00
Roman Kazantsev d90ceb93d1
[TF Hub][TF FE] Fix 5D case for FusedBatchNorm (#19904)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-18 12:51:33 +00:00
Roman Kazantsev df19699e3a
[TF Hub API][TF FE] Support TF Keras Model OOB without example_input (#19892)
* [TF Hub] Cover TF Hub use cases with adoption to OpenVINO

This is necessarily to demonstrate support of models programmed with TF Hub API
through OV notebooks.

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Preserve original keras input and output tensor names

* Add tests with TF Hub API models

* No KerasLayer handling

* Handle specific signature

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-09-18 12:18:05 +00:00