Commit Graph

26 Commits

Author SHA1 Message Date
Andrei Kashchikhin 10177bfb89
[CI] [GHA] Introduce Dockerfiles for test jobs (#24742)
### Tickets:
 - *141574*
2024-05-30 09:46:12 +00:00
Andrei Kashchikhin f028ecf0f7
[CI] [GHA] Investigate and mitigate Mac workflows (#24631)
### Tickets:
 - *142049*
2024-05-23 19:58:53 +00:00
Alina Kladieva e4670660a0
[GHA][CVS-112829] Public Dockerfile (#23064)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Mikhail Ryzhov <mikhail.ryzhov@intel.com>
2024-05-02 17:44:03 +00:00
Mikhail Ryzhov a6265c136b
[GHA] Move tokenizers build to reusable job (#23909)
### Details:
 - Move tokenizers build to reusable job

### Tickets:
 - *132908*

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-04-19 19:12:17 +00:00
Roman Kazantsev 1496229908
[TF FE] Switch TF2 Keras layer tests to precommit mark (#24010)
**Details:** Switch TF2 Keras layer tests to precommit mark.

**Ticket:** TBD

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-04-15 14:14:14 +00:00
Roman Kazantsev 0852da2a13
[TF FE] Remove MO legacy deps for TF FE layer tests (#24005)
**Details:** Remove MO legacy deps for TF FE layer tests

**Ticket:** TBD

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-04-12 14:52:54 +00:00
Surya Siddharth Pemmaraju a5cf8b30d5
Quantization support for torch.compile (#23779)
### Details:
 - Added support for Quantization in torch.compile
 - Removed Torchscript backend
 - Removed Environment variables for setting options

### Tickets:
 - https://jira.devtools.intel.com/browse/CVS-107243
 - https://jira.devtools.intel.com/browse/CVS-131521

---------

Co-authored-by: ynimmaga <yamini.nimmagadda@intel.com>
2024-04-03 12:36:56 +00:00
Roman Kazantsev 4760b5b75b
[TF FE] Replace precommit_tf_fe marker with precommit (#23667)
**Details:** It allows to run layer tests on GPU in precommit

**Ticket:** TBD

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-03-28 13:43:19 +00:00
Pranshu Shukla b520763404
[TF FE] Enable parallel execution of TensorFlow Layer 2 python tests (#23344)
Addresses issue: #20919 

### Details:
- Enables parallel execution of TensorFlow Layer 2 python tests
- Fixes test_tf2_keras_conv_lstm_2d.py and test_tf2_map_fn.py to not
fail during parallel execution
- Appends args in github workflow to enable parallel execution

Errors fixed:
- Due to varying Kera activation function addresses causing the workers
to get different parameter inputs and thus failing. See [known
issue](https://pytest-xdist.readthedocs.io/en/stable/known-limitations.html#order-and-amount-of-test-must-be-consistent)
```
-tensorflow2_keras_tests/test_tf2_keras_conv_lstm_2d.py::TestKerasConvLSTM2D::test_keras_conv_lstm_2d_basic[ ie_device:CPU - precision:FP32 - params:{'params': {'filters': 4, 'kernel_size': (3, 3), 'padding': 'same', 'return_sequences': False, 'activation': <function swish at 0x7f1fadf364d0>}, 'input_shapes': [[2, 5, 20, 30, 2]]} ]
-tensorflow2_keras_tests/test_tf2_keras_conv_lstm_2d.py::TestKerasConvLSTM2D::test_keras_conv_lstm_2d_basic[ ie_device:CPU - precision:FP32 - params:{'params': {'filters': 6, 'kernel_size': (2, 3), 'padding': 'valid', 'dilation_rate': 3, 'recurrent_activation': <function elu at 0x7f1fe6a1a830>, 'return_sequences': True, 'use_bias': True, 'data_format': 'channels_first'}, 'input_shapes': [[2, 5, 1, 40, 30]]} ]
+tensorflow2_keras_tests/test_tf2_keras_conv_lstm_2d.py::TestKerasConvLSTM2D::test_keras_conv_lstm_2d_basic[ ie_device:CPU - precision:FP32 - params:{'params': {'filters': 4, 'kernel_size': (3, 3), 'padding': 'same', 'return_sequences': False, 'activation': <function swish at 0x7f635e4d24d0>}, 'input_shapes': [[2, 5, 20, 30, 2]]} ]
+tensorflow2_keras_tests/test_tf2_keras_conv_lstm_2d.py::TestKerasConvLSTM2D::test_keras_conv_lstm_2d_basic[ ie_device:CPU - precision:FP32 - params:{'params': {'filters': 6, 'kernel_size': (2, 3), 'padding': 'valid', 'dilation_rate': 3, 'recurrent_activation': <function elu at 0x7f6396fa2830>, 'return_sequences': True, 'use_bias': True, 'data_format': 'channels_first'}, 'input_shapes': [[2, 5, 1, 40, 30]]} ]
```

- Due to lambda function definitions giving varying addresses as inputs
```
-tensorflow2_keras_tests/test_tf2_map_fn.py::TestMapFN::test_multiple_inputs_outputs_int32[ ie_device:CPU - precision:FP32 - params:{'fn': <function TestMapFN.<lambda> at 0x7f66c2c63c70>, 'input_type': tf.int32, 'fn_output_signature': (tf.int32, tf.int32, tf.int32), 'back_prop': True, 'input_names': ['x1', 'x2', 'x3'], 'input_shapes': [[2, 1, 3, 4], [2, 1, 3, 4], [2, 1, 3, 4]]} ]
-tensorflow2_keras_tests/test_tf2_map_fn.py::TestMapFN::test_multiple_inputs_outputs_int32[ ie_device:CPU - precision:FP16 - params:{'fn': <function TestMapFN.<lambda> at 0x7f66c2c63c70>, 'input_type': tf.int32, 'fn_output_signature': (tf.int32, tf.int32, tf.int32), 'back_prop': True, 'input_names': ['x1', 'x2', 'x3'], 'input_shapes': [[2, 1, 3, 4], [2, 1, 3, 4], [2, 1, 3, 4]]} ]
+tensorflow2_keras_tests/test_tf2_map_fn.py::TestMapFN::test_multiple_inputs_outputs_int32[ ie_device:CPU - precision:FP32 - params:{'fn': <function TestMapFN.<lambda> at 0x7f211b56fd00>, 'input_type': tf.int32, 'fn_output_signature': (tf.int32, tf.int32, tf.int32), 'back_prop': True, 'input_names': ['x1', 'x2', 'x3'], 'input_shapes': [[2, 1, 3, 4], [2, 1, 3, 4], [2, 1, 3, 4]]} ]
+tensorflow2_keras_tests/test_tf2_map_fn.py::TestMapFN::test_multiple_inputs_outputs_int32[ ie_device:CPU - precision:FP16 - params:{'fn': <function TestMapFN.<lambda> at 0x7f211b56fd00>, 'input_type': tf.int32, 'fn_output_signature': (tf.int32, tf.int32, tf.int32), 'back_prop': True, 'input_names': ['x1', 'x2', 'x3'], 'input_shapes': [[2, 1, 3, 4], [2, 1, 3, 4], [2, 1, 3, 4]]} ]
```

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-03-23 08:36:18 +00:00
Maxim Vafin 8b792927fa
[PT FE] Support multiple FX operations (#23112)
### Details:
 - *Unpack nested tuples at model outputs*
 - *Support for `aten.cat.default` with default axis*
 - *Support `aten::reciprocal_` and `aten::abs_` for TorchScript case*
 - *Support:*
    *  `aten.adaptive_max_pool3d.default`
    *  `aten.adaptive_max_pool{N}d.default`
    *  `aten.amin.default`
    *  `aten.argmin.default`
    *  `aten.bitwise_{XXX}.default`
    *  `aten.clamp_max.default`
    *  `aten.clamp_{max/min}.Tensor`
    *  `aten.fill.Tensor`
    *  `aten.flip.default`
    *  `aten.fmod.{Scalar/Tensor}`
    *  `aten.ge.{Scalar/Tensor}`
    *  `aten.gt.Tensor`
    *  `aten.index_select.default`
    *  `aten.le.{Scalar/Tensor}`
    *  `aten.log{10/1p/2}.default`
    *  `aten.{max/maximum/mean/min/minimum}.default`
    *  `aten.min.dim`
    *  `aten.ne.Tensor`
    *  `aten.pow.{Scalar/Tensor_Tensor}`
    *  `aten.reciprocal.default`
    *  `aten.rsub.Tensor`
    *  `aten.scatter.value`
    *  `aten.select_scatter.default`
    *  `aten.sign.default`
    *  `aten.sqrt.default`
    *  `aten.sum.default`
    *  `aten.unfold.default`
    *  `aten.var.correction`
    *  *trigonometric ops*

 - *Enabled layer tests for added ops for torch.export case*

### Tickets:
 - *ticket-id*
2024-02-29 16:14:31 +00:00
Andrei Kashchikhin 7ceff6a580
[CI] [GHA] Transition to the v4 for `actions/upload` and `actions/download`-`artifact` (#23142)
### Details:
- Should improve uploading and downloading stability of larger artefacts
(e.g., test packages), and [improve
speed](https://github.blog/changelog/2023-12-14-github-actions-artifacts-v4-is-now-generally-available/).

### Tickets:
 - *133744*
2024-02-28 17:22:05 +00:00
Andrei Kashchikhin 6145490ad4
[CI] [GHA] Investigate and resolve macOS workflows issues (#22840)
### Details:
 - The macOS x64 and arm workflows are broken.
- One of the issues is that `apt` retries are set unconditionally in
various reusable workflows when `apt` is only available on Linux.
- There was no `Smart_CI` job requirement for the `Samples` job in the
ARM mac workflow leading to it being broken.
- Several tests started failing, they are skipped in this PR with an
appropriate ticket.

### Tickets:
 - *132596*

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2024-02-21 17:49:53 +00:00
Roman Kazantsev 9b22324109
[TF FE][OV Tokenizers] Deploy use of OpenVINO Tokenizers in FE layer tests (#22896)
**Details:** We are going to test OpenVINO Tokenizers conversion
extensions by FE layer tests. It gives better quality integration
between openvino and openvino-tokenizers. For example, operation on
string tensors such as tf.raw_ops.StringLower, tf.raw_ops.StringSplitV2
will supported via OV tokenizers near feature until we move them into
core part.

**Ticket:** 132667

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-02-17 17:32:05 +00:00
Roman Kazantsev 3d2c15ffd9
[TF FE][Layer tests] Run layer tests for TF FE by default and use_legacy_frontend for legacy FE (#22848)
**Details:** Run layer tests for TF FE by default and
use_legacy_frontend for legacy FE. Developers have to add
`use_new_frontend` for running layer tests for TF FE. This is not
convenient. Instead, let us use `use_legacy_frontend` option for legacy
FE that is rarely run.

**Tickets:** TBD

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-02-15 15:42:06 +00:00
Surya Siddharth Pemmaraju 19ba148b4f
Op support 2024.0 (#22745)
### Details:
 - Improved op support for 2024.0 release
 - Includes ops required for enabling customer model lightglue
 - Also added ops for lora fine tuning
 - Added support for options in aot autograd backend
- Added a new option to specify whether to use aot autograd
functionality
 - Added a new option to specify decompositions that need to be added
- Added a new option to specify ops that need to be disabled from
executing on OpenVINO


### Tickets:
 - https://jira.devtools.intel.com/browse/CVS-116702
 - https://jira.devtools.intel.com/browse/CVS-120276

---------

Co-authored-by: ynimmaga <yamini.nimmagadda@intel.com>
2024-02-13 12:13:42 +00:00
Andrei Kashchikhin dab68a88bb
[CI] [GHA] Add retries for APT, update deadsnakes action (#22515)
* update setup_python version, add retries for apt in Linux workflows

* account for sudo

* use sudo via sh
2024-01-30 14:03:40 +00:00
Maxim Vafin d018779add
[PT FE] torch.export support (#22397)
* [PT FE] torch.export support

* Apply code style

* Fix build

* Support torch <2.2

* Support more operations

* Update tests/model_hub_tests/torch_tests/torch_utils.py

* Support for model operations

* Support is_causal as kwarg for SDPA

* Update src/frontends/pytorch/src/op/addcmul.cpp

* Update tests/model_hub_tests/torch_tests/test_timm.py

* Support only decoder passed to convert_model

* Fix tests

* Update src/bindings/python/src/openvino/frontend/pytorch/fx_decoder.py

* Update src/bindings/python/src/openvino/frontend/pytorch/fx_decoder.py

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>

* Apply suggestions from code review

* Apply suggestions from code review

* Improve testing with caching model

* Apply suggestions from code review

---------

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>
2024-01-30 11:50:18 +00:00
Oleg Pipikin 1ed7b50130
Disable proxy for GPU plugin (#22235)
* Disable proxy for GPU

* Fix
2024-01-26 04:54:57 +00:00
Rajat Krishna 1a8f72f342
Parallel execution of TensorFlow Layer 1 Python tests (#22173)
* Update TF Layer 1 tests

* Enable parallel execution of tests

* Fix typo

* Fix typo

* Enable parallel tensorflow tests for windows

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-01-18 18:46:20 +04:00
Anastasia Kuporosova d843a33551
[PyOV] clean up after legacy python api removal (#22101) 2024-01-11 20:14:04 +01:00
Aleksandr Voron e99af17296
[CPU][ARM] Set `arm64-v8.2-a` as a default architecture (#21545) 2024-01-03 16:39:13 +04:00
Anastasia Kuporosova 5da132bdfe
[PyOV] Delete compatibility tests (#21820)
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-12-22 17:13:21 +01:00
Ilya Lavrenov 662aa57a92
Downgrade GHA for upload / download back to @v3 (#21770) 2023-12-20 00:48:31 +04:00
Ilya Lavrenov ccc79fb691
Updated versions for upload / download artifacts actions (#21691) 2023-12-15 20:43:22 +04:00
Alina Kladieva 06a27e7b31
[GHA] Add Smart CI to Windows pipeline (#21558)
* [GHA] Add Smart CI to Windows pipeline

* Remove Smart CI from Python API units due to 127101

* Rename overall GHA status check for Windows
2023-12-09 01:50:14 +04:00
Andrey Kashchikhin dfc91186a1
[CI] [GHA] Extract test jobs into reusable workflows (#21395)
* extract cpu func tests into a reusable workflow

* add needs

* check paths

* correct paths

* rm usage of setupvars

* extract samples

* use yaml string

* split mac workflow

* check variables

* try github workspace

* check full dir

* set variables

* try with sub directory

* Revert "try with sub directory"

This reverts commit d891ee3f28.

* extract c++ tests from linux

* change

* use cxx workflow in mac workflows

* add noninteractive

* extract cpu func tests

* rm unused

* enable mac

* fix reusable workflow name

* correct path for sparse-checkout

* extract python UT

* remove unnecessary asterisk

* remove another unnecessary asterisk

* use reusable action for linux cc

* add check for setupvars existence

* check with manually installed opencl

* add components input to samples workflow; rm pr triggers for mac workflows

* add missing needs

* add missing option for deps install  script

* use disables in test themselves instead of ifs in workflows

* use reusable workflow for cxx tests in linux arm

* use python reusable workflow in linux arm

* add missing endif

* use self-hosted for samples, add x86_64 constraint for jax

* check paths

* find gompby partial name

* skip failing tests on arm; correct gomp finding for ovc

* check tests

* add debian packages job; use job_ prefix for reusable workflows with jobs

* extract tf hub model tests

* extract tf model hub perf tests

* extract pytorch models tests

* do not use container on GHA runners

* extract onnx runtime

* add missing deps

* skip test for linux arm

* rm always()s

* fix quotes

* correct paths

* correct ifs, check dir for onnxruntime

* correct path for onnxruntime utils folder; install python3

* use self-hosted as input

* check for self-hosted runner via name, pass version

* skip cpu plugin unittest

* check cxx tests

* rm pr trigger
2023-12-07 23:44:45 +04:00