Commit Graph

1034 Commits

Author SHA1 Message Date
Maxim Vafin 03fa47a2ff
Refactor hf GHA tests (#24048)
### Details:
 - *Refactor hf tests*

### Tickets:
 - *ticket-id*
2024-04-16 14:27:34 +00:00
Roman Kazantsev 1496229908
[TF FE] Switch TF2 Keras layer tests to precommit mark (#24010)
**Details:** Switch TF2 Keras layer tests to precommit mark.

**Ticket:** TBD

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-04-15 14:14:14 +00:00
Luca Tam e3fbb5733b
[PT FE] Support aten::aminmax for pytorch models (#23879)
### Details:
 - Implemented `aten::aminmax` operation
 - Implemented test for aminmax op
 - registered inside `op_table.cpp`

### Tickets:
 - #23327

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2024-04-15 09:46:05 +00:00
Hongbo Wei 0287267a8d
[TF FE]: Support MatrixInverse operation for TensorFlow (#23881)
This pull request adds support for the TensorFlow "**MatrixInverse**"
operation to OpenVINO's TensorFlow Frontend (TF FE). It implements a new
loader function translate_matrix_inverse_op that translates the
TensorFlow operation into the equivalent OpenVINO Inverse operation
(from opset-14) for both real-valued and complex-valued inputs.

Addresses issue:
#[22957](https://github.com/openvinotoolkit/openvino/issues/22957)

Hi Roman @rkazants, could you please review my work, thank you!

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-04-13 17:26:56 +00:00
Roman Kazantsev 0852da2a13
[TF FE] Remove MO legacy deps for TF FE layer tests (#24005)
**Details:** Remove MO legacy deps for TF FE layer tests

**Ticket:** TBD

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-04-12 14:52:54 +00:00
Maxim Vafin 2eb09a4d07
[FX] Remove unused code from FX decoder (#23954)
### Details:
 - *Remove unused code from FX decoder*

### Tickets:
 - *ticket-id*
2024-04-11 12:42:52 +00:00
Luca Tam bf832a481d
[TF FE] Add layer test for Round operation (#23921)
### Details:
 - Added tests for Round op for both real and complex tensors
 - Added support for handling complex tensors for the Round operation

### Tickets:
 - #23237

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-04-10 10:14:42 +00:00
Roman Kazantsev 7a10b94cc0
[TF FE] Support StringHashBucketFast operation (#23946)
**Details:** Support StringHashBucketFast operation. Needed for several
models from TF Hub. Merge after
https://github.com/openvinotoolkit/openvino_tokenizers/pull/115

**Ticket:**

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-04-10 04:17:55 +00:00
Maxim Vafin 3caf888636
[PT FE] Resolve issue with If test (#23898)
### Details:
 - *Resolve issue with `If` test*

### Tickets:
 - *CVS-123727*
2024-04-08 15:04:12 +00:00
Anastasiia Pnevskaia 81599b790b
[TF FE] Increased HF nightly scope. (#23480)
### Details:
 - Increased HF nightly scope.

### Tickets:
 -
2024-04-05 12:48:44 +00:00
Maxim Vafin 621b025bef
[PT FE] Fix coverity issues (#23834)
### Details:
 - *Fix coverity issues*
 - *Removed unfinished list support POC*

### Tickets:
 - *CVS-136547*
2024-04-05 10:46:17 +00:00
Maxim Vafin 4ef40f0f0e
[PT FE] Fix GHA model tests (#23846)
### Details:
 - *Added `kornia` dependency for lightglue model*
 - *Disable GFPGAN since it doesn't support latest `torchvision`*
 - *Remove `transfo-xl-wt103` as not supported on latest `transformers`*
 - *Remove XFAIL from `facebook/levit-128S`*

### Tickets:
 - *ticket-id*
2024-04-05 06:30:50 +00:00
Roman Kazantsev 740be35b8f
[TF FE] Add layer test for RaggedTensorToSparse (#23850)
**Details:** Add layer test for RaggedTensorToSparse. Needs to be merged
after https://github.com/openvinotoolkit/openvino_tokenizers/pull/103

**Ticket:** TBD

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-04-04 16:04:28 +00:00
Surya Siddharth Pemmaraju a5cf8b30d5
Quantization support for torch.compile (#23779)
### Details:
 - Added support for Quantization in torch.compile
 - Removed Torchscript backend
 - Removed Environment variables for setting options

### Tickets:
 - https://jira.devtools.intel.com/browse/CVS-107243
 - https://jira.devtools.intel.com/browse/CVS-131521

---------

Co-authored-by: ynimmaga <yamini.nimmagadda@intel.com>
2024-04-03 12:36:56 +00:00
Roman Kazantsev 33206de427
[Layer tests] Use legacy MO API only for legacy tests and optimize imports (#23821)
**Details:** Use legacy MO API only for legacy tests and optimize
imports

**Ticket:** TBD

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-04-03 08:31:27 +00:00
Rinne 8a81500458
[PT TE] Support aten::index_copy_ operation (#23349)
### Details:
 - *Add support for aten::index_copy_ operation*
 - *Add related unit test of it*

### Tickets:
 - *No ticket*

### Related issues
- Closes #21970

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2024-04-03 05:56:57 +00:00
Maxim Vafin ee2962a50c
[OVC] Allow models obtained from torch.export (#23815)
### Details:
 - *Allow models obtained from `torch.export`*

### Tickets:
 - *ticket-id*
2024-04-03 05:56:46 +00:00
Maxim Vafin 9e15d1bb4b
[PT FE] Fix sporadic fail in scatter_reduce test (#23820)
### Details:
 - *Fix sporadic fail in scatter_reduce test*

### Tickets:
 - *CVS-137143*
2024-04-02 21:17:45 +00:00
Pranshu Shukla 2bfa1ee01d
[TF FE] Support complex tensors for Cumsum operation (#23500)
### Details:
- Extends support for CumSum operation to complex types
 - Addresses issue #22949

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-03-30 22:37:48 +00:00
Pranshu Shukla 8482121fc4
[TF FE] Support complex tensors for BiasAdd operation (#23218)
Extending support for BiasAdd operation to complex tensors.
Resolves Issue: #22945

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2024-03-30 14:19:52 +00:00
Luca Tam 5fac80fc78
[TF FE] Supported Complex tensor for AddN op (#23614)
### Details:
- extended addN.cpp file to support complex tensor
- extended test_tf_addN.py with test for complex input

### Tickets:
 - #22944

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-03-28 18:23:35 +00:00
Artyom Anokhov 038e6316e3
Revert "constraints openvino-dev: Limit mpmath<1.4" (#23704)
Reverts openvinotoolkit/openvino#23601

Necessary changes applied in OMZ
https://github.com/openvinotoolkit/open_model_zoo/pull/3935
2024-03-28 17:28:51 +00:00
Roman Kazantsev 4760b5b75b
[TF FE] Replace precommit_tf_fe marker with precommit (#23667)
**Details:** It allows to run layer tests on GPU in precommit

**Ticket:** TBD

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-03-28 13:43:19 +00:00
Piotr Krzemiński cb7212b834
[Spec][Ref][CPU] Improve Inverse testing suite, add LU pseudocode to specification (#22834)
### Details:
 - Improved Inverse testing suite for dynamic shapes in the CPU plugin
 - Introduced random tests to PT FE Inerse testing suite
 - Added LU decomposition pseudocode to spec
 - Removed numpy import from opset/opset14.py
- Moved reference inverse outside inverse namespace and removed inverse
namespace
 - Added label propagation tests
 - Changed bf16 threshold restriction
 - Removed dynamic rank check as it's already present in CPU plugin
 - Simplified check for B => P[i] == j
- Did NOT use std::copy_n as ov::bfloat16 is missing difference_value to
use in std implementations

### Tickets:
 - 133090

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2024-03-28 13:07:57 +00:00
Maxim Vafin fba93854cb
[PT FE] Fix issue with aten.copy in FX graph (#23711)
### Details:
 - *Fix translation for `aten.copy.default`*
 - *Add support for `aten.rand.default`*
 - *Support `vit-mae` model*
 - *Update hf model list with newly added models since list creation*

### Tickets:
 - *CVS-133732*
2024-03-28 13:01:06 +00:00
Rinne 6270a59aa3
[PT FE] Support aten::_unique2 op. (#23506)
### Details:
 - *Add support for aten::_unique2 op*
 - *Add unit test for it*

### Tickets:
 - *No ticket id*

### Related issues

closes: #21972
2024-03-27 16:33:36 +00:00
Rinne 2b9ee66b27
[PT FE] Add support for ones_like and zeros in fx. (#23499)
### Details:
 - *Add support of ones_like and zeros in fx*


These two ops appear in LLaVA and AudioCraft models respectively.

### Tickets:
 - *No ticket id*

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2024-03-27 15:37:06 +00:00
Roman Kazantsev a8cc74e9f9
[PT FE] Xfail scatter_reduce test due to sporadicity (#23716)
**Details:** Xfail scatter_reduce test due to sporadicity

**Ticket:**

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-03-27 17:08:52 +01:00
Maxim Vafin 99715bf875
[PT FE] Add more operators for FX graph (#23698)
### Details:
 - *item1*
 - *...*

### Tickets:
 - *ticket-id*
2024-03-27 07:46:53 +00:00
Evgeny Kotov 22d67427c2
Disable compression to fp16 for optimized models (#23609)
### Details:
 - use PR https://github.com/openvinotoolkit/openvino/pull/22589
 - added unit tests

### Tickets:
 - 126103

---------

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2024-03-27 06:02:11 +00:00
Evgeny Kotov ab64489d9b
Implement performance tests in nightly validation to compare read_model and ovc.convert with OVVP output (#23303)
### Details:
 - add nightly performance tests with skip list
 - [restored PR](https://github.com/openvinotoolkit/openvino/pull/21353)
- [restored PR
#2](https://github.com/openvinotoolkit/openvino/pull/22325)
 - added OVVP support
 - extend skip list with the models that have unstable results

### Tickets:
 - 126282
2024-03-27 06:02:01 +00:00
Maxim Vafin b10877f6e8
[PT FE] Resolve i64 usage in frontend (#23518)
### Details:
 - *Support lightglue*
 - *Support int64 as scalar in PyTorch Frontend*

### Tickets:
 - *CVS-127326, CVS-134328*
2024-03-26 15:57:00 +00:00
Roman Kazantsev 5b3216d8ed
[TF FE] Add testing StringLower and TextVectorization operations on non-ASCII sentences (#23641)
**Details:** Add testing non-ASCII sentences for StringLower operation.
Needs to be merged after
https://github.com/openvinotoolkit/openvino_tokenizers/pull/80.

**Ticket:** 135752

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-03-25 12:29:00 +00:00
awayzjj b8b2bd9be5
Support aten::bucketize for pytorch models #23328 (#23527)
### Closes [#23328
](https://github.com/openvinotoolkit/openvino/issues/23328)
### Details:
 - Support aten::bucketize for pytorch models
2024-03-25 10:03:33 +00:00
Aryan Pandey ed5c543a0a
Fix the aten::mv for pytorch models #22073 (#22677)
### Details:
 - *item1*
 - *...*
Add aten::mv operator
close https://github.com/openvinotoolkit/openvino/issues/22073
### Tickets:
 - *ticket-id*

---------

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2024-03-25 05:55:12 +00:00
rghvsh dbef32e292
[TF FE] Support Angle operation for TensorFlow models (#23028)
### Details:
 - *Support Angle operation for TensorFlow models*
 
### Tickets:
 - Closes #22083

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-03-24 19:48:22 +00:00
Pranshu Shukla b520763404
[TF FE] Enable parallel execution of TensorFlow Layer 2 python tests (#23344)
Addresses issue: #20919 

### Details:
- Enables parallel execution of TensorFlow Layer 2 python tests
- Fixes test_tf2_keras_conv_lstm_2d.py and test_tf2_map_fn.py to not
fail during parallel execution
- Appends args in github workflow to enable parallel execution

Errors fixed:
- Due to varying Kera activation function addresses causing the workers
to get different parameter inputs and thus failing. See [known
issue](https://pytest-xdist.readthedocs.io/en/stable/known-limitations.html#order-and-amount-of-test-must-be-consistent)
```
-tensorflow2_keras_tests/test_tf2_keras_conv_lstm_2d.py::TestKerasConvLSTM2D::test_keras_conv_lstm_2d_basic[ ie_device:CPU - precision:FP32 - params:{'params': {'filters': 4, 'kernel_size': (3, 3), 'padding': 'same', 'return_sequences': False, 'activation': <function swish at 0x7f1fadf364d0>}, 'input_shapes': [[2, 5, 20, 30, 2]]} ]
-tensorflow2_keras_tests/test_tf2_keras_conv_lstm_2d.py::TestKerasConvLSTM2D::test_keras_conv_lstm_2d_basic[ ie_device:CPU - precision:FP32 - params:{'params': {'filters': 6, 'kernel_size': (2, 3), 'padding': 'valid', 'dilation_rate': 3, 'recurrent_activation': <function elu at 0x7f1fe6a1a830>, 'return_sequences': True, 'use_bias': True, 'data_format': 'channels_first'}, 'input_shapes': [[2, 5, 1, 40, 30]]} ]
+tensorflow2_keras_tests/test_tf2_keras_conv_lstm_2d.py::TestKerasConvLSTM2D::test_keras_conv_lstm_2d_basic[ ie_device:CPU - precision:FP32 - params:{'params': {'filters': 4, 'kernel_size': (3, 3), 'padding': 'same', 'return_sequences': False, 'activation': <function swish at 0x7f635e4d24d0>}, 'input_shapes': [[2, 5, 20, 30, 2]]} ]
+tensorflow2_keras_tests/test_tf2_keras_conv_lstm_2d.py::TestKerasConvLSTM2D::test_keras_conv_lstm_2d_basic[ ie_device:CPU - precision:FP32 - params:{'params': {'filters': 6, 'kernel_size': (2, 3), 'padding': 'valid', 'dilation_rate': 3, 'recurrent_activation': <function elu at 0x7f6396fa2830>, 'return_sequences': True, 'use_bias': True, 'data_format': 'channels_first'}, 'input_shapes': [[2, 5, 1, 40, 30]]} ]
```

- Due to lambda function definitions giving varying addresses as inputs
```
-tensorflow2_keras_tests/test_tf2_map_fn.py::TestMapFN::test_multiple_inputs_outputs_int32[ ie_device:CPU - precision:FP32 - params:{'fn': <function TestMapFN.<lambda> at 0x7f66c2c63c70>, 'input_type': tf.int32, 'fn_output_signature': (tf.int32, tf.int32, tf.int32), 'back_prop': True, 'input_names': ['x1', 'x2', 'x3'], 'input_shapes': [[2, 1, 3, 4], [2, 1, 3, 4], [2, 1, 3, 4]]} ]
-tensorflow2_keras_tests/test_tf2_map_fn.py::TestMapFN::test_multiple_inputs_outputs_int32[ ie_device:CPU - precision:FP16 - params:{'fn': <function TestMapFN.<lambda> at 0x7f66c2c63c70>, 'input_type': tf.int32, 'fn_output_signature': (tf.int32, tf.int32, tf.int32), 'back_prop': True, 'input_names': ['x1', 'x2', 'x3'], 'input_shapes': [[2, 1, 3, 4], [2, 1, 3, 4], [2, 1, 3, 4]]} ]
+tensorflow2_keras_tests/test_tf2_map_fn.py::TestMapFN::test_multiple_inputs_outputs_int32[ ie_device:CPU - precision:FP32 - params:{'fn': <function TestMapFN.<lambda> at 0x7f211b56fd00>, 'input_type': tf.int32, 'fn_output_signature': (tf.int32, tf.int32, tf.int32), 'back_prop': True, 'input_names': ['x1', 'x2', 'x3'], 'input_shapes': [[2, 1, 3, 4], [2, 1, 3, 4], [2, 1, 3, 4]]} ]
+tensorflow2_keras_tests/test_tf2_map_fn.py::TestMapFN::test_multiple_inputs_outputs_int32[ ie_device:CPU - precision:FP16 - params:{'fn': <function TestMapFN.<lambda> at 0x7f211b56fd00>, 'input_type': tf.int32, 'fn_output_signature': (tf.int32, tf.int32, tf.int32), 'back_prop': True, 'input_names': ['x1', 'x2', 'x3'], 'input_shapes': [[2, 1, 3, 4], [2, 1, 3, 4], [2, 1, 3, 4]]} ]
```

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-03-23 08:36:18 +00:00
Roman Kazantsev 1ab9bedd81
[TF FE] Support TensorFlow 2.16 (#23562)
**Details:** Support TensorFlow 2.16

**Ticket:** TBD

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-03-21 20:39:39 +00:00
Artyom Anokhov a929c8c7e6
constraints openvino-dev: Limit mpmath<1.4 (#23601)
### Details:
- Limit mpmath because of
https://github.com/pytorch/pytorch/issues/120995 and
https://github.com/sympy/sympy/issues/26273
2024-03-21 20:24:55 +00:00
Monal Singh d5a664a296
[TF FE] Support complex tensors for OnesLike operation (#23445)
### Details:
 - *Adding support for OnesLike operation on complex type tensor*
- Closes #22953

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-03-21 14:17:53 +00:00
Mustafa Cavus 09a388f8e9
Torch Compile - New Op Support (#23310)
New op support for:
 - torch.export updates
 - benchmarking model support
 - chatglm2 support

---------

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: ynimmaga <yamini.nimmagadda@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Co-authored-by: suryasidd <surya.siddharth.pemmaraju@intel.com>
2024-03-21 11:13:09 +00:00
Maxim Vafin d7160d0a34
[PT FE] Make ModuleExtension patching in independent function scope (#23584)
### Details:
 - *Make ModuleExtension patching in independent function scope*

### Tickets:
 - *ticket-id*
2024-03-20 21:03:59 +04:00
Roman Kazantsev 5d5203ba86
[TF FE] Test TextVectorization on white-space string input and Equal on empty string tensor (#23572)
**Details:** Test `tf.keras.TextVectorization` on white-space string
input and Equal on empty string tensor.

**Ticket:** 135749

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2024-03-20 21:02:02 +04:00
Maxim Vafin edcb1b1edc
[PT FE] Add ModuleExtension (#23536)
### Details:
 - *Continuation of #22867*

### Tickets:
 - *CVS-133733*

---------

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
2024-03-20 12:57:53 +00:00
Maxim Vafin 7d5e4afe7e
[PT FE] Fix sporadic issue in quantized tests (#23520)
### Details:
 - *Relax quantized tests condition to remove sporadicity.*

### Tickets:
 - *CVS-129734*
2024-03-19 17:10:40 +00:00
Monal Singh 9f08e406a2
[TF FE] Support complex tensors for Reciprocal operations (#23355)
### Details:
- *Extended loader Reciprocal by propagating ComplexTypeMark from input
to output and to represent output complex type tensor as a
floating-point type tensor with an auxiliary dimension that concatenates
real and imaginary parts of complex tensor.*
- *Performed reciprocal for complex numbers.*
- *Wrapped the complex result with ComplexTypeMark and returned the
result*

### Tickets:
 - #23234

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-03-19 16:22:37 +00:00
Monal Singh 59c6314764
[TF FE] Support ApproximateEqual operation for TensorFlow (#23351)
### Details:
 - *Adding operation support for ApproximateEqual operation*
 - *Addresses issue #22082 *

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-03-18 07:04:48 +00:00
Yongsheng Xu c208a881cb
[TF FE] Support Bincount operation (#23418)
### Details:
 - implemented Bincount op
 - simple test cases

### Tickets:
https://github.com/openvinotoolkit/openvino/issues/22071

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-03-15 19:20:45 +00:00
Roman Kazantsev 217afeecb3
[DOCS][Layer Tests] Update layer test documentation (#23485)
**Details:** Update layer test documentation. It will be used by
external developers and mentioned in GFIs.

**Ticket:** TBD

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Anastasiia Pnevskaia <anastasiia.pnevskaia@intel.com>
2024-03-15 16:17:15 +00:00
awayzjj 2725fb4e4d
[TF FE]: Support complex tensors for PadV2 operations (#22955) (#23388)
Closes https://github.com/openvinotoolkit/openvino/issues/22955
### Details:
- separate input into real and imaginary parts and handle them
separately by padding real or imag parts of padding value to them and
concatenate them finally.

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2024-03-15 13:59:13 +00:00