**Details:** Fix h5py issue in GHA test jobs: `error: libhdf5.so: cannot
open shared object file: No such file or directory`
**Ticket:** TBD
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
### Details:
Numpy started preparation to release 2.0 version.
It brings many breaking changes listed below.
Align with these changes it's a plan for further development
(CVS-138766), for today we want to secure users against unintentional
installation of 2.x version of numpy with OV.
This PR has to be ported for 2024/1 branch
- Preparing to restrict OV to not use release of Numpy 2.0 which may
introduce many breaking changes including:
- required bump of `pybind` to 2.12+
- API and namespaces clean-ups and deprecations
- behavior changes of keywords such as `copy`
- changes to existing and introduction of new dtypes (such as
`StringDType` and possibility of adding custom ones)
- more can be found here:
https://numpy.org/devdocs/release/2.0.0-notes.html
- and here:
https://numpy.org/devdocs/numpy_2_0_migration_guide.html#numpy-2-migration-guide
### Tickets:
- CVS-138838
---------
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
New PR due to merge
conflicts(https://github.com/openvinotoolkit/openvino/pull/22917)
Updated the copyright year from 2018-2023 to 2018-2024 in all openvino
files
Ref. to script: CVS-101144
Command used:
```bash
git grep -lz '2018-2023 Intel Corporation' | xargs -0 sed -i '' -e 's/2018-2023 Intel Corporation/2018-2024 Intel Corporation/g'
```
### Details:
- Extended `Core` class to interact with Remote API via `compile_model`,
`create_context` and `get_default_context`.
- Added `RemoteContext` and `RemoteTensor` classes to Python API.
- Added `ClContext` and `ClImage2DTensor` classes placeholders.
- Added `VADisplayWrapper`, `VAContext` and `VASurfaceTensor` classes.
- Added utility function to raise `NotImplemented` errors.
**TODO list (with cc's):**
- [x] Decide which `VADisplayWrapper` constructors stay.
`VADisplayWrapper(VADisplay device)` (which translates to `void*`) is
quite necessary to pass memory pointers from/to external libraries.
`VADisplayWrapper(std::string& device)` is not necessary as it
introduces additional build dependency on libva itself. However, there
are no standard libva bindings that expose such functionalities.
- [ ] Proposal: change of `create_tensor` to `create_device_tensor ->
RemoteTensor` to make difference clear while API expose
`create_host_tensor -> Tensor`. (cc @ilya-lavrenov @slyalin)
- [x] Question: move CL and libva related classes to specific submodules
`openvino.intel_gpu` or keep it as-is in flat namespace? (cc
@ilya-lavrenov @slyalin @akuporos)
- [x] Decide on how memory management should work. My draft proposal:
expose in future PR as "read-only" via custom bindings to `cl_mem` in
case of accessing `ClImage2DTensor`.
- [x] Add test cases.
### Tickets:
- *129468 and 129469*
---------
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
* [TF FE] Support TensorFlow 2.15
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Use lower version of pylint
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update tools/constraints.txt
* Update tools/constraints.txt
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Get rid of distutils
* get rid of LooseVersion
* try to get rid of clean and copy_file
* fix mo tests
* fix warning in mo
* Update src/bindings/python/wheel/setup.py
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* add packaging to requirements
---------
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* [MO][TF FE] Switch off fallback to legacy FE
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Support complex condition for TF While
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Support TensorArrayV3 of a dynamic size
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Test TensorArrayV3 of dynamic size
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* [MO][TF FE] Remove informative messages about API1.0 and TF FE limitations
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update unit-tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* [ONNX] Switched to ONNX 1.15.0
* Updated usage of ONNX serialization API
* Updated xfailed lists
* Updated xfailed lists
* Added xfailed ML-operators
* Added xfailed float8 cases
* Fixing mo tests
* Reverted legacy tests
* Sets default opset version in layer tests
* Skipped test which breaks moving on 1.15
* Updated xfailed list
* Fixed typo and added more tests to skipped
* Added xfailed tests
* Reduced opset due to need to work on onnx 1.13
* Removed unnecessary xfails
* Skipped misaligned tests
* WA for old compiler build
* [TF FE] Support complex tensors
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Align output type for Real and Imag operations
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update decoding complex types
* Add support for ComplexAbs, FFT and IFFT operations
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Correct axes based on a number of inner-most dimensions
* Add layer tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update supported ops documentation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add a comment for ComplexTypeMark
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* [TF FE] Switch off TF1 While support totally
This is a total switch off due to GPU limitation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Need additional fallback in Enter to avoid shapes problem
* Disable tests with While op
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Disable layer test for TF1 While
* Remove extra spaces
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* [TF FE] Provide full support of TF1 Control flow and TensorArray ops
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add missed header for TensorArrayV3 op
* Temporarily disable GRU cell fusion
* Update src/common/transformations/src/transformations/common_optimizations/moc_transformations.cpp
* Fix a case when element_shape for TensorArrayV3
* Fix translator for TensorArrayCloseV3
* Update summarize graph with TensorArrayCloseV3
* Add layer tests for TensorArrayScatterV3, Close, Size, Array
* Fix output shape for Merge node
* Remove unused variable
* Fix translator for TensorArrayConcatV3
* Fix translator for TensorArrayConcatV3
* Add layer tests for TensorArrayWriteV3, Gather, and Concat
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add translator for GatherTree
* Fix TF FE unit-test for GatherTree
* Fix GatherTree translator
* Fix GatherTree translator to handle 1d end_token
* Fix undeclared parameter issue
* Fix GatherTree unit-test
* Add TensorArrayV3Replacer transformation
* Temporarily disable dangling transformation
* Recover RemoveMultiSubGraphOpDanglingParamsResults transformation
* Recover GRUCellFusion transformation
* Simplify check for GRUCellFusion transformation
* Use proper name for unit-tests
* Simplify translator for TensorArrayWriteV3
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix RemoveMultiSubgraphOpDanglingParamsResults transformation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Additional fix for remove_multi_subgraph_op_dangling_params
* Make static TI run a dynamic subgraph
* Dedicated SL test
* Change condition to respect stat shapes
* Adjust test to cover the code path properly
* Recover fallback for still failing case GNMT
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Maksim Kutakov <maksim.kutakov@intel.com>
* Reference implementation for u4 constant compression from pytorch model based on bitwise ops pattern
* Fixed order of 4-bit halfs in byte
* Switched PyTorch FE to dev mode: in case if model cannot be fully converted, give partially converted model with PTFrameworkNode's with a printed warning (normally would raise an exception in case).
* Moved u4 compression to utils_quantize. Implemented not-interleaved version of u4 compression
* Removed debug output
* Added aten::matmul to the list of exceptions in may_produce_alias as a workaround for gptq models
* Added patching for gptq models applied automatically in convert_model
* WA for an inssue with u4 with earlier convert to fp16
* U4 blocked repacking for gptq patched model layout
* Deleted obsolete u4 re-packing based on aten::cat. Fixed the resulting u4 constant shape. Removed debug output.
* Revert "Switched PyTorch FE to dev mode: in case if model cannot be fully converted, give partially converted model with PTFrameworkNode's with a printed warning (normally would raise an exception in case)."
This reverts commit 0ef1455e70.
* Update src/frontends/pytorch/src/op/cat.cpp
* Check mask and shift values in u4 pattern. deque -> OutputVector for u4_compression_stack
* Convert to a given floating type instead of half in gptq patching. Better structured code.
* Code style fix
* Removed deque include
* Code style fixes
* Trailing space removed
* Fixed patched_forward and ts_decoder after unvalidated commits.
* Swap nibbles in u4/i4
* Better exception handling around jit.trace and gptq.patch_model
* Update src/bindings/python/src/openvino/frontend/pytorch/gptq.py
Co-authored-by: Alexander Kozlov <alexander.kozlov@intel.com>
* Update src/bindings/python/src/openvino/frontend/pytorch/gptq.py
Co-authored-by: Alexander Kozlov <alexander.kozlov@intel.com>
* Code style
* Revers int4 byte order
* Fixed core tests
* Fixed unguarded dynamic_cast result
Co-authored-by: Evgenya Nugmanova <eva.my.link@gmail.com>
* Fixed transformation tests
* Update src/bindings/python/src/openvino/frontend/pytorch/gptq.py
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Prevent patching of non-gptq models
* Removed extra calling of quantized weights decompression patterns
* Better detection of supported AutoGPTQ models + more diagnostics
* Accurate diagnostics in case when aten::stack has multiple axes
---------
Co-authored-by: Alexander Kozlov <alexander.kozlov@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
Co-authored-by: Evgenya Nugmanova <eva.my.link@gmail.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Add Multinomial-13 to MO
* Add Multinomial tests for MO IR reader
* Move convert_type check
* Imports clean up
* Update pacgage BOM file
* Avoid files collision in tests
* [TF FE] Support TF 2.14 and add OnesLike translator
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update tests constraints
* Update open_model_zoo
* Adopt TF Lite test to 2.14 TF
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Support TF Lite layer tests for diffrent TF versions
---------
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Roman Kazantsev