### Details:
- Initial problem: `test_custom_op` hanged on destruction because it was
waiting for a thread which tried to acquire GIL.
- The second problem is that pybind11 doesn't allow to work with GIL
besides of current scope and it's impossible to release GIL for
destructors. https://github.com/pybind/pybind11/issues/1446
- Current solution allows to release GIL for InferRequest and all called
by chain destructors.
### Tickets:
- CVS-141744
### Details:
- adding new struct for PCI information (aligned with GPU)
- adding new property to query PCI information (as a RO metric)
- implement query of pci information from driver in zero_device, with
backwards compatibility
### Tickets:
[ - *ticket-id*](https://jira.devtools.intel.com/browse/CVS-138767)
### Details:
- *Enable new property model_distribution_policy for CPU inference*
-- *Add C++ interface and test cases*
-- *Add Python interface and test cases*
### Tickets:
- *CVS-127844*
### Details:
- `OPENVINO_ASSERT` takes boolean expression as first argument. In order
to explicitly throw AssertFailure, need to specify `false`, non-empty
string will be treated as `true`
---------
Co-authored-by: Sergey Shlyapnikov <sergey.shlyapnikov@intel.com>
### Details:
- Extended `Core` class to interact with Remote API via `compile_model`,
`create_context` and `get_default_context`.
- Added `RemoteContext` and `RemoteTensor` classes to Python API.
- Added `ClContext` and `ClImage2DTensor` classes placeholders.
- Added `VADisplayWrapper`, `VAContext` and `VASurfaceTensor` classes.
- Added utility function to raise `NotImplemented` errors.
**TODO list (with cc's):**
- [x] Decide which `VADisplayWrapper` constructors stay.
`VADisplayWrapper(VADisplay device)` (which translates to `void*`) is
quite necessary to pass memory pointers from/to external libraries.
`VADisplayWrapper(std::string& device)` is not necessary as it
introduces additional build dependency on libva itself. However, there
are no standard libva bindings that expose such functionalities.
- [ ] Proposal: change of `create_tensor` to `create_device_tensor ->
RemoteTensor` to make difference clear while API expose
`create_host_tensor -> Tensor`. (cc @ilya-lavrenov @slyalin)
- [x] Question: move CL and libva related classes to specific submodules
`openvino.intel_gpu` or keep it as-is in flat namespace? (cc
@ilya-lavrenov @slyalin @akuporos)
- [x] Decide on how memory management should work. My draft proposal:
expose in future PR as "read-only" via custom bindings to `cl_mem` in
case of accessing `ClImage2DTensor`.
- [x] Add test cases.
### Tickets:
- *129468 and 129469*
---------
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
* [PT FE] torch.export support
* Apply code style
* Fix build
* Support torch <2.2
* Support more operations
* Update tests/model_hub_tests/torch_tests/torch_utils.py
* Support for model operations
* Support is_causal as kwarg for SDPA
* Update src/frontends/pytorch/src/op/addcmul.cpp
* Update tests/model_hub_tests/torch_tests/test_timm.py
* Support only decoder passed to convert_model
* Fix tests
* Update src/bindings/python/src/openvino/frontend/pytorch/fx_decoder.py
* Update src/bindings/python/src/openvino/frontend/pytorch/fx_decoder.py
Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>
* Apply suggestions from code review
* Apply suggestions from code review
* Improve testing with caching model
* Apply suggestions from code review
---------
Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>
* Add and implement the logic of property SCHEDULE_POLICY for MULTI plugin.
* Updated.
* Enable test case for schedule policy test.
* enable test case for property ov::intel_auto::schedule_policy.
* Update.
* Updated.
* Updated.
* Update.
* Update the lock logic here by considering the runtime fallback case.
* Update.
* Update.
* Update.
* Update default value of schedule policy to DEVICE_PRIORITY
* Enable the function test case for schedule policy.
* Add description for inference requests schedule policy within AUTO plugin cumulative mode.
* Updated.
* Python bindings for enum SchedulePolicy and property ov::intel_auto::schedule_policy.
* Update.
* Update.
* Update.
* Updated.
---------
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
* [PyOV] Fix issues with RTMap
* update year
* some clean-up and items fix
* tests and small fixes
* Update src/bindings/python/src/pyopenvino/utils/utils.cpp
* undo changes
* fix serialization on python side
* rt_info as rt_map
* undo several changes in tests
* fix mo test
* sadd docstrings
* add tests
* fix codestyle
* try to fix win
* fix master
* apply comments
* Remove None at outputs of the model, improve types handling in frontend
* Fix py code style
* Add torch dependency in pybind tests
* Fix tests if fe is disabled and add backward type cpnversion
* Move decoder tests to layer tests
* Fix codestyle
* Add comment
* Move tests to separate folder
* Update .ci/azure/linux.yml
* WIP
* update input validation
* upsample_nearest2d and upsample_bilinear2d support
* support leaky_relu add test for inplace relu
* update tests, add handler for ListConstruct
* Do not create extra outputs in main body
* add positive case with non-default value
* update testing
* update test, handle non constant size and scale
* remove ie_device
* add aten::group_norm support
* refactoring
* Enable aten::reshape_as operator and add layer test
* more tests
* Fix typo in test
* Resolve conflicts
* fix code style
* expand init version
* expand_as and tests
* add transposed convolutions support
* add tests
* initial support pad
* add circular
* update for differenced in rang
* cleanup
* refactor
* more tests
* apply review comments
* Add split+listunpack transformation
* Add split+getitem transformation
* Add test cases
* fix typo
* Minor fixes
* Apply suggestions from code review
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Apply suggestions from code review
* Small fix
* Support converting models without freezing
* support BoolTensor and masked_fill
* add support aten::rsqrt and test for sqrt
* add cumsum and type_as
* support clamp
* support more matrix operations
* add tests
* Add aten::adaptive_avg_pool3d and layer test
* Change to rank
* fix code style in utils.hpp
* Update src/frontends/pytorch/src/op_table.cpp
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
* fix code style
* add tests
* add xfail
* remove unnecessary broadcast
* Changes required by style formater
* aten::_convolution_mode
* Changes requested by a reviewer
* remove code duplication
* add aten::unbind transformation
* full, zeros and ones
* Support getattr list and unrolling nested ifs
* Remove line change
* Enable back freezing in layer tests
* Add aten::norm operator and layer test
* Small fix in layer test
* add aten::roll
* add empty line
* Typo fix
* fix style
* fix style v2
* add pytorch frontend to wheel
* Support all types of numeric norms
* add check for dynamic shapes
* remove random change
* merge statements
* add min and max ops support
* aten::max and aten::min
* move axes range creation to utils
* add transformation for tuple results, update tests
* fix copyright
* aten::var
* add test and translation for numel
* ignore aten::clone
* Add layer test for aten::add operator
* Fix typo
* Remove redundant import
* Add parameter name in forward method
* fix code style
* apply review comments
* Add size+slice+listunpack transform
* Add append listunpack transformation
* Register transformation
* aten::where
* update realization
* Fix issue with getitem
* Fix getitem
* Add layer test for aten::view operator
* Add tests for listunpack
* add test for aten::div
* fix style
* update aten::adaptive_max_pool2d
* fix style
* add aten::floor_divide
* aten::addmm support alpha and beta with different dtype
* nonzero
* Change test name
* update test cases to include other dtypes
* aten::arange
* prim::max transformation for ListConstruct
* rename op
* generalize conv2d implementation for conv1d and conv3d
* aten::unsqueeze_ and tests for aten::unsqueeze (#70)
* add aten::le, aten::ge and tests for other tensor comparision ops (#74)
* add support trigonometry ops (#73)
* support aten::upsample_bicubic2d, aten::ceil, aten::floor (#72)
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* extend and add tests for avg_pool and max_pool
* extend tests and constant filling ops
* fix as_tensor and full ops
* aten::repeat
* fix code style
* aten::im2col (#61)
* aten::im2col
* remove debug prints, add number of elements check
* fix failed tests
* move helper function
* use split
* Update src/frontends/pytorch/src/op/im2col.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* fix code style
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Update src/frontends/pytorch/src/utils.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* fix code style
* revert removeinf floordiv, add floor_divide file
* Fix merge issue
* reduce code duplication
* refactor
* Add len operator with layer test
* update clamp to support mixed precision and add support torch.long for constants
* aten::selu
* add trunc mode to div
* add else statement
* Add test case to layer test
* Fix submodules (#88)
* update test file
* fix namings
* execute in fp64 and convert back to initial precision
* Revert set_output_size to master. Small fix in If validate
* Fix build and code style
* fix failed tests
* Add torchvision::nms operator and layer test
* Change requested by a reviewer
* Remove div test
* convert constants to input type
* Mark some cases in div tests as xfail (#93)
* Small refactoring (#94)
* Small refactoring
* Fix type
* Fix python codestyle
* Incremental fix code style (#95)
* Fix style (#96)
* Fix copyright
* Fix code style
* Branch clean up (#97)
* Optimize includes and force opset10 (#98)
* Optimize includes
* Force opset10 in pt fe
* Fix codestyle (#99)
* Fix style
* Fix clang codestyle
* Fix cerr with debug log
* Update src/bindings/python/src/pyopenvino/frontend/pytorch/decoder.cpp
* Add pytorch dependency only if pytorch frontend is enabled
* Update src/bindings/python/src/pyopenvino/CMakeLists.txt
* Add layer tests to precommit (#100)
* Add layer tests to precommit
* Remove accidentally added files
* Apply code style on layer tests
* batch norm tests and fixes
* move default weight and bias to else block
* reduce code duplication
* Changes requested by a reviewer
* Changes requested by a reviewer
* Remove dependency from pytorch in pyopenvino (#102)
* Remove dependency from pytorch when fe is disabled
* Change docstring
* Remove pytorch FE dependency from pyopenvino
* Apply codestyle (#107)
* Apply codestyle
* Remove commented line
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix mock FE test (#108)
* Fix mock PE test (#111)
* Revert changes in StridedSlice (#114)
* Small refactoring (#116)
* Small refactoring
* Fix codestyle
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply suggestions from code review
* Update src/frontends/pytorch/src/op/group_norm.cpp
* Fix cmake copyright define (#117)
* Update src/frontends/pytorch/src/op/arange.cpp
* Apply suggestions from code review
* Update build configs (#120)
* FIx build configs
* Update type cast in full.cpp
* Apply review feedback (#121)
* Apply suggestions from code review
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix issue after master merge (#122)
* Fix issue after master merge
* Fix build
Co-authored-by: eaidova <ekaterina.aidova@intel.com>
Co-authored-by: bszmelcz <bartosz.szmelczynski@intel.com>
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
Co-authored-by: sikorsl1 <leonard.sikorski@intel.com>
Co-authored-by: Leonard Sikorski <l.sikorski123@gmail.com>
Co-authored-by: Mateusz <mateusz.mikolajczyk@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* add type caster for ov::Layout, enable load method to take pathlibs.Path as arugment
* fix typo
* fix style
* add missing blank line
* add common function to check if py::object is either Path or string
* fix style
* Update src/bindings/python/src/pyopenvino/graph/preprocess/pre_post_process.hpp
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* add tests, fix style, remove pointer argument overload
* fix style
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* [Python API] Remove old api class from the new api
* start working on refactoring of OVAny
* fix tests
* fix code-style
* remove tuple test
* fix test
* fix omz hash
* one more overload
* fix pyfloat
* move from_ov_any to utils
* code-style
* move function from common to utils
Anastasia Kuporosova