Commit Graph

277 Commits

Author SHA1 Message Date
Przemyslaw Wysocki 84a3aab115
[PyOV] Backport of wheel building fix (#19013)
* Add upper bound

* backport flake fix

* Support of protobuf >= 21 (#18351)

* Corrected typo

* Ability to compile with newer protobuf versions

* Limit numpy (#18406)

* Revert "[PyOV] Pin version of Cython for API 1.0 (#18604)" (#18681)

* Revert "[PyOV] Pin version of Cython for API 1.0 (#18604)"

This reverts commit 787796d88f.

* Suppressed clang warning

* Restrict scipy module version for POT (#18237)

* Restrict scipy module version for POT

Latest release https://pypi.org/project/scipy/1.11.0 causes dependency conflicts

* Bump OMZ to include scipy restriction

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Alina Kladieva <alina.kladieva@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-08-07 18:23:05 +04:00
Jan Iwaszkiewicz 83f51e0d00
[PyOV][Backport] Remove numpy strides from Tensor creation (#17535)
* [PyOV] Remove numpy strides from Tensor creation

* [PyOV] Add test for stride calculation

* [PyOV] Fix flake issue
2023-05-16 09:04:56 +04:00
Jan Iwaszkiewicz 512b186231
[PyOV] Enable group_convolution_backprop test (#17186) 2023-04-25 12:19:56 +00:00
Aleksandr Voron e31b00c299
[CPU] Enable Python test test_infer_request.test_infer_mixed_values with bool for ARM (#17111)
* Update test_infer_request.py

* enable all py tests
2023-04-21 19:52:32 +04:00
Mateusz Bencer 77a5d1aa03
[ONNX FE] Fixed handling duplicates during graph extraction (#17071) 2023-04-20 11:10:09 +00:00
Anastasia Kuporosova f9098cd67c
[PyOV] Mark add_openvnio_libs as internal (#16971)
* [PyOV] Mark add_openvnio_libs as internal

* fix flake8
2023-04-17 17:34:13 +01:00
Jan Iwaszkiewicz 816c0f76e2
[PyOV] Deprecate PerformanceMode.UNDEFINED and refactor deprecation (#16965) 2023-04-17 12:38:28 +02:00
Roman Kazantsev 18da874c57
[MO] Remove use of mapping file and its generation (#16944)
* [MO] Remove use of mapping file and its generation

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Fix pylinter findings

* Remove usage of mapping file in the layer tests

* Fixing layer tests for legacy frontend

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-04-15 10:38:33 +00:00
Jan Iwaszkiewicz 63c5be3ed2
[PyOV] Fix models checking and ensure correct destructor calls in tests (#16814) 2023-04-13 10:37:05 +02:00
Tomasz Dołbniak fb49228fec
Pillow modes in the preprocessor's resize mechanism (#16601) 2023-04-12 15:30:42 +02:00
Jan Iwaszkiewicz 92eb62fe63
[PyOV] Fix getting all names in OVDict (#16665)
* [PyOV] Fix getting all names in OVDict

* Add docs and adjust tests

* Fix linter issues

* Adjust typing and add test for incorrect key type

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
2023-04-06 14:44:37 +02:00
Vitaliy Urusovskij 7442a17240
Add Core property to switch from `mmap` to `read` in IR Frontend (#16600)
* Add Core property to switch from `mmap` to `read`
in IR FrontEnd

* Add tests on `ov::enable_mmap` property

* Add `enable_mmap` in C & Py APIs

* ClangFormat
2023-04-05 18:22:11 +04:00
Shen, Wanglei 9f54504232
update cpu properties name to enable_hyper_threading and enable_hyper_threading (#16723) 2023-04-04 15:25:11 +04:00
Shen, Wanglei 86da15e621
enable new property ov::hint::use_cpu_pinning (#16383)
* enable ov::hint::use_cpu_pinning

* update test case for comments

* update header file

* update header file

* Delete cpu_streams_calculation.hpp

* Revert "Delete cpu_streams_calculation.hpp"

This reverts commit a1074ca843.

* update config name

* fix code styple issue

* update for merge conflict
2023-04-03 18:14:33 +08:00
Wang Wangwang 99eda5b5e1
[PYTHON][CAPI][AUTO] Add ENABLE_STARTUP_FALLBACK and ENABLE_RUNTIME_FALLBACK proper… (#16436)
* [AUTO] Add ENABLE_STARTUP_FALLBACK and ENABLE_RUNTIME_FALLBACK properties to Python API

* Add DEVICE_BIND_BUFFER property

* Add AUTO properties to C API

* Update test case && Update AUTO properties in PYTHON API

* Create dedicated files for auto plugin

* Update header files

* Update test case

* Modify code style

* Update variable name

* Add test case for invalid input value
2023-04-03 11:56:48 +08:00
Ilya Lavrenov ccf9c19f61
Deprecated UNDEFINED values for execution / performance hints (#16563)
* Deprecated UNDEFINED values for execution / performance hints

* Update src/tests/functional/plugin/gpu/shared_tests_instances/behavior/ov_plugin/properties_tests.cpp

* Fixes

* Fixes
2023-03-30 13:48:19 +04:00
Ilya Lavrenov 0250f62d11
Revert inference precision to be a hint (#16634) 2023-03-29 18:59:33 +04:00
Vitaliy Urusovskij 40cc006bae
Enable MapAllocator in IR Frontend (#12673)
* Enable MapAllocator in IR Frontend

* Fix `ov_infer_request_ppp` test

With `mmap()`ing of IR, .bin can't be deleted until unmapping.
And it shows that there was a leak in test

* Add comment to Win `CreateFile()` regarding
FILE_SHARE_DELETE

* Unmap .bin file before IR files deletion

Wait ov::Model deletion to trigger .bin file unmapping
before IR files deletion

* ClangFormat

* Add `use_map_allocator` switch in FE

In case of direct use of FE (e.g. via MO), `mmap()` is OFF.
But in case of use FE via Core, `mmap()` is ON.
2023-03-28 23:24:13 +04:00
Shen, Wanglei a726f0ae38
Enable new property ov::hint::scheduling_core_type (#16106)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* refine process_type to scheduling_core_type

* refine description

* fix code style issue

* change to ov::hint::scheduling_core_type

* fix code style issue

* fix code style issue

* fix python issue

* fix python issue

* fix python issue

* fix python issue

* change core_type_cfg to ov::hint::SchedulingCoreType

* update test case for comments

* update test case for comments

* add default for comments

* update code style

* update for comments

* update for comments

* fix typo

* move cpu_map_scheduling into threading folder

* update for merge conflict

* update for code style
2023-03-28 10:04:30 +04:00
Shen, Wanglei 815d4abc03
enable new property ov::hint::use_hyper_threading (#16176)
* enable apply_processor_type()

* declare PROCESSOR_TYPE

* enable readProperties

* test case for get_property()

* enable set_property() and test cases

* reduce changes

* fix code style issue

* fix python test case issue

* remove python interface

* move processor type definition out of dev_api

* refine coding

* add dependency

* update header file

* update description

* merge intel_cpu header file

* add inline in-code documentation

* change 'UNDEFINED' to 'DEFAULT'

* remove ProcTypeConfig

* refine change

* refine change

* enable new property use hyper threading

* update description

* resume legacy code

* change to ov::hint namespace

* update including header file

* update C API and Python API

* update description for comments

* update test case for comments

* update function location for comments

* fix typo

* fix typo

* fix code style issue and update test case

* move cpu_map_scheduling into threading folder
2023-03-28 00:39:26 +04:00
Przemyslaw Wysocki 52b27d82c5
Upgrade `ONNX` to 1.13, `protobuf` to 3.20.3 and relax `tensorflow` (#14773)
* Bump ONNX version

* Bump protobuf

* Add xfails and skips

* Add tickets

* Skip ONNX Serialization tests

* Compile ONNX with C++17

* Force cpp17 - 2

* Use MSVC check

* Update tensorflow

* Minor change

* Bump onnx to 1.13.1

* Bump protobuf to 3.20.3

* Debug test tf

* Xfail tests in comp

* Update comp tests

* Update tf reqs

* Remove deprecated ONNX function

* Align PDPD FE protobuf req with 2.4.1

* Satisfy dependency review

* Attempt to fix dependency review

* Revert pdpd protobuf

* Skip pdpd tests

* Fix MO-TF-PB test

* Skip TF test case

* Add ticket numbers, rewrite reqs

* Fix requirements

* Minor change

* Set TF to 2.12

* Remove wrapt and skip test
2023-03-24 00:43:01 +04:00
Tomasz Dołbniak de0a4e16fb
TopK 11 exposed to Python (#16501) 2023-03-23 16:33:54 +01:00
Anastasia Kuporosova 982e1c1192
[PyOV] Fix issues with RTMap (#15636)
* [PyOV] Fix issues with RTMap

* update year

* some clean-up and items fix

* tests and small fixes

* Update src/bindings/python/src/pyopenvino/utils/utils.cpp

* undo changes

* fix serialization on python side

* rt_info as rt_map

* undo several changes in tests

* fix mo test

* sadd docstrings

* add tests

* fix codestyle

* try to fix win

* fix master

* apply comments
2023-03-23 10:29:32 +01:00
Edward Shogulin 087b10ff00
Snippets: precision propagation (#14996) 2023-03-23 13:16:04 +04:00
Tomasz Dołbniak 951c5fdae9
Interpolate 11 exposed to Python (#16465) 2023-03-22 18:12:16 +00:00
Jan Iwaszkiewicz 4561aa7109
[PyOV] OVDict class - new return value from inference (#16370) 2023-03-22 16:12:07 +01:00
Xuejun Zhai 8509d0dd82
[Deprecated API] remove `version` (#16426)
* [Remove version] Remove version from py openvino

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Modify caused by remove version

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix clang format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Revert "Fix clang format issue"

This reverts commit 132787286f.

* Fix CI format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix CI format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Fix merge conflict error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-03-22 16:09:14 +01:00
Przemyslaw Wysocki 6cfea099d8
[PyOV] Align Python API's attributes and methods between its modules (#15889)
* Complete alignment

* Minor change

* Apply discussion results

* Apply discussion comments

* Clang

* Apply CR

* Code style
2023-03-22 10:22:44 +04:00
Pavel Esir d8e7b39edb
flush by recreating constant (#16430) 2023-03-21 18:05:11 +04:00
Przemyslaw Wysocki 1e512af105
Skip `test_mixed_dynamic_infer` on ARM devices (#16397)
* Skip test

* Minor fix

* Minor update
2023-03-20 15:23:12 +00:00
Ilya Lavrenov 0c99135d44
Improved properties handling between Core and plugins (#16296)
* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Multiple improvements

* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Code style, bugfix after merging improvement

* More improvements

* Even more improvements

* Commit changes in core_impl.cpp

* Added parsing of any maps

* Fixed code-style

* Fixed AB mock tests build

* Fixed comparison

* Added new AB config key

* Improvements and fixes (#147)

* Fix BA, fix GetSupportedConfig call for virtual plugins (#148)

* Fix GPU tests (#149)

* Fix BA, fix GetSupportedConfig call for virtual plugins

* Fix GPU tests

* Code style

* Improvements 10

* Fixed incorrect tests

* Revert removal cache_dir

* Revert removal cache_dir

* Fixed clean

* Supported device ID in CPU

* More fixed tests

* clang-format

* Fix legacy GPU tests (#150)

* Removed clone_map

* clang-format

* Added clone_map back

---------

Co-authored-by: Nadezhda Ageeva <nadezhda.ageeva@intel.com>
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
2023-03-20 12:42:40 +00:00
Egor Duplenskii e1e44d6bac
[CPU] Move to oneDNN v3.1 (#15918) 2023-03-17 14:17:55 +04:00
Jan Iwaszkiewicz 0372ca929a
[PyOV] Constant/Tensor from scalars (#16270) 2023-03-16 11:15:19 +01:00
Ilya Churaev 95faa573ed
Introduce ITensor instead of Blob (#16048)
* Introduce ITensor

* Added new allocator

* Hide ITensor from dev api

* Changed some python tests

* Remove deprecated API from sample

* Fixed warnings

* Skiped unsupported tests

* Fixed exception message

* Fixed template func tests

* Fixed incorrect tests

* Fixed comments and move ITensor to developer API

* Fixed CI issue

* Fixed allocated tensor

* Fixed docs and windows warning

* Fixed set shape for strided tensors

* Fixed build and some comments

* Introduce remote tensor

* Fixed code style

* Fixed build

* Remove static assert method

* Remove fail type

* Added device name API

* Try to fix GPU remote tests

* Added debug output

* Try to fix GPU tests

* Fixed comments

* Fixed build

* Added additional element type check

* Revert some comment changes
2023-03-14 19:12:27 +04:00
Ilya Lavrenov f080a0d9cf
Added NCC style for frontends sources (#16200)
* Ability to provide several source dirs for ncc-style checks

* Fixed include headers; added NCC to TF common

* Fixed NCC for frontends

* Fixed NCC for frontends

* Extra fixes

* Fixest push --f

* Clang-format

* Apply comments

* Add an option to specify required clang-format version

* Update src/frontends/tensorflow/src/decoder_proto.cpp

* Update src/frontends/tensorflow/src/decoder_proto.cpp
2023-03-13 14:54:00 +00:00
Ilya Churaev 45bdbf7486
Changed throw ov::Exception to macro (#16150)
* Changed throw ov::Exception to macro

* Fixed code style

* Revert myriad headers

* CPPlint fixes

* Fixed typo
2023-03-10 11:14:50 +04:00
Pavel Esir e43f606750
[LoadTime][MO] flush fp32 subnormals to zero at offline phase (#15929)
* flush fp32 subnormals to zero in IR

* style fix in test_offline_api.py

* simplified call of FlushFP32SubnormalsToZero: is called form offline_transformations.cpp

* reverted offline_transformations.py

* use fpclassify

* style-fix

* Update src/common/transformations/tests/common_optimizations/flush_fp32_subnormals_to_zero_test.cpp

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-03-09 16:21:28 +04:00
Mateusz Bencer 50b76873e2
[ONNX] Fix external weights loading for the current dir path case (#16124) 2023-03-08 12:12:23 +01:00
Tomasz Dołbniak 4486470e02
TopK v11 core operator (#15910) 2023-03-06 08:31:18 +01:00
Anastasia Kuporosova b130b73f80
[Docs][PyOV] Add docstrings for transformations + python examples for stateful model (#15978)
* [Docs][PyOV] Add docstrings for transformation + python examples for stateful

* add snippets + small improvements
2023-03-03 17:07:34 +01:00
Jan Iwaszkiewicz 6c0e2686ad
[PyOV] Fix passing of the key in data dispatcher (#15941) 2023-02-24 23:07:59 +04:00
Jan Iwaszkiewicz 3373c6743f
[PyOV] Shared memory improvements for Tensor and Constant classes (#15814) 2023-02-23 13:46:41 +01:00
Anastasia Kuporosova 592ad68455
[PyOV] Fix deprecation warning in tests (#15830)
* [PyOV] Fix deprecation warning in tests

* Update src/bindings/python/tests/test_graph/test_manager.py
2023-02-22 18:08:49 +01:00
Anastasia Kuporosova 6f0313b2c4
[PyOV] Support BytesIO in read_model and load (#15498)
* [PyOV] Support BytesIO in read_model

* fix path

* load support

* apply comments

* add test

* apply comments

* add error msg

* Update src/bindings/python/src/pyopenvino/core/core.cpp

* Update src/bindings/python/src/pyopenvino/core/core.cpp

* codestyle

* Update src/bindings/python/tests/test_runtime/test_core.py

* add space
2023-02-10 23:00:56 +01:00
Jan Iwaszkiewicz 2769e22767
[PyOV] Adding optimizations and shared memory mode to inference calls (#15290)
* Proposal of data_dispatcher

* Fix C-style for array-like objects

* Added test cases

* Add InferRequestInternal to hold lifetime of converted data

* Change name and location of InferRequestInternal to _InferRequestWrapper

* Fixes for shared data mode to match previous tests, codestyle refactoring

* Fix annotations and style

* Add initial testing

* Fix dtype capture

* Fix set_request_tensor

* Extend doc strings

* Fix docs

* Docs fix

* Change to ndarray in docs

* Fix async case

* Fix async test 2

* Remove linter issue
2023-02-09 10:50:39 +01:00
Jan Iwaszkiewicz b94e8c2f25
[PyOV] Add ExecutionMode enum and property (#15497) 2023-02-04 13:10:44 +04:00
Vitaliy Urusovskij 29b15233c7
Remove `OV_FRONTEND_PATH` (#15364)
* Remove "OV_FRONTEND_PATH" from `FrontEndManager`

* Remove "OV_FRONTEND_PATH" from layer_tests

* Remove "OV_FRONTEND_PATH" from find_ie_version.py

* Remove "OV_FRONTEND_PATH" from .ci/

* Move `ov::get_plugin_path` to file_util.hpp (ov::util)

* Add `register_front_end(name, path)` FEM public API

* Enable frontend/ tests

* ClangFormat

* Remove OV_FRONTEND_PATH from FE shared utils

* Add `register_front_end()` to PythonAPI

* Update Py tests with registering of "mock_py" FE

* ClangFormat

* Leftovers

* Fix SegFault with `register_front_end(name, lib_path)`

* Add FE_LIB_PRE and FE_LIB_SUFFIX to `ov_core_unit_tests`

* Fix format

* Update `testFailRegisterFEByWrongPath`
2023-02-02 08:19:35 +04:00
Anastasia Kuporosova ce287067d5
[PyOV] Change default opset9->opset10 (#15238) 2023-02-01 13:44:58 +01:00
Anastasia Kuporosova de74d3c837
[PyOV] Try to fix PosixPath error in CI (#15377) 2023-01-31 11:58:15 +01:00
Mateusz Bencer e409f708e0
[ONNX FE] Added support of DFT operator (#15280) 2023-01-30 08:46:09 +01:00