Commit Graph

444 Commits

Author SHA1 Message Date
Pavel Esir d8e7b39edb
flush by recreating constant (#16430) 2023-03-21 18:05:11 +04:00
Przemyslaw Wysocki 1e512af105
Skip `test_mixed_dynamic_infer` on ARM devices (#16397)
* Skip test

* Minor fix

* Minor update
2023-03-20 15:23:12 +00:00
Ilya Lavrenov 0c99135d44
Improved properties handling between Core and plugins (#16296)
* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Multiple improvements

* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Code style, bugfix after merging improvement

* More improvements

* Even more improvements

* Commit changes in core_impl.cpp

* Added parsing of any maps

* Fixed code-style

* Fixed AB mock tests build

* Fixed comparison

* Added new AB config key

* Improvements and fixes (#147)

* Fix BA, fix GetSupportedConfig call for virtual plugins (#148)

* Fix GPU tests (#149)

* Fix BA, fix GetSupportedConfig call for virtual plugins

* Fix GPU tests

* Code style

* Improvements 10

* Fixed incorrect tests

* Revert removal cache_dir

* Revert removal cache_dir

* Fixed clean

* Supported device ID in CPU

* More fixed tests

* clang-format

* Fix legacy GPU tests (#150)

* Removed clone_map

* clang-format

* Added clone_map back

---------

Co-authored-by: Nadezhda Ageeva <nadezhda.ageeva@intel.com>
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
2023-03-20 12:42:40 +00:00
Anastasia Kuporosova 8bfb6afd6a
[PyOV] Remove deprecated API (#16361) 2023-03-20 10:47:06 +04:00
Egor Duplenskii e1e44d6bac
[CPU] Move to oneDNN v3.1 (#15918) 2023-03-17 14:17:55 +04:00
Jan Iwaszkiewicz 0372ca929a
[PyOV] Constant/Tensor from scalars (#16270) 2023-03-16 11:15:19 +01:00
Ilya Churaev 95faa573ed
Introduce ITensor instead of Blob (#16048)
* Introduce ITensor

* Added new allocator

* Hide ITensor from dev api

* Changed some python tests

* Remove deprecated API from sample

* Fixed warnings

* Skiped unsupported tests

* Fixed exception message

* Fixed template func tests

* Fixed incorrect tests

* Fixed comments and move ITensor to developer API

* Fixed CI issue

* Fixed allocated tensor

* Fixed docs and windows warning

* Fixed set shape for strided tensors

* Fixed build and some comments

* Introduce remote tensor

* Fixed code style

* Fixed build

* Remove static assert method

* Remove fail type

* Added device name API

* Try to fix GPU remote tests

* Added debug output

* Try to fix GPU tests

* Fixed comments

* Fixed build

* Added additional element type check

* Revert some comment changes
2023-03-14 19:12:27 +04:00
Ilya Lavrenov f080a0d9cf
Added NCC style for frontends sources (#16200)
* Ability to provide several source dirs for ncc-style checks

* Fixed include headers; added NCC to TF common

* Fixed NCC for frontends

* Fixed NCC for frontends

* Extra fixes

* Fixest push --f

* Clang-format

* Apply comments

* Add an option to specify required clang-format version

* Update src/frontends/tensorflow/src/decoder_proto.cpp

* Update src/frontends/tensorflow/src/decoder_proto.cpp
2023-03-13 14:54:00 +00:00
Ilya Churaev 75314c2c53
Rename OPENVINO_UNREACHABLE to OPENVINO_THROW (#16201)
* Changed some exceptions to OPENVINO_THROW

* Changed samples throw exception

* Fixed some comments

* Remove OPENVINO_UNREACHABLE
2023-03-10 20:23:13 +04:00
Ilya Churaev 45bdbf7486
Changed throw ov::Exception to macro (#16150)
* Changed throw ov::Exception to macro

* Fixed code style

* Revert myriad headers

* CPPlint fixes

* Fixed typo
2023-03-10 11:14:50 +04:00
Pavel Esir e43f606750
[LoadTime][MO] flush fp32 subnormals to zero at offline phase (#15929)
* flush fp32 subnormals to zero in IR

* style fix in test_offline_api.py

* simplified call of FlushFP32SubnormalsToZero: is called form offline_transformations.cpp

* reverted offline_transformations.py

* use fpclassify

* style-fix

* Update src/common/transformations/tests/common_optimizations/flush_fp32_subnormals_to_zero_test.cpp

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-03-09 16:21:28 +04:00
Mateusz Bencer 50b76873e2
[ONNX] Fix external weights loading for the current dir path case (#16124) 2023-03-08 12:12:23 +01:00
Mateusz Mikolajczyk b907bfab3b
[PT FE] Fix for prim::Constant tensor with int/float values (#16029)
* Fix constant

* Change

* Remove duplicated code

* Add tests
2023-03-07 20:54:18 +00:00
Mateusz Mikolajczyk 6358974c1a
[PT FE] Add prim::PythonOp (#15714)
* Add PythonOp

* Fix deprecation & cleanup

* Apply suggestions from code review

* Fix dtype

* Apply suggestions from code review

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

* Update to new tensor names handling

* Fix negation

* Apply changes from code review

* Remove unnecesary imports

* Update src/frontends/pytorch/src/op/pythonop.cpp

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-03-07 17:20:13 +01:00
Tomasz Dołbniak 4486470e02
TopK v11 core operator (#15910) 2023-03-06 08:31:18 +01:00
Xuejun Zhai 9b97235902
Xuejun/remove api in ov any (#15667)
* [Remove APIs] remove ov::any api  &

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any api

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove interfaces in ov::any  Base* operator->() & const Base* operator->()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any interfaces Base* get() & const Base* get()

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] remove ov::any interfaces call(const Any& any) & dynamic_pointer_cast(const ::ov::Any& any) & static_pointer_cast(const ::ov::Any& any)

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issues in ov::any

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix review issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] clear code

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix review issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix compiler issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* Fix variant error

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
Signed-off-by: xuejun <xuejun.zhai@intel.com>
2023-03-06 10:24:08 +04:00
Ilya Lavrenov 79d3ff352e
Migration to latest versions of submodules (#16103) 2023-03-06 10:22:34 +04:00
Ilya Lavrenov e1fbb7d768
Fixes for multi-config generators (#16097) 2023-03-05 10:46:53 +04:00
Anastasia Kuporosova b130b73f80
[Docs][PyOV] Add docstrings for transformations + python examples for stateful model (#15978)
* [Docs][PyOV] Add docstrings for transformation + python examples for stateful

* add snippets + small improvements
2023-03-03 17:07:34 +01:00
Przemyslaw Wysocki 8cbd8b8e03
Remove setuptools upperbound (#16054) 2023-03-02 20:58:39 +04:00
Ilya Lavrenov 7be7f25566
Added TF / TF Lite in API reference docs (#16023) 2023-03-02 16:45:18 +04:00
Anastasia Kuporosova 4c0d28f26d
Try to update minimum setuptools req (#15971)
* Try to update setuptools req

* suppress output from setup
2023-03-01 17:05:51 +04:00
Mateusz Mikolajczyk 112c763256
[PT FE] Add prim::device and prim::type, improvements to aten::to, aten::eq, aten::ne (#15881)
* Add device, improve to and equal

* Rename and remove unused import

* Apply fixes from code review

* Fix decoder.py

* Load prim::device using prim::Constant

* Remove throwing exceptions

* Apply suggestions from code review

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>

---------

Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
2023-03-01 09:46:55 +01:00
Maxim Vafin 4fac7eabc0
Use shared constant in pytorch decoder (#15917)
* Use shared constant in pytorch decoder

* Fix contigious array

* Support scalars

* Apply suggestions from code review

* Apply suggestions from code review

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>

---------

Co-authored-by: Ekaterina Aidova <ekaterina.aidova@intel.com>
2023-02-26 11:39:27 +01:00
Artyom Anokhov bd8c7506f0
requirements-dev: top-limited setuptools with 65.7.0 (#15946) 2023-02-25 14:54:50 +04:00
Jan Iwaszkiewicz 6c0e2686ad
[PyOV] Fix passing of the key in data dispatcher (#15941) 2023-02-24 23:07:59 +04:00
Ilya Lavrenov bd61d317f8
Revert "Install patchelf for aarch64 linux (#15865)" (#15919)
This reverts commit e34d4e4664.
2023-02-23 23:02:00 +04:00
Jan Iwaszkiewicz 3373c6743f
[PyOV] Shared memory improvements for Tensor and Constant classes (#15814) 2023-02-23 13:46:41 +01:00
Anastasia Kuporosova 592ad68455
[PyOV] Fix deprecation warning in tests (#15830)
* [PyOV] Fix deprecation warning in tests

* Update src/bindings/python/tests/test_graph/test_manager.py
2023-02-22 18:08:49 +01:00
Ilya Lavrenov e34d4e4664
Install patchelf for aarch64 linux (#15865) 2023-02-22 12:55:27 +04:00
Ilya Lavrenov 1d5839fb92
Fixed compilation with clang (#15801) 2023-02-19 16:22:18 +04:00
Ilya Lavrenov ed5fa69b41
Fixed compilation on CI (#15787) 2023-02-17 22:28:48 +04:00
Xuejun Zhai 91df0a8aa9
[API remove] remove variantImpl & variantwrapper related class/interfaces (#15580)
* [API remove] remove variantImpl & variantwrapper related class/interfaces

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove api] fix python compiler issue caused by deprecated varient

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Remove APIs] fix code format issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2023-02-17 16:31:26 +04:00
Ilya Lavrenov 672522492e
Changed sample's format_reader libraries type from dynamic to static (#15756) 2023-02-17 09:30:19 +04:00
Maxim Vafin 878e24d6f6
[PT FE] Better handle tensor names (#15718)
* Add debugNames, smartly handle tensor names, add TranslateSession

* Add friendly name specification in mark_node

* Fix code style

* Fix supported_impl logic

* Fix supported logic 2

* Optimize includes
2023-02-16 20:26:08 +01:00
Maxim Vafin 6c72ea4bea
[PT FE] Check number of inputs, use rank function (#15656)
* Check number of inputs, use rank function

* Change min inputs in flatten

* Fix code style

* Fix aten::tensor and aten::_convolution number of inputs

* Refactor NodeCOntext a little

* Fix codestyle
2023-02-13 09:58:21 +01:00
Anastasia Kuporosova 6f0313b2c4
[PyOV] Support BytesIO in read_model and load (#15498)
* [PyOV] Support BytesIO in read_model

* fix path

* load support

* apply comments

* add test

* apply comments

* add error msg

* Update src/bindings/python/src/pyopenvino/core/core.cpp

* Update src/bindings/python/src/pyopenvino/core/core.cpp

* codestyle

* Update src/bindings/python/tests/test_runtime/test_core.py

* add space
2023-02-10 23:00:56 +01:00
Jan Iwaszkiewicz 2769e22767
[PyOV] Adding optimizations and shared memory mode to inference calls (#15290)
* Proposal of data_dispatcher

* Fix C-style for array-like objects

* Added test cases

* Add InferRequestInternal to hold lifetime of converted data

* Change name and location of InferRequestInternal to _InferRequestWrapper

* Fixes for shared data mode to match previous tests, codestyle refactoring

* Fix annotations and style

* Add initial testing

* Fix dtype capture

* Fix set_request_tensor

* Extend doc strings

* Fix docs

* Docs fix

* Change to ndarray in docs

* Fix async case

* Fix async test 2

* Remove linter issue
2023-02-09 10:50:39 +01:00
Ilya Lavrenov 84ecacda26
Windows ARM64 support via LLVM (#15585) 2023-02-09 11:30:07 +04:00
Ilya Lavrenov 1f3e469c5e
Added -Wall for Clang and GCC (#15513)
* Added -Wall for Clang and GCC

* Fixes

* Don't use /J

* Fixed warnings

* Fixed warnings

* More fixes

* Fixed for MSVC

* Fixed more warnings on Windows

* Suppressed some warnings in template plugin

* Update src/tests/functional/plugin/shared/include/behavior/plugin/caching_tests.hpp

* Added suppression for PT FE

* Suppressed warnings in TF FE

* Suppressed warnings on Core unit tests

* Suppress warnings in python

* Suppressed Windows warning for 3rd party modules

* Suppresed one more warning
2023-02-08 15:01:00 +04:00
Ilya Churaev 26108b1b67
Deprecate clone_model API, use model->clone() instead of (#15482)
* Deprecate clone_model API, use model->clone() instead of

* Renamed clone_nodes function

* Fixed exception
2023-02-07 23:53:17 +04:00
Jan Iwaszkiewicz b94e8c2f25
[PyOV] Add ExecutionMode enum and property (#15497) 2023-02-04 13:10:44 +04:00
Ilya Lavrenov de1631d67d
Generalized OpenCL handling (#15253)
* Squashed commit of the following:

commit 62c992f6a0bc3a2f559faac6912be9c5632a359f
Author: Ilya Lavrenov <ilya.lavrenov@intel.com>
Date:   Sun Jan 22 11:38:18 2023 +0400

    Generalized OpenCL handling

* Updates

* Fixes

* Update thirdparty/CMakeLists.txt

test

* Fixed build with CL/cl2.hpp

* Fixes

* Fixes

* Fixed compilation flags

* Fixed build with target OpenCL 120

* Don't use cache
2023-02-03 15:36:47 +00:00
Maxim Vafin 3c919134b1
Fix issue with If and bool type (#15457) 2023-02-02 22:32:40 +01:00
Vitaliy Urusovskij 29b15233c7
Remove `OV_FRONTEND_PATH` (#15364)
* Remove "OV_FRONTEND_PATH" from `FrontEndManager`

* Remove "OV_FRONTEND_PATH" from layer_tests

* Remove "OV_FRONTEND_PATH" from find_ie_version.py

* Remove "OV_FRONTEND_PATH" from .ci/

* Move `ov::get_plugin_path` to file_util.hpp (ov::util)

* Add `register_front_end(name, path)` FEM public API

* Enable frontend/ tests

* ClangFormat

* Remove OV_FRONTEND_PATH from FE shared utils

* Add `register_front_end()` to PythonAPI

* Update Py tests with registering of "mock_py" FE

* ClangFormat

* Leftovers

* Fix SegFault with `register_front_end(name, lib_path)`

* Add FE_LIB_PRE and FE_LIB_SUFFIX to `ov_core_unit_tests`

* Fix format

* Update `testFailRegisterFEByWrongPath`
2023-02-02 08:19:35 +04:00
Maxim Vafin 92649105ed
Add eltwise types resolving. Support big int constants. (#15415)
* Add eltwise types resolving. Support big int constants.

* Update src/bindings/python/src/openvino/frontend/pytorch/decoder.py

* Small fix

* Fix some cases

* Add tests for add in different types

* Add tests for mul

* Add tests for sub and div

* Small fixes

* Return list handling (needed for empty lists)

* Add test for empty list

* Update src/frontends/pytorch/src/op/mul.cpp

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use refs instead of ptrs

* Apply suggestions from code review

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply code review suggestions

* Fix code style

* Add more eltwise ops

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
2023-02-02 02:15:33 +01:00
Anastasia Kuporosova ce287067d5
[PyOV] Change default opset9->opset10 (#15238) 2023-02-01 13:44:58 +01:00
Anastasia Kuporosova de74d3c837
[PyOV] Try to fix PosixPath error in CI (#15377) 2023-01-31 11:58:15 +01:00
Ilya Lavrenov d092f5d7dd
Setup minimum supported version for pybind11 (#15397) 2023-01-31 11:48:15 +04:00
Mateusz Bencer e409f708e0
[ONNX FE] Added support of DFT operator (#15280) 2023-01-30 08:46:09 +01:00