e977a6ed9b
Fix `COPY_INSTEAD_OF_MOVE` issue in Hetero ( #20667 )
2023-10-24 12:44:01 +00:00
865b21ecd4
Introduce WA to improve performance of find_port() method ( #20573 )
...
* Introduce WA to improve performance of find_port() method
* Add mutex
* Remove redindant lock
* Reduce the number of get_tensor_ptr calls
* Fixed typo
* Removed WAs from Hetero plugin
2023-10-23 13:44:58 +04:00
e30f75bb4d
Rpath story ( #20297 )
2023-10-10 06:27:26 +02:00
ead4b8a0ec
Moved cmake functions, variables to API 2.0 naming style ( #20281 )
...
* Merge Linux CC + static build + clang compiler
* Improvements
* Removed ie prefixes from cmake scripts
* Fixes for NPU
2023-10-09 22:30:32 +04:00
d6c2a10b38
Merge Linux CC + static build + clang compiler ( #20243 )
...
* Merge Linux CC + static build + clang compiler
* Improvements
* Fixes
2023-10-06 00:30:11 +04:00
3d6fb85a99
Model builders refactoring: rename dirs, targets, file names ( #19885 )
...
* Model builders refactoring
* Apply review comments
* resolve review commets: update cmake target names
* fix build: use correct headers
* fix headers
* fix build
* fix docs
2023-10-04 18:08:24 +02:00
784cce37b3
[HETERO]: Mask subgraphs by operations ( #19834 )
...
* [HETERO]: Mask subgraphs by operations
Fix GPU tests. Fix mapping of subgraphs inputs to outputs.
Raise exception on last device
Fix dot files dumping
Small fix
* [HETERO] Fix debug dump after https://github.com/openvinotoolkit/openvino/pull/19392/
* [HETERO] Second fix for debug dump after https://github.com/openvinotoolkit/openvino/pull/19392/
2023-09-26 19:11:11 +04:00
35a0706dff
Replaced several cmake utilities with new ov_ prefix ( #19819 )
...
* Replaced several cmake utilities with new ov_ prefix
* Replaced several cmake utilities with new ov_ prefix
2023-09-14 16:22:50 +04:00
3454139931
[HETERO] Hetero refactor subgraph collector. Adds unit tests. ( #19656 )
...
* [HETERO] Refactor subgraph collector. Add unit tests.
* [HETERO] Adds ov_hetero_unit_tests to azure
* [HETERO] Adds ov_hetero_unit_tests to github workflows
* Small updates
* Set CI_BUILD_NUMBER
* Fix cmake
* Fix cpplint
* STATIC -> OBJECT
* Fix .github/workflows/linux.yml
* Fix cmake
* Fix .github/workflows/linux_debian.yml
* Fix win build: separate version file
2023-09-13 12:17:32 +00:00
d84fa07841
[HETERO] Save plugin so in tensor ( #19489 )
2023-08-30 10:23:04 +00:00
81645aaeda
[HETERO] Avoid unexpected dynamism ( #18862 )
...
* [HETERO] Add ConstantFolding in compile modelto avoid unexpected dynamism after model split. Add new property, which shows number of subgraphs
* Remove check for dynamic subgraph
2023-08-09 17:22:20 +04:00
ff0b51f3ca
Rename CommonTestUtils namespace ( #18590 )
...
* Rename CommonTestUtils namespace 1
* Rename CommonTestUtils namespace 2
* Rename CommonTestUtils namespace 3
* Rename CommonTestUtils namespace 4
* Fix1
* Fix2
* Fix3
* Apply comments
* Fix4
* Fix5
2023-07-26 21:06:50 +02:00
a930c74143
[HETERO] Fix problem with ov_hetero_unit_tests ( #18794 )
...
* [HETERO] Fix problem with ov_hetero_unit_tests
* FIX 2
* Rename ov_hetero_unit_tests -> ov_hetero_func_tests
2023-07-26 16:12:22 +04:00
97b4b13074
Adds ov::internal::exclusive_async_requests in ov::internal::supported_properties ( #18746 )
...
* Adds ov::internal::exclusive_async_requests into ov::internal::supported_properties
* Update HETERO tests for ov::internal::exclusive_async_requests
2023-07-26 09:43:21 +04:00
be02d1a3c9
[HETERO] Implement get_runtime_model function ( #18586 )
...
* [HETERO] Implement get_runtime_model function
* [HETERO] Adds unit tests
Update src/plugins/hetero/tests/unit/properties_tests.cpp
Co-authored-by: Vitaliy Urusovskij <vitaliy.urusovskij@intel.com>
* Temporarily disable GA
---------
Co-authored-by: Vitaliy Urusovskij <vitaliy.urusovskij@intel.com>
2023-07-25 12:30:04 +04:00
3f675ce396
Extend Proxy tests to cover cache_dir with auto batch ( #18632 )
...
* Added new tests to reproduce issue with auto batch
* Remove cache dir
* Fixed tests with auto batch
* Fixed check
* Added comment
* Remove try catch
* Remove comment
* Revert "Remove comment"
This reverts commit 99e26de4ca08b478c070
2023-07-20 11:11:41 +04:00
f470825faf
Revert "Remove extra model from CompiledModelDesc" ( #18612 )
...
* Revert "Remove extra `model` from `CompiledModelDesc`"
This reverts commit fb07fd7b82
2023-07-19 12:05:24 +04:00
ef56b53a3f
Remove excess ov::Model clone in Hetero ( #18576 )
2023-07-17 12:27:33 +00:00
aeff5056f5
Hetero 2.0 leftovers ( #18559 )
...
* Enable `LoadedTensor.*HETERO` test
* Fix use of `ICompiledModel::outputs()`
* Remove extra `loaded_from_cache` argument
* Misprint
* Small refactoring
* Remove extra `model` from `CompiledModelDesc`
Use `get_runtime_model()` instead
* ClangFormat
2023-07-17 11:58:44 +04:00
93e30468b1
Change plugin api ( #18441 )
...
* Remove vector of so objects from Tensor, Any, VariableState and
RemoteContext
* Change IRemoteContext
* Fixed build without Proxy
* Moved API to ITensor
* Remove friends from Tensor class
* Changed query_state API
* Remote SoPtr for some returned values
* Fixed auto plugin
* Add so to converted objects
* Fixed build all on macOS
* Check that tensor pointers != nullptr
* Add SO to converter
* Added new constructors for SO ptrs
* Changed IVariableState API
* Remove proxy friend
* Remove friends and nullptrs from auto
* Fixed build
* Fixed HETERO plugin
* Fixed code style
2023-07-14 10:47:53 +04:00
cba84fd763
Fixed clang format for plugin files with version ( #18546 )
2023-07-14 10:41:38 +04:00
43ff356f1a
Hetero 2.0 ( #18429 )
...
* Hetero 2.0: Implement `hetero::Plugin`
* Fix CMakeLists.txt
* Remove duplicated "itt.hpp"
* Remove extra API method
* Delete `HeteroPlugin::Engine`
* Intregrate `ov::hetero::Plugin` into `HeteroExeNet`
* Use `is_new_api()`
* Add `override` modificator
* Rename `GetDevicePlugins` to `get_device_properties`
* Small fixes
* Fix precommit
* Fix Import/Export
* Fix `import_model()`
* Remove extra lines
* TEMPORARY disable one test
* ClangFormat+Refactoring
* Build fix
* Update `hetero::Configuration` logic
* Update `hetero::Plugin::get_property()`
* Fix
* Changes after code review
* Remove extra comments
* Revert "TEMPORARY disable one test"
This reverts commit 13fa48d8102ec5146e79987835e6f7444e469f7a.
* Small fix
* Refactoring + Fixes
* Add `hetero::Plugin::device_supports_model_caching`
* Replace `device_supports_model_caching` with ICore impl
* Code review changes
* Rework `Configuration`
* Implement `hetero::CompiledModel`
* Fix caching_test
* ClangFormat
* Fix inputs/outputs mapping
After some fix in ICompiledModel, m_inputs != model->inputs,
so mapping was updated to be independent from m_inputs
(same for m_outputs)
* Fix types
* Update `get_runtime_model()`
* Remove `ngraph` and `IE_THROW`
* Implement Hetero Sync/Async Infer Requests
* A lot of changes
* Add `submodels_output_to_input` to import/export
* Implement `get_tensors()`/`set_tensors()`
* Fix `Configuration` ctor
* Skip `SetPreProcessTo` legacy tests for hetero
* Change `Output->Input` logic to `Input->PrevOutput`
because for one output may be several inputs
(map key collision)
* Update `CompiledModel` to use shared_ptr vs *
* Update `CompiledModel` public/private members
* Names refactoring
* Optimize imports
* Fix properties for `query_model()` call
* Use static objects in `Configuration` methods
* `Configuration` refactoring
* Get `ov::supported_properties` from subdevices
* InferRequest +1 import and fwd declaration
* Update `InferRequest` prof_info, remove extra methods
* Remove `InferRequestDesc`
* Remove `InferRequest::cancel()`
* Update CMakeLists.txt
* Remove extra `catch` in `CompiledModel`
* Replace `InferenceEngine::details::contains()`
* ClangFormat
* Use `const auto&`
* Try to fix types
* Remove `friendly_name` for subgraphs connection
* Remove TODO comment
* Remove `CompiledModel::m_model` as unused
* Polish .hpp files
* Fix size_t serialization in `CompiledModel::export_model()`
* Minor changes
* Move `intersect*` IE utils to anonym namespace
* Use `const auto&`
* Update Hetero `get_profiling_info()`
* Minor changes
* Rename `deviceName` to `device_name`
* Add `hetero::VariableState` in order to hold HW so
* Port internal properties to `ov::internal`
* Add `CompiledModel::set_inputs_and_outputs()`
* Add `OPENVINO_SUPPRESS_DEPRECATED_*`
* Fix CompiledModel `ov::device::properties` issue
* Use `get_device_name()` instead of hardcoded name
* Make `get_profiling_info()` names bwd compatible
* Remove `include` folder
* Remove try/catch from CompiledModel
* Update error message
* `CompiledModel::set_property` throw not implemented
2023-07-13 23:26:04 +04:00
3330cd69a7
[GPU] Introduce ov::config_device_id internal property to the new API ( #17820 )
...
* [GPU] Introduce ov::config_device_id internal property to the new API. Fix setting property for specific device
* Introduce ov::internal::supported_properties
* Fix caching tests
* Fix win tests
* Fix Proxy tests
* Replace CONFIG_KEY_INTERNAL(CONFIG_DEVICE_ID) by ov::internal::config_device_id in PROXY plugin
* Review comments
2023-07-12 10:03:35 +00:00
0743e9bfb5
Removed legacy methods SetBatch and SetBlob ( #17984 )
...
* Removed legacy methods SetBatch and SetBlob
* Fixed GPU plugin build
* Remove DYN_BATCH_LIMIT from tests
* Revert some changes in GPU plugin
2023-06-12 18:54:23 +00:00
65caa9d745
[HETERO]: Avoid duplicated results ( #17725 )
...
* [HETERO]: Avoid duplicated results
* Code style
2023-05-31 15:13:01 +04:00
a34ef680f2
Made plugins.hpp generation to be CONFIG dependent ( #17139 )
2023-04-24 14:48:45 +04:00
7ce40996e5
Fix copy constructor and assignment for ov::Any ( #16757 )
...
* Fix copy constructor and assignment for ov::Any
* Fix1
* Apply comments
* Add test
* Fix code style
* Fix2
* Fix3
2023-04-14 22:12:18 +04:00
4a43753e02
Enable some tests for Template plugin ( #16832 )
...
* Remove the skip of template plugin tests
* Enable some skipped tests for template plugin
* Added cancel callback, collect per-layer statistic, fixed tests
* Fixed template tests
* Rename internal API terminate to cancel
* Fixed windows tests
* Fixed logic with performance counters
2023-04-12 01:02:28 +04:00
5e2f424fd0
[HETERO] Enable smoke_Hetero_CachingSupportCase tests ( #16711 )
2023-04-06 21:19:37 +04:00
e66b837104
Properties improvements: part 2 ( #16489 )
...
* Properties improvements: part 2
* Accurate configs handling in HETERO / BATCH
* Align plugins in caching properties
* Fixed caching mock tests
* Added new TestNoCachingProperties test
* Fixed test
* Added ov::caching_properties to API 1.0 metrics as well
* Fixes for HETERO plugin
* Fixed tests
* Even more refactoring in HETERO plugin config management
2023-03-25 19:28:05 +04:00
580b99c99b
Align plugins in caching properties ( #16528 )
...
* Align plugins in caching properties
* Fixed caching mock tests
* Added new TestNoCachingProperties test
* Fixed test
* Added ov::caching_properties to API 1.0 metrics as well
2023-03-25 00:26:18 +04:00
65e5ed7dd7
[HETERO]: support caching properties ( #16451 )
...
* Fixed build
* [HETERO]: support caching properties
* Fix caching test
* Code style
* Change result type from map to vector
* Review comments
---------
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-03-24 12:25:55 +04:00
cbb25e9483
[DOCS] Proofreading developer documentation moved from wiki. ( #15886 )
...
Minor stylistic and grammar corrections. Fixing links
* Apply suggestions from code review
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
2023-03-22 09:08:31 +01:00
ec0a1e58d1
Fixed some leftovers for 2.0 dev api ( #16421 )
...
* Fixed some leftovers for 2.0 dev api
* Fixed build issue
2023-03-21 09:34:37 +00:00
0c99135d44
Improved properties handling between Core and plugins ( #16296 )
...
* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO
Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test
Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests
[HETERO][MULTI][AUTO] Make ov::device::properties regular property
[PYTHON] Update python BA with device properties
Update after rebase
Update src/plugins/auto/auto_executable_network.cpp
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Update src/plugins/auto/multi_executable_network.cpp
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Fix merge conflicts, apply some review comments
* Multiple improvements
* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO
Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test
Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests
[HETERO][MULTI][AUTO] Make ov::device::properties regular property
[PYTHON] Update python BA with device properties
Update after rebase
Update src/plugins/auto/auto_executable_network.cpp
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Update src/plugins/auto/multi_executable_network.cpp
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Fix merge conflicts, apply some review comments
* Code style, bugfix after merging improvement
* More improvements
* Even more improvements
* Commit changes in core_impl.cpp
* Added parsing of any maps
* Fixed code-style
* Fixed AB mock tests build
* Fixed comparison
* Added new AB config key
* Improvements and fixes (#147 )
* Fix BA, fix GetSupportedConfig call for virtual plugins (#148 )
* Fix GPU tests (#149 )
* Fix BA, fix GetSupportedConfig call for virtual plugins
* Fix GPU tests
* Code style
* Improvements 10
* Fixed incorrect tests
* Revert removal cache_dir
* Revert removal cache_dir
* Fixed clean
* Supported device ID in CPU
* More fixed tests
* clang-format
* Fix legacy GPU tests (#150 )
* Removed clone_map
* clang-format
* Added clone_map back
---------
Co-authored-by: Nadezhda Ageeva <nadezhda.ageeva@intel.com>
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
2023-03-20 12:42:40 +00:00
f080a0d9cf
Added NCC style for frontends sources ( #16200 )
...
* Ability to provide several source dirs for ncc-style checks
* Fixed include headers; added NCC to TF common
* Fixed NCC for frontends
* Fixed NCC for frontends
* Extra fixes
* Fixest push --f
* Clang-format
* Apply comments
* Add an option to specify required clang-format version
* Update src/frontends/tensorflow/src/decoder_proto.cpp
* Update src/frontends/tensorflow/src/decoder_proto.cpp
2023-03-13 14:54:00 +00:00
c3b22af3f7
CoreImpl small refactoring ( #16145 )
...
* Small CoreImpl refactoring
* Removed cache_dirhandling from CPU plugin
* clang-format
* Fixed python tests
* Fix
* Fixed bugs in HETERO case
* Fixed clang-format and warnings in auto plugin
* Added import_export as capability for TEMPLATE plugin
* Commented throw exception from loaded_from_cache
* Fixed clang-formatof ro template plugin
2023-03-08 19:19:52 +04:00
6d7b94b8cd
Improved API validator logic ( #15942 )
2023-02-25 01:11:50 +04:00
91df0a8aa9
[API remove] remove variantImpl & variantwrapper related class/interfaces ( #15580 )
...
* [API remove] remove variantImpl & variantwrapper related class/interfaces
Signed-off-by: xuejun <xuejun.zhai@intel.com>
* [Remove APIs] fix code format issue
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [Remove api] fix python compiler issue caused by deprecated varient
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
* [Remove APIs] fix code format issue
Signed-off-by: xuejun <xuejun.zhai@intel.com>
---------
Signed-off-by: xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2023-02-17 16:31:26 +04:00
0efa17f95c
HETERO move dumping dot files to separate file ( #15758 )
2023-02-16 18:10:41 +00:00
70cb829992
[DOCS] Move of developer documentation from wiki to md documents - master ( #15372 )
...
* CPU Plugin README creation
* debug capabilities
* Update debug_capabilities.md
* performance_analysis_ITT_counters
* cpu-emulation
* runtime_parameters_cache
* Update README.md
* internal_cpu_plugin_optimization
* See Also update for CPU Plugin
* See Also update for CPU Plugin 2
* intel_gpu
* Update README.md
* source code structure & See Also update for CPU plugin
* Update README.md
* See also update
* basic_data_structure
* memory_allocation_gpu_plugin
* Update memory_allocation_gpu_plugin.md
* simplified workflow
* graph optimization passes
* execution_of_inference
* GPU Plugin
* GPU Plugin fix
* Snippets
* Update README.md
* Update README.md
* fixes
* Snippets fix
* Update README.md
* component description
* Key Contacts
* Apply suggestions from code review
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
* Update src/plugins/intel_gpu/README.md
* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md
* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md
* Update src/plugins/intel_cpu/docs/internal_cpu_plugin_optimization.md
* Apply suggestions from code review
* Apply suggestions from code review
* Apply suggestions from code review
Text graphs to mermaid
* Update src/plugins/intel_gpu/docs/simplified_workflow.md
* Delete ov_intel_gpu_plugin_diagram.png
Removal of ov_intel_gpu_plugin_diagram.png file as the mermaid version is replacing it.
* Apply suggestions from code review
* Update src/common/snippets/README.md
---------
Co-authored-by: Sebastian Golebiewski <sebastianx.golebiewski@intel.com>
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2023-02-16 11:03:11 +04:00
3f06d871bf
Remove catch(...) code style ( #14433 )
...
* remove ... in /src/bindings/c and resolve format
* remove ... in auto and resolve format
* remove ... in auto batch and resolve format
* remove ... in hetero and resolve format
* IE exception
* IE exception
* const
* const
* resolve format and ov::Exception
* ov::Exception
* reset IE::Exception
* remove ov::Exception
* InferenceEngine->IE in auto_schedule.cpp
* fix coredump while runing test case smoke_AutoMultiMock_NumStreamsAndDefaultPerfHintToHWTest
* fix coredump issue of running LoadNetworkWithSecondaryConfigsMockTest
* fix commpile fail in CI
* resolve core dump of running exec_network_get_metrics.cpp and disable some test cases for KEEMBAY and MYRIAD in exec_network_get_metrics.cpp
* remove test cases of MYRIAD and resolve core dump of running KEEMBAYin exec_network_get_metrics.cpp
* resolve conflic of common.h
* resolve conflic of common.h
* resolve common.h complie fail
---------
Co-authored-by: guozhong <guozhong.wang@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2023-02-16 11:44:24 +08:00
421d791f58
[HETERO] Return only own properties for compiled model ( #15547 )
2023-02-07 23:54:08 +04:00
988847f559
Transformation component transition to OV namespace (phase 4) ( #13558 )
...
* Use openvino pass graph_rewrite
* Replace use of ngraph::pass to ov::pass
* Remove ngraph::pass aliases
* Update after rebase
* Fix post merge conflicts
* Apply code style
* Apply code style
* Remove bypassing inclusion
* Apply code style
2023-01-25 01:02:35 +03:00
0c9abf43a9
Updated copyright headers ( #15124 )
...
* Updated copyright headers
* Revert "Fixed linker warnings in docs snippets on Windows (#15119 )"
This reverts commit 372699ec49
2023-01-16 11:02:17 +04:00
a8a59f3cb4
[HETERO] Remove WA for Parameters, Results and Constants. ( #15020 )
...
* [HETERO] Remove WA for Parameters, Results and Constants.
* Update HeteroSyntheticTest
2023-01-11 17:45:56 +04:00
80a07375bf
Bell/hetero execution devices ( #13924 )
...
* initial commit
Signed-off-by: fishbell <bell.song@intel.com>
* add cases
Signed-off-by: fishbell <bell.song@intel.com>
* apply review comments
Signed-off-by: fishbell <bell.song@intel.com>
* enable app
Signed-off-by: fishbell <bell.song@intel.com>
* clang
Signed-off-by: fishbell <bell.song@intel.com>
* apply review comments
Signed-off-by: fishbell <bell.song@intel.com>
* enable cpu conditionally
Signed-off-by: fishbell <bell.song@intel.com>
* enable cpu tests
Signed-off-by: fishbell <bell.song@intel.com>
Signed-off-by: fishbell <bell.song@intel.com>
2022-11-15 09:53:18 +00:00
8a9c19e3eb
Warning as error for Windows ( #13291 )
...
* parent 6e7016ccda29224c93ff87e9e4e674a1adca8b0520d00d215a0eb236254375ef86a79d
2022-10-06 13:44:21 +04:00
9e7c821477
Enabled plugins auto registration ( #12573 )
...
* Enabled plugins auto registration
* Fixed comments
* Skip CMakeLists.txt
2022-08-16 23:19:10 +04:00
8b9aea9fad
Fixed missed pugixml in case of system libs + wheel package ( #12464 )
...
* Fixed missed pugixml in case of system libs + wheel package
* Fixes
* Removed useless rpath
2022-08-12 11:35:56 +04:00
Vitaliy Urusovskij