Commit Graph

836 Commits

Author SHA1 Message Date
Vladislav Golubev 5e846a0433
[CPU] Extensions shape inference issue fix (#18824) 2023-07-28 15:02:38 +04:00
Luwei Zhou 493723ecdf
Fix dump_check.py argument. (#18400) 2023-07-28 15:25:43 +08:00
Luwei Zhou c9001980ef
[CPU] Ensure const blob 16 byte alignment on non-AVX platforms (#18705) 2023-07-28 09:01:36 +04:00
Nesterov Alexander 1857c7a793
Revert "[ARM CPU] ACL TBB scheduler (#17445)" (#18821)
This reverts commit 510f578aab.
2023-07-27 21:38:20 +04:00
Tomasz Jankowski 37fb5d2736
[CPU] Handle negative indices in ScatterElementsUpdate (#18770)
* Handle negative indices in ScatterElementsUpdate

* Enable test on negative indices

* Enable onnx test on negative indices
2023-07-27 16:53:58 +00:00
Luwei Zhou 5f5df36b60
[CPU] Enable oneDNN avx2 brgemm impls for Matmul/FullyConnected operations (#18467) 2023-07-27 13:09:13 +02:00
Zhang Yi 5a945a6219
[CPU] Apply sdl requirement for mlas (#18812) 2023-07-27 14:53:05 +04:00
Oleg Pipikin ff0b51f3ca
Rename CommonTestUtils namespace (#18590)
* Rename CommonTestUtils namespace 1

* Rename CommonTestUtils namespace 2

* Rename CommonTestUtils namespace 3

* Rename CommonTestUtils namespace 4

* Fix1

* Fix2

* Fix3

* Apply comments

* Fix4

* Fix5
2023-07-26 21:06:50 +02:00
Pawel Raasz 2655512b2f
Review RandomUniform for shape inference (#18800)
* Review RandomUniform for shape inference
- Check dynamic and static shape propagation
- Check label propagation
- Check preserve input values and labels
- Add template implementation of shape_infer
- Add unit tests

* Update RandomUniform copy test

* Use correct type for call reference implementation
2023-07-26 21:54:15 +04:00
Pawel Raasz 32f2868a5b
Review shape inference of ExtractImagesPatches (#18771)
* Review shape inference of ExtractImagesPatches
- Check static and dynamic shapes propagation
- Check label propagation
- Review template implementation of `shape_infer function
- Add unit tests.

* Add additional test to check padding calc
2023-07-26 21:49:48 +04:00
Pawel Raasz bb3c9aa9a7
Review RegionYolo class for shape inference aspects (#18741)
* Add static shape adapter
- Adapters holds CPU dimension which can be reference to it or vector
- Add ov::optional for holding optional result from shape inference
- Add new `infer` function in `IStaticShapeInfer`

* Temporary support of StaticShape

* Minor corrections in ShapeInferenceTA

* Migrate shape_infer to new interface version

* Replace StaticShape by adapter implementation

* Replace IShapeInferCommon by IStaticShapeInfer

* Correct code formatting

* Fix build issues

* NodeValidationFailure::create for StaticShapeRef

* Review RegionYolo for shape inference:
- Check dynamic shape and label propagation
- Check static shape inference
- Review shape_infer template implementation
- Update unit test

* Remove commented test code

* Correct flatten dim calculation
2023-07-26 20:42:41 +04:00
Tomasz Jankowski 1ee5b6dd3f
[Tests] Add subgraph body functions comparison (#18254)
* Add subgraph body comparison

* Avoid confusing function name

* Skip failing snippet test

* Skip some ov_snippets_func_tests

* Derive comparison flags

* Skip snippet test

* Drop on bodies mismatch

---------

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-26 15:59:28 +02:00
Luwei Zhou 3228522b53
[CPU] Fix legacy zero point issue (#18399) 2023-07-26 11:56:35 +04:00
Zhang Yi 1c0c929231
[CPU] MLAS backend integration (#17885)
- currently enabled only for FP32 FullyConnected node on x86 CPUs
2023-07-26 07:40:34 +00:00
Nadezhda Ageeva 97b4b13074
Adds ov::internal::exclusive_async_requests in ov::internal::supported_properties (#18746)
* Adds ov::internal::exclusive_async_requests into ov::internal::supported_properties

* Update HETERO tests for ov::internal::exclusive_async_requests
2023-07-26 09:43:21 +04:00
Pawel Raasz 5a4cf4c8b6
Review ReorgYolo class for shape inference aspects (#18633)
* Add static shape adapter
- Adapters holds CPU dimension which can be reference to it or vector
- Add ov::optional for holding optional result from shape inference
- Add new `infer` function in `IStaticShapeInfer`

* Temporary support of StaticShape

* Minor corrections in ShapeInferenceTA

* Migrate shape_infer to new interface version

* Replace StaticShape by adapter implementation

* Replace IShapeInferCommon by IStaticShapeInfer

* Correct code formatting

* Fix build issues

* NodeValidationFailure::create for StaticShapeRef

* Review ReorgYolo op for shape inference
- Check partial shape and label propagation
- Check shape_infer implementation
- Update tests for static and dynamic shapes

* Change dim::is_valid to dim::is_empty
2023-07-25 18:51:17 +02:00
Ilya Lavrenov 5792bba6d1
Disabled multi_isa in ARM CPU plugin (#18737) 2023-07-25 11:48:54 +04:00
cecilia peng 7fbd3a7ebf
[CPU] Zero-copy optimizations for model outputs (#18476)
- Implement zero-copy output between plugin graph and infer request, thus eliminate memory copy overhead and optimize performance
- Implement double buffer for InferRequest outputs
2023-07-25 10:33:48 +04:00
Pawel Raasz 5eab1be682
Migrate shape infers to new `IStaticShapeInfer` API (#18579)
* Add static shape adapter
- Adapters holds CPU dimension which can be reference to it or vector
- Add ov::optional for holding optional result from shape inference
- Add new `infer` function in `IStaticShapeInfer`

* Temporary support of StaticShape

* Minor corrections in ShapeInferenceTA

* Migrate shape_infer to new interface version

* Replace StaticShape by adapter implementation

* Replace IShapeInferCommon by IStaticShapeInfer

* Correct code formatting

* Fix build issues

* NodeValidationFailure::create for StaticShapeRef
2023-07-24 15:59:18 +02:00
Mang Guo ec8fe6353a
Allow weight sharing across NUMA nodes inside one socket (#17989)
* Allow weight sharing across NUMA nodes inside one socket

* Fix comments

* Add WA for MacOS
2023-07-24 20:49:46 +08:00
Ilya Lavrenov 86c68fffe4
Removed Intel Myriad headers from new API (#18736)
* Removed Intel Myriad from new API

* Renamed GPU unit tests
2023-07-24 16:20:08 +04:00
Egor Duplenskii 5833f32c22
[CPU][ARM] Fix perf issues of oneDNN 3.2 migration (#18589) 2023-07-24 13:01:59 +04:00
Fang Xu e478964695
merge loadnetwork and importnetwork for cpu plugin (#18024)
* merget loadnetwork and importnetwork for cpu plugin

* fix testcase

* remove multithreading config saving

* modify test case

* separate function

* modify function name

* save model_prefer_threads to cache

* remove function encapsulation for config
2023-07-21 14:02:11 +08:00
Sun Xiaoxia 2dfb537bcb
Xiaoxia/add get_socket_id interface based on threading2.0 (#18264)
* add streams_info_table init in the constructor of config

* add refresh _proc_type_table

* add get_org_proc_type_table

* add numa_node per stream in reserve_available_cpus()

* fix warning

* remove log

* fix code style

* fix gpu test build failed issue, modify debug info

* fix code style

* fix build failed on macos

* fix code style

* select socket in reserve cpu on 2 sockets platform

* fix build failed on macos

* modify numa node selecting in reserve_cpu_by_streams_info

* add test case

* fix code style

* modify test case

* fix core dump

* fix core dumped on pin=NUMA

* fix test failed on macos

* fix reserve cpu is wrong when streams_info_table=[1 1 36] proc_type_table=[36 18 0 18]

* add test case in LinuxCpuReserve

* modify test case

* add test case in cpu_reserve_test

* add cpu_stream_info_test

* modify enum

* fix test failed

* change int to size_t

* remove invalid code, fix running failed on macos

* modify LinuxCpuStreamType test case, move ie_cpu_streams_info.hpp to openvino/runtime/threading/

* fix code sytle

* modify enum name

* add comments in test case

* fix build issue

* change IE_ASSERT to OPENVINO_ASSERT

* fix test failed on macos and windows

* updated test cases due to the cpu mapping is changed

* enable numa_node_id and socket_id in streams_info_table

* fix code style issue

* fix document issue

* add get socket id interface

* fix segment fault on machine enabled socket_id=1 with numactl command

* fix numactl failed on four numa nodes machine

* remove compile warning

* fix numa_node_id=-1

* fix test case failed on macos

* fix test failed on macos

* fix numa_node_id=0 on macos

* Solve conflicts with master branch

* separate test cases for Linux and Mac/Windows

* update code style for windows compiler

* fix comments

* fix code style

* fix code style

* remove _plugin_mutex, fix comments

* fix code style

* fix code style

* add get_num_sockets

* fix cpu reserve issue in latency mode,ANY core on RPL machine

* add cpu reserve test case

---------

Co-authored-by: Wanglei Shen <wanglei.shen@intel.com>
2023-07-20 23:34:21 +08:00
Chenhu Wang b5b11f3b29
[CPU]Shape agnostic jit kernel for MVN (#17988) 2023-07-20 13:40:37 +00:00
Mateusz Tabaka fe8b8a96ff
Handle sequence ops with non constant W, R, B inputs (#18138)
* Handle sequence ops with non constant W, R, B inputs

Ticket: CVS-49207

* fix tests

* tests

* fix gna tests

* add include

* change type for seqLenIdx

* rename is_constfoldable to is_on_constant_path

---------

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
2023-07-20 14:48:41 +04:00
Oleg Pipikin 60a8c2bc7a
Extend data_utils to work with ov::Tensor (#18142)
* Extend data_utils to work with ov::Tensor. Update SplitConcatMemory tests

* Fix1

* Apply comments

* Apply comments 2

* Apply comments 3

* Apply comments 4
2023-07-20 08:29:47 +00:00
Anton Voronov 60e40843c0
[CPU] f16 constant folding on cpu plug-in side for MatMul only (#18079) 2023-07-20 08:58:46 +04:00
Xuejun Zhai ba76b45194
[AUTO BATCH PLUGIN] enable api 2.0 for auto batch plugin (#18172)
* [AUTO BATCH PLUGIN] enable API 2.0 for auto batch plugin

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] disenable auto batch plugin unite test for tmp

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] remove test with ov::auto_batch_timeout(-1), cause the variable is unsigned int

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix compiler error caused by std::atomic_uint32_t

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [Remote Context] fix revew comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix compiler warnings

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix compiler warnings

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix test error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix CI test error in cpu func test case, caused by batched model lost rt info

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix CI build error, caused by unused variable

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] using ov::threading

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] clear code in batched req share buffer with non-batched req

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] clean code & fix format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] clean code & fix format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] add api implementation about get_default_context() & create_context() and remove the test config with AUTO_BATCH_TIMEOUT(-1)

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix gpu test with auto btch failed

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix warning

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix get_default_context() issue

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix using namespace redundancy

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] modify variable naming style

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix CI test error, cause by tensor reference in virtual plugin

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] implement get_profiling()

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] remove get_context() from auto batch compiled model using the interface from parent class

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] implement create_context() & get_default_context for auto batch plugin

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix format issue

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] implement auto batch remote context

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix error after merge with master

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix compiler error caused by update master

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] refact remote context in auto batch plugin

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] add unite test cases for auto batch plugin

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix CI warning caused by unused variable & add unite of remote context

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] add virtual property for get_context() in icompiled_model & implement it in auto batch plugin

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] add ov::loaded_from_cache support

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix error caused by updating with master

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix unite test error

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix conflict

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix error caused by update master

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* [AUTO BATCH PLUGIN] fix review comments

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
Signed-off-by: xuejun <xuejun.zhai@intel.com>
2023-07-20 07:02:45 +04:00
Edward Shogulin 38dec7b8cf
[CPU] Fixed zero-point fusion transformation (#18435)
Proper hanlding for subgraphs where ZP parent node has more than one output port
2023-07-19 11:30:21 +04:00
Nesterov Alexander 510f578aab
[ARM CPU] ACL TBB scheduler (#17445) 2023-07-19 10:01:31 +04:00
Oleg Pipikin cdef86c366
Move unit and func test utils (#18423)
* Move unit and func test utils. Rename targets

* Fix1
2023-07-18 16:23:58 +02:00
Chen Xu 9334ad0790
[CPU] Reduce node supports fp16 precision (#18227) 2023-07-18 12:49:25 +00:00
Pawel Raasz ff5b56ee07
Improve node validation failure message for shape infer (#18520)
* Add NODE_SHAPE_INFER_CHECK macro
throws NodeValidationFailure for shape inference

* Use NODE_SHAPE_INFER_CHECK in topk shape inference

* Move description to header file

* export NodeValidationFailure::create function
2023-07-18 11:41:19 +04:00
Vladislav Golubev 42d2c130c2
[Snippets] ExtractReshapesFromMHA transformation (#18477) 2023-07-17 20:42:18 +02:00
Oleg Pipikin b211767280
Consolidate common test utils targets (#18385)
* Consolidate test util targets

* Fix code style

* Fix 1

* Fix code style
2023-07-17 11:59:13 +00:00
Nesterov Alexander 238c7fa47e
[CPU][ARM] Add ACL executor for Transpose (#17322)
* separate executors + add acl executor fot transpose

* correct axisCast

* update transpose executors list

* update new changes

* enable tests

* fix fortting

* fixed test shapes and transpose generalization

* fixed different signedness error

* size_t usage in loop counters

* undo unwanted changes

* fixed comments

* added i8 and fp32 to blocked x86 tests

* fixed comments

* fixed comments

* extracted general reference executor from PermuteKernel

* fix mayiuse in JitTransposeExecutorBuilder::isSupported

* getDescWithType name refactoring

* refactoring

* removed 2nd executor creation in transpose node

* Moved RefOptimizedTranspose to the top

* fixed comments

---------

Co-authored-by: Aleksandr Voron <aleksandr.voron@intel.com>
2023-07-14 15:16:09 +02:00
Alexandra Sidorova 67c88f4434
[Snippets] Added SplitDimensionM optimization (#18160) 2023-07-14 07:31:24 +02:00
Vitaliy Urusovskij 43ff356f1a
Hetero 2.0 (#18429)
* Hetero 2.0: Implement `hetero::Plugin`

* Fix CMakeLists.txt

* Remove duplicated "itt.hpp"

* Remove extra API method

* Delete `HeteroPlugin::Engine`

* Intregrate `ov::hetero::Plugin` into `HeteroExeNet`

* Use `is_new_api()`

* Add `override` modificator

* Rename `GetDevicePlugins` to `get_device_properties`

* Small fixes

* Fix precommit

* Fix Import/Export

* Fix `import_model()`

* Remove extra lines

* TEMPORARY disable one test

* ClangFormat+Refactoring

* Build fix

* Update `hetero::Configuration` logic

* Update `hetero::Plugin::get_property()`

* Fix

* Changes after code review

* Remove extra comments

* Revert "TEMPORARY disable one test"

This reverts commit 13fa48d8102ec5146e79987835e6f7444e469f7a.

* Small fix

* Refactoring + Fixes

* Add `hetero::Plugin::device_supports_model_caching`

* Replace `device_supports_model_caching` with ICore impl

* Code review changes

* Rework `Configuration`

* Implement `hetero::CompiledModel`

* Fix caching_test

* ClangFormat

* Fix inputs/outputs mapping
After some fix in ICompiledModel, m_inputs != model->inputs,
so mapping was updated to be independent from m_inputs
(same for m_outputs)

* Fix types

* Update `get_runtime_model()`

* Remove `ngraph` and `IE_THROW`

* Implement Hetero Sync/Async Infer Requests

* A lot of changes

* Add `submodels_output_to_input` to import/export

* Implement `get_tensors()`/`set_tensors()`

* Fix `Configuration` ctor

* Skip `SetPreProcessTo` legacy tests for hetero

* Change `Output->Input` logic to `Input->PrevOutput`
because for one output may be several inputs
(map key collision)

* Update `CompiledModel` to use shared_ptr vs *

* Update `CompiledModel`  public/private members

* Names refactoring

* Optimize imports

* Fix properties for `query_model()` call

* Use static objects in `Configuration` methods

* `Configuration` refactoring

* Get `ov::supported_properties` from subdevices

* InferRequest +1 import and fwd declaration

* Update `InferRequest` prof_info, remove extra methods

* Remove `InferRequestDesc`

* Remove `InferRequest::cancel()`

* Update CMakeLists.txt

* Remove extra `catch` in `CompiledModel`

* Replace `InferenceEngine::details::contains()`

* ClangFormat

* Use `const auto&`

* Try to fix types

* Remove `friendly_name` for subgraphs connection

* Remove TODO comment

* Remove `CompiledModel::m_model` as unused

* Polish .hpp files

* Fix size_t serialization in `CompiledModel::export_model()`

* Minor changes

* Move `intersect*` IE utils to anonym namespace

* Use `const auto&`

* Update Hetero `get_profiling_info()`

* Minor changes

* Rename `deviceName` to `device_name`

* Add `hetero::VariableState` in order to hold HW so

* Port internal properties to `ov::internal`

* Add `CompiledModel::set_inputs_and_outputs()`

* Add `OPENVINO_SUPPRESS_DEPRECATED_*`

* Fix CompiledModel `ov::device::properties` issue

* Use `get_device_name()` instead of hardcoded name

* Make `get_profiling_info()` names bwd compatible

* Remove `include` folder

* Remove try/catch from CompiledModel

* Update error message

* `CompiledModel::set_property` throw not implemented
2023-07-13 23:26:04 +04:00
Nesterov Alexander 6822eb612e
[CPU][ARM] Add ACL executor for Convert (#17323)
* seaprate executors + add acl executor for convert

* update convert

* enabled tests and lot of changes in acl executor

* fixed different signedness comparison

* added expectedPrimitiveType method

* fixed comments

* fp16 WAs

* enable fp16 convert tests

* Revert "enable fp16 convert tests"

This reverts commit 037af672ce.

* Revert "fp16 WAs"

This reverts commit 3db3d4294e.

* fixed comments

* updated expected privitive to ref

* fixed comments

* getDescWithType name refactoring

* GetPtr to getData refactoring

* GetPtr to getData refactoring

---------

Co-authored-by: Aleksandr Voron <aleksandr.voron@intel.com>
2023-07-13 12:36:49 +02:00
Xiping Yan a396f07421
[CPU][NGraph]Enable node scatter_nd_update support negative indices. (#17219) 2023-07-12 17:04:44 +04:00
Nikolay Shchegolev 98e88bee52
[CPU] Support Pad-12. (#18407) 2023-07-12 16:59:07 +04:00
Nadezhda Ageeva 3330cd69a7
[GPU] Introduce ov::config_device_id internal property to the new API (#17820)
* [GPU] Introduce ov::config_device_id internal property to the new API. Fix setting property for specific device

* Introduce ov::internal::supported_properties

* Fix caching tests

* Fix win tests

* Fix Proxy tests

* Replace CONFIG_KEY_INTERNAL(CONFIG_DEVICE_ID) by ov::internal::config_device_id in PROXY plugin

* Review comments
2023-07-12 10:03:35 +00:00
Chen Xu 7c1949421f
[CPU] Fix performance issue for some cases of Reduce node (#11456) 2023-07-12 08:48:38 +00:00
Pawel Raasz 56f51135d4
Grey preprocessing yuv nv12 i420 (#18239)
* Add two plane YOV to Grey conversion

* Add i420 to grey conversion

* Add yuv to grey conversion for GPU

* Fix cmakes

* Remove static from local function

* Remove opencv dependency from tests

* Put grey_from_yuv_single_plane into namespace
2023-07-11 12:41:24 +02:00
Nikolay Shchegolev 88703905f4
[CPU] Leftovers for Extension convert I64/U64 to I32. (#16941)
* [CPU] Leftovers for Extension convert I64/U64 to I32.

* Fix as per comments

* Fixes as per commits 2

* Fixes as per commits 3

* Revert "Fixes as per commits 3"

This reverts commit 84022be66f64faccd96a32da5611db0e5137d049.

* Some fixes

* Test fix
2023-07-11 11:42:53 +02:00
Maksim Kutakov 900163c484
[CPU] In place memory for dynamic shapes (#17741)
* InPlace memory direction resolution pass

* Partitioned mem mngr

* Concat reshape pattern has been enabled

* Enhanced in place conflicts detection

* Refactor Concat

* Fix Reshape isExecutable call

* Split node refactoring

* Gather node inPlace special case

* Temporal WA to enable zero copy on Split input

* Process inPlace edges in order

* Fixes

* Remove implicit initialization from Edge::getMemory

* Allow NotAllocated edges call allocate

* extract IMemory interface and implements Memory class.

* IMemory fixes after merge

* Prevent input memory modification

* Minor build fixes

* Fix unittest build

* Fix for variadic concat

* Edge reference fix

* Lock based mem manager

* Return value fix

* Naming refactoring

* Use make_unique

* Split output dims check

* Special processing for empty parts

* Concat null memory fix

* Fix downstream inplace resolution

* Concat allocated edge search fix

* Variadic split clean up tests

* Variadic Split tests update

* Fix make_unique conflict

* Split inPlace tests are back

* Concat inPlace dyn shapes tests

* Add safety checks to isInputTensorAtPortEmpty

* Fix partitioned mem mngr zero size reset

* Introduce Static Memory

* Gather InPlace Tests

* InPlace conflict check in merge Reorder Transpose

* Apply review comments

* fix after rebase

---------

Co-authored-by: jialipen <cecilia.peng@intel.com>
2023-07-11 10:39:29 +02:00
Katarzyna Mitrus 827fb0234b
[Shape Infer] RNN/GRU/LSTM Cell & Sequence - common shape infer and review (#18009)
* rrn seq base common shape infer init

* Update and add shape infer to all seq rnn based ops

* Use shape_infer in lstm seq core op

* Use shape_infer in rnn seq core op

* Unified shape infer for rnn cell base

* Update and add missing cells shape_infer functions

* Use shpe_infer in rnn_cell

* Update shape_infer map

* shape_infer tests

* Move new shape_infer to TA map

* More tests and shape improvements

* Introduce common base tests

* Fix merge conflict

* Missing setters and default ctor tests

* Use RNNCellBase class instead of template type op

* Update v0 LSTMSequence to use RNNCellBase as parent class

* Style

* V0::LSTMSequence update

* Specify opset in shape infer registry

* Move rank check

* Output vec generation refactor

* Update num_dir_validation

* Tests warining fix

* Test types adjustment

* Commented code cleanup

* Move test helpers to test fixture

* Common default ctor tests for Cell

* Update GRU shape infer tests

* Update LSTM shape infer tests

* Update RNN shape infer tests

* File names update

* Functions renaming

* Cast hidden size in test

* Move v0::LSTMSequence conformance test

---------

Co-authored-by: Pawel Raasz <pawel.raasz@intel.com>
2023-07-11 12:38:31 +04:00
Oleg Pipikin d6c0289008
Move common test utils (#18339)
* Move common test utils

* Apply comments

* Comments 2
2023-07-10 12:48:24 +00:00
River Li 3286a405be
Don't eliminate Transpose when 0 size of order_value (#18130)
* Don't eliminate Transpose when 0 size of order_value

* Remove invalid test for transpose
2023-07-10 14:58:02 +04:00