Commit Graph

325 Commits

Author SHA1 Message Date
Wilson Seok 1e0470f4e7
Add slt in template plugin/lstm sequence (#9305)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* initial code commit

* add runtime reference

* apply ov::Model

* initial lstmcell-1 definition

* initial change

* apply Peepholes

* apply input_forget option

* apply initial test case of lstmsequence-1

* fix clang-format error

* fix clang-format error 2

* add lstms_sequence test cases by runtime reference and onnx test cases

* fix clang-format error

* fix clang-format error

* fix onnx test failure of LSTM IE_CPU

* fix clang-format issue

* fix clang-format issue 2

* add type_prop and visitor api test of lstm_sequence_v1

* fix clang-format error

* replace input/refOut data to hard coded and remove unnecessary enum definition

* update namespace of Tensor()

* remove supported test cases in disabling list
2022-01-28 07:49:32 +03:00
David Nam 78a1212a90
Implement interpolate-1 and interpolate-4 in template plugin test (#9704)
* Implement interpolate-1 and interpolate-4 in template plugin test

* Fix clang error

* Fix clang error

* Fix clang error

* Fix linux build

* Fix cpplint error

* Fix clang error

* Fix linux build

* Change way to pass attribute into struct for linux build

* Correct supported type

* Fix clang error

* Add visitor api test for interpolate-1 and interpoate-4

* Fix typo and cpplint

* Update copyright

* Avoid using a class that will be deprecated

* Rollback to CoordinateTransform

* Remove interpolate.in.cpp
2022-01-27 08:27:34 +03:00
Anton Pankratov f45991bd64
OV 2.0 c++ configuration API (#9870)
* New configuration API

* Review fix

* review coments

* fixed device name map

* fixed header

* code stile

* fixed optimization capabilities

* flatten properties

* dox fix

* doc

* merge conflicts

* fixed merge conflicts

* Fixed subobject linkage warning

* foramt fix

* Fixed unity test build

* Merge conflict fixes

* Fixed variadic
2022-01-25 12:43:56 +03:00
Alexander Zhogov 6c2d1e923c
Revert "OV2.0 c++ configuration API (#9829)" (#9860)
This reverts commit 50da8c4aed.
2022-01-24 11:29:09 +03:00
Anton Pankratov 50da8c4aed
OV2.0 c++ configuration API (#9829)
* New configuration API

* Review fix

* review coments

* fixed device name map

* fixed header

* code stile

* fixed optimization capabilities

* flatten properties

* dox fix

* doc

* merge conflicts

* fixed merge conflicts

* Fixed subobject linkage warning

* foramt fix
2022-01-21 18:44:41 +03:00
Alexander Zhogov 79ff926b6d
Revert "OpenVINO runtime Configuration API (#7750)" (#9828)
This reverts commit 400e9ad916.
2022-01-21 13:30:39 +03:00
Mikhail Nosov 7f10473b96
Loop/If/TensorIterator - fix dynamic input cases (#9752)
* Loop/If/TensorIterator - fix dynamic input cases
Reference evaluate for body uses Model::evaluate instead of custom evaluation
Loop/TensorIterator additional fix - set result shape according to body execution result

Only op_eval test verifies issues, template tests were added just in case (these passed even without fix)

* Fix clang-format

* rename ti.cpp
2022-01-21 13:27:20 +03:00
Anton Pankratov 400e9ad916
OpenVINO runtime Configuration API (#7750)
* New configuration API

* Review fix

* review coments

* fixed device name map

* fixed header

* code stile

* fixed optimization capabilities

* flatten properties

* dox fix

* doc

* merge conflicts

* fixed merge conflicts
2022-01-21 10:32:57 +03:00
Ilya Lavrenov 8f3d030d79
Removed ov::runtime namespace (#9781)
* Removed ov::runtime namespace

* clang-format

* Fixes

* template reference

* Fixes
2022-01-20 16:17:57 +03:00
Wilson Seok 22fae50229
Add slt in template plugin/region yolo (#8886)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of region_tolo

* add type_prop test and remove backend test of region_yolo

* apply type conversion for loading file test and add bf16 test case in skip_test_config

* change location of compile definition under target and use path_join from file_util

* add dependency of test_model_zoo

* apply ov::Model

* remove unnecessary

* changed compile definition of TEST_FILES

* skip test cases of external test file

* remove test cases of importing data file
2022-01-20 09:27:42 +03:00
Mikhail Nosov 690e7a5958
Local build seems good today (#9402) 2022-01-19 11:15:40 +03:00
Alexey Suhov a79830cb55
Update year to 2022 in copyright notice (#9755) 2022-01-19 01:07:49 +03:00
Ilya Churaev 3d4e82dcd1
Added new tests for tensors element types (#9667) 2022-01-14 22:59:08 +03:00
Anton Pankratov 790f02c0b1
Hetero creates single result node (#9572) 2022-01-14 12:26:39 +03:00
Luo Cheng 68d8ca8060
MulticlassNms/MatrixNms: ngraph op support FP16 output (#9481)
* recover overwritten code in #8520

* support fp16

* update spec

* apply review comments

* support dynamic type check
2022-01-14 07:54:32 +03:00
Steve Yoo a23a398dc0
Add SLT to Template Plugin: NonMaxSuppression-4,3,1 (#9511)
* Add SLT to Template Plugin: NonMaxSuppression-4

* Add SLT to Template Plugin: NonMaxSuppression-4,3,1
2022-01-13 12:42:56 +03:00
Mikhail Nosov a6c9f9aeab
Move 'NV12toRGB/BGR' reference evaluates to template plugin (#9548)
* Move 'NV12toRGB/BGR' reference evaluates to template plugin

CPU doesn't need this fallback, so implementation can be moved to reduce core binary size

* Moved evaluate_nv12 to 'runtime::reference'

* Fix arm build
2022-01-12 14:29:03 +03:00
Mikhail Nosov 26a78fcb5d
[OV2.0] Calculate model layout based on 'tensor' layout and convert steps (#9550)
* Calculate model layout based on 'tensor' layout and convert steps

Previously, 'model layout' is set to '...' by default,
thus no shape conversion happened when tensor layout is set to 'NHWC', then there was explicit convert_layout "NCHW"

Now "model layout" is calculated based on tensor layout and conversion steps:
Examples:
 1) Tensor: NHWC, Convert: NCHW. Result: NCHW
 2) Tensor: NHWC, Convert: 0312. Result: NCHW

* Fix for set_shape + resize case
2022-01-12 10:52:02 +03:00
Mikhail Nosov bd3a996239
[OV2.0] Preprocessing: support convert HWC->NCHW layout (#9540)
* Initial implementation

* Template reference tests

* cpu & gpu tests for HWC -> NCHW conversion
2022-01-11 13:13:37 +03:00
Alexander Zhogov 32bc7840fc
Revert "Revert "[LPT] Assign + ReadValue transformation (#8690)" (#9457)" (#9460)
This reverts commit d51f337934.
2021-12-27 22:51:23 +03:00
Alexander Zhogov d51f337934
Revert "[LPT] Assign + ReadValue transformation (#8690)" (#9457)
This reverts commit c5824b8494.
2021-12-27 18:25:11 +03:00
Vladimir Zinoviev c5824b8494
[LPT] Assign + ReadValue transformation (#8690)
* [LPT] Assign + ReadValue transformation

* [LPT] Assign+ReadValue: applied review comments

* fixed some misses
2021-12-27 17:07:20 +03:00
Ilya Churaev 5e1d241c11
Renamed template plugin and tests (#9389)
* Renamed template plugin and plugin's tests

* Renamed template_extension
2021-12-23 14:59:24 +03:00
Ilya Churaev d0cdf14c47
Fixed address sanitizer (#9364) 2021-12-23 14:02:44 +03:00
Vladislav Volkov 60a11a6348
[CPU] Renamed CPU plugin to ov_intel_cpu_plugin (#9342) 2021-12-23 11:49:25 +03:00
Ilya Churaev 42350a705e
Remove legacy targets (#9333)
* Remove some legacy targets

* Replace some targets

* Removed inference_engine_plugin_api dependency

* Minor comment for developer config

* Fixed include paths

* Small fixes for static build

* Try to fix build pyopenvino

* Fixed comments

* Try to fix build

* Include OpenVINODeveloperPackage inside InferenceEngineDeveloperPackageConfig

* Try to fix GAPI tests
2021-12-23 08:16:23 +03:00
Mikhail Nosov 8f908db61e
[OV20] Set tensors infer req (#9158)
* Fix incomprehensible error message during layout conversion when layout rank doesn't match with shape rank

* Stash

* stash

* Memcpy implementation
Added tests

* Revert "Fix incomprehensible error message during layout conversion when layout rank doesn't match with shape rank"

This reverts commit 37064741b2.

* Fix clang-format and remove redundant headers

* Covered "cached" case (+ tested on Myriad)

* Apply review comments
Introduced 'applyBatchedBlob' function which allows override 'memcpy' on inferefnce time

* clang-format fix

* Added dynamic shape case

* - Review comments
- Deep copy of parameters/results for caching from cnnNetwork. Deep copy logic is moved to Utils
- Caching Tests: return correct inputs/outputs map after ImportNetwork mock call

* Reworked according to discussion

Also introduced 'SetBlobsImpl' which throws 'Not implemented' exception by default.
Template plugin updates internal '_batched_inputs' map

* Updated according to moved tests

* don't support 'memcpy' for ROI tensors

* Fix caching tests

* Just to retrigger CI

* Correct offset padding (however there is no test update as current implementation will not hit here due to other checks)

* Fix clang-format

* Applied review comments

* Added check that 'get_tensor' throws if set_tensors/set_input_tensors is used

* Fix review comments - part 1

* Fix caching tests - mock implementation becomes more complicated
Cached mock model shall identify its inputs/outputs, otherwise core will assert on SetExeNetworkInfo stage

* More comments fix

* More comments fixes

* More cleanup

* And more style comment

* typo fix

* Try fix caching windows tests

* Blind attempt to fix Ubuntu20 CI
2021-12-23 01:19:28 +03:00
Anton Pankratov 114d37b28c
Fixed release oreder (#9218) 2021-12-20 12:11:32 +03:00
Steve Yoo bd2e3de295
Create LSTMCell-1 (#9073) 2021-12-16 17:48:10 +03:00
Vitaliy Urusovskij 2db19e6bf7
Fix c4146 warning: unary minus operator on unsigned type (#9153) 2021-12-16 13:13:05 +03:00
Mateusz Tabaka 40f668140e
Fix compilation error in template_plugin tests (#9248) 2021-12-16 01:52:26 +03:00
Steve Yoo d9ecb108f1 Create Einsum-7 (#8982) 2021-12-15 21:46:10 +03:00
Steve Yoo 93698483b5
Migrate ExtractImagePatches-3 (#8981) 2021-12-15 21:45:18 +03:00
Steve Yoo 2619269496
Create TopK-3 (#9106) 2021-12-15 21:42:24 +03:00
Ilya Lavrenov e6d08aef5b
Don't use EXCLUDE_FROM_ALL with samples targets (#9237) 2021-12-15 21:21:46 +03:00
Vitaliy Urusovskij 60e71e531b
Extend Tile test with different ops types (#8804) 2021-12-13 12:53:08 +03:00
Ilya Churaev 4f62a48077
Remove ngraph backends (#9162) 2021-12-13 00:04:56 +03:00
Steve Yoo 29715672fd
Remove unused header files in GatherTree-1 (#9141) 2021-12-12 00:18:33 +03:00
Ilya Churaev 37b0b6f7c8
Renamed ExecutableNetwork to CompiledModel (#9144)
* Renamed ExecutableNetwork to CompiledModel

* Fixed python

* Fixed comments

* Fixed build

* Fixed code style
2021-12-11 16:11:15 +03:00
Ilya Churaev ec6f57872f
Renamed ov::Function to ov::Model (#9051)
* Renamed ov::Function to ov::Model

* Fixed all for macos

* Fixed build

* Fixed build

* Revert changes in GPU plugin

* Fixed ngraphFunctions

* Fixed all for mac

* Fixed new test

* Fixed if for Windows

* Fixed unit tests and renamed Function in python API

* Fixed code style

* Fixed import

* Fixed conflict

* Fixed merge issues
2021-12-10 13:08:38 +03:00
Steve Yoo a2f93f069d
Create Gather-8 (#8953) 2021-12-10 11:59:52 +03:00
Ilya Lavrenov 02e7706776
Merged ngraph & core components (#9101) 2021-12-09 15:38:44 +03:00
Steve Yoo d3cf7b92d0
Create GatherTree-1 (#8995) 2021-12-09 09:26:43 +03:00
Wilson Seok 9faf661250
Add slt in template plugin/experimental detectron grid generator (#8923)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of ExperimentalDetectronPriorGridGenerator

* implement actual_comparision_size for compare

* update slt for actual comparison size and add visitor api test

* fixed clang error
2021-12-08 19:07:40 +03:00
Mikhail Nosov 20bf5fcc4a
Rename "network" to "model" in preprocessing API (#9054) 2021-12-07 19:26:27 +03:00
Mikhail Nosov 70b5e28979
[OV20] InputTensorInfo::set_shape (#9059)
* InputTensorInfo::set_shape

* Fix clang-format
2021-12-07 19:13:38 +03:00
Mikhail Nosov 92bdddbfc9
Fix for reverse-input-channels - semi-dynamic case (#8936)
In case of partially-dynamic shape, e.g. {?,3,?,?} shape inference
for gathering channels and reverse operations can't infer final shape to {?,3,?,?} and it becomes {?,?,?,?}

Added 'static' version of reverse-channels to preserve output shape for such cases
It can be changed in future if operations will be able to calculate shape on 'validate' phase
2021-12-07 16:39:24 +03:00
Anton Pankratov 9a5b911856
Variant replaced with Runtime Attribute (#8520) 2021-12-07 13:02:31 +03:00
Roman Kazantsev 42892767f5
[MO, nGraph, transforms., ref., python] Support DetectionOutput-8 (#8853)
* Implement MO part for DetectionOutput-8

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Implement nGraph part for DetectionOutput-8

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Implement deduction of a number of classes method

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix build

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Implement nGraph tests to check shape inference for DetectionOutput-8 with deduction of num_classes

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Implement attributes tests for DetectionOutput-8

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove DetectionOutput-1 from opset8

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add python bindings for DetectionOutput-8 and tests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Implement downgrading and upgrading transformations for DetectionOutput

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Implement tests for downgrading and upgrading transformations for DetectionOutput

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Adopt existing reference for DetectionOutput-8

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix DetectionOutput-8 reference

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add tests for DetectionOutput-8 reference

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Finish resolving merge conflict

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix python bindings after re-structuring

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix BOM package list

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix multibox_detection_test

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix python bindings for DetectionOutput-8

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Insert blank line between summary and description for python binding

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply review comments: identation, for loop

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix formatting in python bindings

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix supported_attrs for DetectionOutput from opset1

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Add missed imports for python if_op

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Apply feedback and fix Win build

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Use the same test suite name for test mixture

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix transformation tests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Recover BWDCMP_RTTI for legacy use and remove unused variables in tests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Remove unused variables in type_prop tests

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Recover legacy referenceDetectionOutput constructor

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Fix python binding for DetectionOutput

Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
2021-12-07 01:17:49 +03:00
Irina Efode 1cd8156d3d
[IE TEMPLATE] Fix operation set in QueryNetwork (#8824)
* [IE TEMPLATE] Fix opeartion set in QueryNetwork

* Apply review comments

* Prepare for review

* Return extra removed

* code style

* Update template_plugin.cpp

* Code style
2021-11-30 23:28:59 +03:00
Mikhail Nosov e2172cd38a
[OV2.0] Preprocessing api cleanup (#8898)
* Removed 'inline' Preprocessing API

Even though this API provided a way to specify all pre/post-processing in one line - it was considered inconvinient
With 'getters' API preprocessing code looks more clear for user, so old' inline' API is removed

* Fix pyopenvino build issues

* Update after merged PR#8717
2021-11-30 12:30:13 +03:00
Ilya Churaev 7678ab2b18
Move hetero plugin (#8872) 2021-11-29 14:05:08 +03:00
Bo Liu 25b2131d21
priorbox_8 ngraph and inference-engine parts (#8114)
* ngraph and inference-engine parts

* add priorbox_8 python api

* remove 'PriorBoxAttrs' and 'PriorBox' from outside of opset namespace

* add common nGraph transformation 'ConvertPriorBox8To0'

* remove redundant alias of PriorBox::Attributes

* use new Tensor api for evaluate method

* change v0operation back to the former api, pass Attribute structure to the reference implement

* use new Tensor api for constant_fold

* add support for dynamic shapes of constant_fold new Tensor api

* fix Node 'create temp tensors' issue when shape==0'

* revert to 'HostTensor' api for PriorBox8

* Apply suggestions from code review and 'template_plugin reference' testcase replaced 'backend INTERPRETER' testcase

* transformation part Apply suggestions from code review

* python init file updated for opset8

* keep backward compatibility to fix CI issue

* rebase to new structure of OpenVINO repo

* revert 'thirdparty/onednn_gpu' mistake changes
2021-11-29 07:28:49 +03:00
Steve Yoo 42f5034892
Migrate Sort (MatrixNms-8, MulticlassNms-8, NonMaxSuppression-5) (#8394)
* Migrate Sort (MatrixNms-8, MulticlassNms-8, NonMaxSuppression-5)

* Add right multiclass_nms.cpp

* Add struct Attributes to matrix_nms

* Add constructors to opset8::MatrixNms::Attributes

* Fix code format of opset8::MatrixNms::Attributes::Attributes
2021-11-26 22:35:43 +03:00
Anton Pankratov bd3e4fbe78
Added openvino any (#8288) 2021-11-26 12:23:25 +03:00
Steve Yoo 808323afa8
Migrate Movement 1 (Broadcast-1, Concat-1, Tile-1) (#8388)
* Migrate Movement 1 (Broadcast-1, Concat-1, Tile-1)

* Add Broadcast-3

* Update to namespace opset

* Add broadcast_test_helper
2021-11-24 05:20:41 +03:00
Vitaliy Urusovskij 5198c4644c
Convert pad_val to Parameter in ReferencePadTestNonConst... test (#8760) 2021-11-23 16:32:50 +03:00
Mikhail Nosov c29569ecbd
[TemplateFuncTests] RGBX->RGB: Increase image size to avoid test failures on some platforms (#8762)
* Increase image size to avoid test failures on some platforms

There is an assert 'length >= nlanes' and 'nlanes' value depends on machine architecture
Set 320x320 test image to guarantee that image size >= nlanes

Also increased image size for 'plugin shared tests' to ensure the same (even though tests do not work with legacy preprocessing)

* Descreased to 160x160
2021-11-23 15:26:22 +03:00
Steve Yoo d248bdc91a
Migrate Sort (TopK-1) (#8423)
* Migrate Sort (TopK-1)

* Add topk_mode_sort_order

* Skip topk_min_sort_none in Windows

* Add types to tests

* Skip topk_max_sort_none and topk_min_sort_none

* Modify names from 1d to 1dMaxMin and SetUp1 to SetUpSecond

* Add outIdx to run tests one by one

* Set default value 0 to outIdx

* Remove copy_data
2021-11-23 10:29:55 +03:00
Mikhail Nosov 7545af07d0
Preprocessing: convert color RGBX/BGRX -> RGB/BGR implementation (#8755) 2021-11-23 10:29:00 +03:00
Vitaliy Urusovskij 3b88682159
Support NonConst pads_begin and pads_end in Pad op (#8697)
* Support pads_begin & pads_end as dynamic ops in Pad

* Extend Pad template test w/ NonConst PB & PE cases

* Remove xfails for 69443 after issue was fixed
2021-11-23 09:27:37 +03:00
Evgeny Talanin 2777820882
Skip Exp test (#8692)
* Skip Exp test

* Fix regexp

* One more attempt...

* Update exp.cpp
2021-11-19 11:08:39 +03:00
Mikhail Nosov aaac5de2fa
[OV2.0] I420 preprocessing color format support (#8680)
* Add I420 preprocessing

Tests:
- Template reference
- OpenCV
- Legacy Preprocessing tests
- Functional shared tests for plugins (CPU)
- Disable i420 preprocessing tests on GPU

* clang-format fix
2021-11-18 23:30:44 +03:00
Irina Efode 3efd842dd9
[IE TESTS] Skip sporadic failures for ref test (#8685) 2021-11-18 18:52:46 +03:00
Ilya Lavrenov 90e10e369d
Configurable G-API preprocessing in static build (#8631)
* Added cmake option todisable G-API preprocessing

* Enabled PDPD, TF on Windows

* Revert "Enabled PDPD, TF on Windows"

This reverts commit 2851cba056.
2021-11-18 16:40:53 +03:00
Mikhail Nosov 03c8542357
[I420 color conversion] I420toRGB/I420toBGR reference implementation (#8605)
* ngraph part

* Template reference tests
Common plugin tests
CPU compliance tests
Serialization tests

* Clang format fixes

* Remove reference implementation for f16, bf16, f64 types

* Fix ninja build

* Fix opset8_dump test

* Fix opset8_dump test

* Fix CentOS build

* Removed Myriad preprocessing tests (to be added by separate PR)
2021-11-18 09:48:18 +03:00
Mikhail Nosov c2d09afab9
PreProcess API change: (#8629)
- PrePostProcessor takes 'function' argument in constructor
- PrePostProcessor::build() doesn't take any function anymore
- PrePostProcessor::input() method to get reference to input
- PrePostProcessor::output() method to get reference to output
- InputInfo - add getters of tensor, preprocess, network
- OutputInfo - add getters of tensor, preprocess, network

Samples:
ClassificationSampleAsync - use new getters

Inference engine:
- Use new getters in ie_network_reader.cpp

TODO: Consider removal of builder-like API in PrePostProcessor, InputInfo, OutputInfo
2021-11-17 00:51:19 +03:00
Anton Chetverikov d0f16d205a
GatherND_8 reference implementation (#8257)
* Add GatherND_8 operation

* Update shape infer function and tests

* Initial commit for nGraph GatherND_8 operation

* Add GatherNDBase class implementation

* Fix base class errors

* Add missrd header

* Update base class

* Update GatherND_8 implementation

* Fix codestyle

* Fix wrong rank

* Implement tests for gatherND_8 shape inference function

* fix codestyle

* Add limitation to doc

* Siplyfy check in shape inference

* Add more test cases

* Update shape inference function

* Add more test cases to cover all case with dynamic input shapes

* Update shape inference function

* Refactor tests

* Initial commit for gatherND_8 reference implementation

* Add visitor tests for gatherND_8 operation

* Add visitor tests for gatherND_8 operation

* Correct comment

* Add additional check is shape inference function

* Update shape inference implementation for gathernd operartion

* Fix codestyle

* Remove restriction for data is fully defined

* Update shape inference functon

* Add gatherND_8 reference to evaluate map

* Add tests for gathernd_8 reference in batch_dims > 1

* Fix codestyle

* Fix codestyle

* Fix missed check for nonetype

* Remove redundant checks for batch_dims

* Use get_shape method instead of get_input_shape in GatherND reference implementation call

* update reference implementation call

* Properly add GatherND_8 to test opset table

* Update GatherND reference implementation for support opset8 version

* Add unit tests for gatherND_8 reference implementation

* Update gatherND reference implementation call in evaluate map

* Mark failed tests for missed plugin gatherND_8 implementations

* Fix codestyle

* Fix codestyle

* Fix codestyle

* Update tests

* Move common methods to base class

* Fix codestyle

* Revert clone_with_new_input function moving

* Add more test for reference

* partially revert API changes
2021-11-16 10:58:06 +03:00
Steve Yoo 90094e8a8a
Migrate Sequence (CTCGreedyDecoder-1, CTCGreedyDecoderSeqLen-6, GRUCell-3, LSTMCell-4, OneHot-1, RNNCell-1) and Sort (ExperimentalDetectronTopKROIs-6) (#8314) 2021-11-16 08:46:21 +03:00
Steve Yoo f66d9216ef
Migrate Movement 2 (BatchToSpace-2, DepthToSpace-1, Roll-7, ShuffleCha… (#8158)
* Migrate Movement2 (BatchToSpace-2, DepthToSpace-1, Roll-7, ShuffleChannels-1, SpaceToBatch-2, SpaceToDepth-1)

* Fix typos while copying

* Update to opset namespace and add i4, u4, bf16 tests when available

* Remove i4, u4 tests from BatchToSpace and Roll
2021-11-16 03:32:29 +03:00
Alexandra Sidorova 5352c2b370
commented test (#8596) 2021-11-15 17:01:02 +03:00
Xiping Yan 3354275da1
Xp/revise embedding bag (#7694)
* Fix: variable writing error.
mas_dimension -> max_dimension

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Update description.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Update EmbeddingBagOffsetsSum comment, it will be easy to understand how to calculate bag.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add attribute description for md

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* WIP: Add correctness test.

Known issue:
1: weight fp16 issue.
2: default idx(1), don't choose in segment id. why?

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* change param order.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Support test T_IND type (int32 and int64)

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* weight support multiple type input.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* refactor correctness test code.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* embeddingbag offset sum correctness test pass.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* embeddingbag packed sum correctness test pass.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add visitor without attribute test.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add EmbeddingSegmentsSum serialization test.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Add EmbeddingBagPackedSum, EmbeddingBagOffsetsSum serialization test.


Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* fix build error after rebase.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* unify name: from ngraph:: to ov::

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* add fp64 support

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove my MACRO define wrappers.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Remove useless header file.

* tmp. pass.

* Remove MACRO warpper for embeddingbag_offsetsum

* Remove myown wrapper header, and update template plugin.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Change vector to ov::Shape.

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Rename CreateConstantVV-> CreateConstant

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>

* Fix rebase issue. duplicate case ov::element::f64:

Signed-off-by: Yan, Xiping <xiping.yan@intel.com>
2021-11-15 13:49:21 +03:00
Steve Yoo b320061ea3
Migrate Movement 1 (Gather-1, Gather-7, Pad-1) (#8414) 2021-11-15 04:31:59 +03:00
Steve Yoo 7a7ea100ec
Migrate Movement 1 Operations (StridedSlice-1) (#8221)
* Migrate StridedSlice-1

* Update generate function to literals for bf16 and f16

* Add shapes to tensors
2021-11-12 12:19:19 +03:00
Ilya Lavrenov e57a455b92
Added support of external modules in static build (#8518)
* Added support of external modules in static build

* Enable template plugin static run; disabled CPU tests run in dynamic build

* Make FEM library dynamic

* Fixed static build

* clang-format

* Fixed targets

* Python tests fix

* Fixed python API tests skip

* Fixed pattern

* Fixed pattern 2

* Don't run template plugin tests in static build
2021-11-12 08:56:57 +03:00
Ilya Lavrenov 461f746430
Install rules for static libraries case (#8384)
* Proper cmake install for static libraries case

* Added an ability to skip template plugin

* Added install rules for VPU / GPU

* Install more libraries

* Fixed absolute TBB include paths

* Disable GNA

* Fixed issue with linker

* Some fixes

* Fixed linkage issues in tests

* Disabled some tests

* Updated CI pipelines

* Fixed Windows linkage

* Fixed custom_opset test for static casr

* Fixed CVS-70313

* Continue on error

* Fixed clanf-format

* Try to fix Windows linker

* Fixed compilation

* Disable samples

* Fixed samples build with THREADING=SEQ

* Fixed link error on Windows

* Fixed ieFuncTests

* Added static Azure CI

* Revert "Fixed link error on Windows"

This reverts commit 78cca36fd2.

* Merge static and dynamic linux pipelines

* Fixed Azure
2021-11-10 18:25:51 +03:00
Wilson Seok 35ba404bcb
Migrate ngraph backend test/prior box (#8227)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of prior_box/prior_box_clustered/reorg_yolo and remove ngraph backend test

* remove related backend test file
2021-11-10 15:28:41 +03:00
Ilya Lavrenov e14ead8dd3
Don't use global objects during CPU plugin nodes registration (#8367)
* Load CPU plugin as extension as well

* Fixed linkage issues

* Added static linux build

* Disabled GPU

* Fix for CPU nodes registration

* Disabled GPU

* Disabled GPU

* Disabled GPU

* Disabled GPU

* Disabled HETERO synthetic tests in static case

* Fixed dependencies

* Proper fix
2021-11-04 12:39:28 +03:00
Steve Yoo e3f1813e5c
Migrate Movement 2 (GatherElements-6, GatherND-5) (#8282) 2021-11-03 08:02:19 +03:00
Steve Yoo bd756df2f5
Migrate ngraph backend test of constant operation (#7996)
* Add test cases for PReLU in cpu plugin

* For case when slope is vector

* Add Constant template plugin reference tests

* Update CMakeLists.txt and delete constant.in.cpp

* Add tests of tensor_2constant and constant_multi_use

* Add test of constant_equality_bool

* Remove wrong comments

* Remove some of strange if

* Merge to one CreateFunction

* Remove test names and update test for types

* Add bf16 and f64 tests

* Add missing type tests

* Clear actualOutData to allow multiple use of Validate()

* Update SetUp and CreateFunction to support CentOS CI

* Remove inputData = {}
2021-11-03 07:52:59 +03:00
Wilson Seok 75c6af7af5
Migrate ngraph backend test/experimental detectron detection & experimental detectron generate proposals (#8264)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of experimental_detectron_detection_output and experimental_detecteion_generate_proposals and remove ngraph backend test

* modify visitor api test of experimental_detectron_detection for clang-format

* modify visitor api test of experimental_detectron_detection for clang-format again

* modify visitor api test of experimental_detectron_detection for clang-format again2
2021-11-02 10:48:15 +03:00
Wilson Seok 3775efd54a
Migrate ngraph backend test/detection output (#8111)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of detection_output

* update op reference test and remove ngraph backend test

* make up the reference test data
2021-11-01 07:21:28 +03:00
Steve Yoo ff713a5e01
Migrate Movement 1 Operations (Transpose-1) (#8135)
* Migrate Transpose-1

* Skip dynamic shape tests

* Add shapes to tensors
2021-11-01 05:52:14 +03:00
Steve Yoo 05dfee0a70
Migrate Movement 1 Operations (VariadicSplit-1) (#8091)
* Migrate VariadicSplit

* Skip dynamic shape tests

* Add shapes to tensors
2021-11-01 05:42:10 +03:00
Wilson Seok f912a8102d
Migrate ngraph backend test/psroi pooling/deformable psroi pooling/proposal (#8152)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of psroi_pooling and deformable_psrio_pooling

* update op reference test

* remove ngraph backend test

* add op reference test of proposalV1 and proposalV4

* update skip_test_config.cpp to avoid failure of accuracy drop in fp16/bf16 test case of proposal
2021-11-01 04:47:42 +03:00
David Nam cc457e003e
Migrate normalization to template plugin test (#8240)
* Migrate normalization to template plugin test

* Migrate result, parameter to template plugin test
2021-10-30 17:58:33 +03:00
David Nam a429044038
Migrate signals to template plugin test (#8279)
* Migrate signals to template plugin test

* Use AutobroadcastType::NONE instead of AutobroadcastSpec::NONE

* Remove unused variable

* Fix cpplint error

* Remove unused variable
2021-10-29 13:01:42 +03:00
David Nam b2b9d9f2c7
Migrate MatMul to template plugin test (#8253) 2021-10-29 13:00:30 +03:00
Steve Yoo 5c2ef7268b
Migrate Movement 1 Operations (Reverse-1, Split-1) (#8079)
* Migrate Reverse-1 and Split-1

* Separate classes for each exception test case
2021-10-29 12:49:41 +03:00
Irina Efode c9e7e60a84
[IE TESTS] LayerTestCommon2.0 (#7945)
* Init

* try adopt softmax

* fix size of expected

* Fix cpuFuncTests

* Add configure model

* Remove extra

* fix softmax

* Adopt eltwise

* Eltwise

* Remove old dynamism

* fix oss build

* Remove In,OutPrecision

* Remove incorrect OPENVINO_ASSERT, correct eltwise tests and fix threshold

* Apply Maxim's comments

* Fix build

* ieFuncTests

* return in, out, prc

* fix tests

* Fix tests

* Fixes according to new api

* skip gpu

* try to fix myriad

* Fix myriad

* cpu fix
2021-10-29 12:00:45 +03:00
Ilya Lavrenov 8fb699a42c
Static compilation for inference plugins (#8197)
* 1. Removed explicit SHARED from libraries
2. Fixed double definition for ie_layer_validators

* Fixed SEG in unit-test: order of initialization for global vars

* Added an ability to find plugins.xml from static IE

* Fixes in unit-test

* Migrated to new macro for import / export

* Minimized number of custom dllexport

* Don't use IR v7 for static libraries

* Revert for merge

* Don't enable tests with dlopen for static libraries

* Code style

* Added condition for export

* Revert format_reader

* Removed forward decalaration with external linkage

* Fixed IE linkage on Windows

* Reverted back 2 flags

* Minimal RRTI for cpuFuncTests

* Minimal RRTI for cpuFuncTests

* Still need IR v7 reader

* Fixed build

* Fixed compilation

* clang-format fix

* Removed BUILD_AS_IS and used USE_STATIC_IE

* Enable IR v7 reader as static library

* Fixed compilation for GPU plugin

* Trying to build plugins as static library

* Plugins are able provide their own name for CreatePluginEngine function

* Fixed CPU

* Fixed comments

* Fixed ENABLE_IR_V7_READER usage

* Fixed VPU

* clang-format

* Fixes

* Fix

* Load multiple plugins at once

* Fixed interpreter undefined symbols

* Trying to dynamically register static plugins

* Reverted some ngraph changes

* Fixed cpuUnitTests compilation

* Fixed compilation

* Fixed myriad

* Fixed custom_opset tests

* Reverted linker flags

* Support both static and dynamic plugins

* Fixed compilation of myriadFuncTests

* Removed duplication

* Fixes after self-review

* Fixed linkage for preprocessing

* Fixes for Windows

* Fixes

* Fixed cmake options

* Fix

* Fix

* Fix 2
2021-10-28 11:33:56 +03:00
David Nam d198d57fe1
Migrate pooling to template plugin test (#8136)
* Migrate pooling to template plugin test

* Fix clang format

* Fix clang style error

* Fix clang style error

* Remove unused variable

* Fix cpplint error

* Fix CI build error

* Remove max_pool.in.cpp
2021-10-28 09:45:12 +03:00
Steve Yoo 6f862822e1
Migrate Movement 1 Operations (ScatterNDUpsate-1) (#8116)
* Migrate ScatterNDUpsate-1

* Remove round.in.cpp
2021-10-28 08:42:50 +03:00
Mikhail Nosov a2a8969201
[OV20] Enable OpenCV tests and support 'u8' type for Interpolate op (#8182)
* Interpolate reference implementation:
- Support u8 and other numeric types
- For integral types - round result to nearest integer (don't cast)
Preprocessing: enable OpenCV tests and add resize conformance tests with OpenCV

* Revert changes in interpolate.cpp, making them minimal needed (added u8 resize)
2021-10-27 20:56:43 +03:00
Mikhail Nosov 7ef4ff6385
Update only Reference implementation and tests (#8126)
There were discovered a lot of issues in 'CompareWithRefs' tests when generated float inputs are not rounded to 'int'
2021-10-27 12:29:37 +03:00
Mikhail Nosov d65e7d4d4f
[OV20] Preprocessing: convert_layout<std::vector<uint64_t>> implementation (#8213)
* Preprocessing: convert_layout<std::vector<uint64_t>> implementation

User is able to use this version without specifying layout explicitly

Same version of convert_layout is added for post-processing

Added usage of new convert_layout to ie_network_reader

* Fix review comment
2021-10-27 11:32:44 +03:00
David Nam 96af987c46
Migrate shape1,2 to template plugin test (#8200)
* Migrate shape1,2 to template plugin test

* Fix member variables order
2021-10-27 09:26:32 +03:00
David Nam fb9c949b29
Migrate FakeQuantize-1 to template plugin test (#8115)
* Migrate FakeQuantize-1 to template plugin test

* Fix cpplint error
2021-10-26 19:10:25 +03:00
Anton Pankratv c39e6fcfd8
added ov InferRequest behaviour tests (#7811) 2021-10-25 10:36:17 +03:00
Anton Pankratv c6eaa5d653
Added syntetic hetero tests for dynamic shapes (#8050) 2021-10-23 01:20:49 +03:00