Commit Graph

48 Commits

Author SHA1 Message Date
Ilya Lavrenov 12f2bb72da
Updates on deprecated stuff (#5838)
* Removed cloneFunction from ngraph CNNNetwork impl

* Removed custom clone

* Localize deprecation suppressions

* Removed Jira tickets

* Fixed MYRIAD tests compilation on Windows
2021-05-27 16:14:07 +03:00
Ilya Lavrenov a3448032ca
Minimized legacy usage in tests (#5591)
* Minimized legacy usage in tests

* Use legacy only for specific files

* Fixed code style

* Fixed linkage

* Removed old CPU / GPU tests binaries

* Test

* Disabled IB console

* Disabled test for AUTO QueryNetwork from parallel threads
2021-05-14 18:47:54 +03:00
Alexey Suhov a748c26fee
Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Anton Pankratv a2b8b974b8
Simplified IE Exceptions Implementation (#4258) 2021-03-18 16:30:16 +03:00
Maksim Derbasov 2a19fc2d8a
Fix warnings spotted by cl compiler (#4793)
* Fix warnings spotted by cl compiler

* Use inline instead of anonymous namespace

* Review comments
2021-03-17 13:08:42 +03:00
Andrew Bakalin a1f8fe3696
[VPU] Use nGraph value propagation in VPU private ops (#4291)
* [VPU] Update StaticShapeBroadcast

* [VPU] Update StaticShapeLoop

* [VPU] Update StaticShapeReshape

* [VPU] Update StaticShapeTopK

* [VPU] Get rid of evaluateTargetShape

* [VPU] Invalidate values before DTS

* [VPU] Update TopK tests

* [VPU] Review fixes

* [VPU] Review fixes
2021-02-19 11:23:18 +03:00
Andrew Bakalin 9d0c02dbd7
[VPU][NGraph][Tests] Merge Gather & GatherElements (#4140)
* [VPU] Introduce ExpGatherElements operation

* [VPU] Enable DTS for ExpGatherElements

* [VPU] Introduce MergeGatherGatherElements transformation

* [IE TESTS] Generate inputs in parameters order

* [NGRAPH] Support dynamic output tensor case in Squeeze evaluate

* [VPU] Fix allocator for dynamic input

* [VPU] Add test on inference

* [VPU] Add test on function compare

* [VPU][NGraph][Tests] Review fixes

* [VPU][NGraph] Fix tests

* [VPU] Review fixes
2021-02-09 11:55:57 +03:00
Gladilov, Gleb 785828d321
[IE][VPU]: Fixes BinaryEltwise DTS on empty input (#3879)
Makes DTS for BinaryEltwise produce empty output tensor in case if at least one input is empty. As criteria for empty tensor ReduceMin is used (assuming all shape's values are non-negative).

Tests are changed accordingly. Trying to add a new test case on inference with empty input, reference version failed, so those tests are left unchanged.
2021-02-08 10:28:57 +03:00
Evgenya Stepyreva f1ffe4f9fd
nGraph value propagation (#3368)
* partial value and shape propagation

* TopK k propagation

* stylish commit

* style again

* Precalc Folding and broadcasting fix

* style

* Self review

* forgetting the unused values

* deleting unused variables

* Review

* self review

* disaster mistake fixed

* tests corrected

* mod to be inferred while creation

* LPT test fix

* tests fixes

* fix

* tests

* dynamic backend fix

* comments

* disable propagation
2021-02-02 12:03:56 +03:00
Ilya Lavrenov 9cfe909e1e
Unused variables (#3963)
* Added -Wused-variable flag

* Fixes for clang compiler

* Removed wrong -Wno-error from protobuf compilation

* More fixes
2021-01-22 17:41:15 +03:00
Gleb Kazantaev 08eea31f45
Remove deprecated classes/methods usage from Legacy/Tests/VPUPlugin (#3907)
* Fix legacy converter for Mul/Add/Sub ops

* Updated VPU plugin to use pass_config;Updated tests to avoid legacy classes/methods

* Updated VPU pipeline
2021-01-21 12:06:07 +03:00
Andrew Bakalin 7c4f435335
[IE][VPU][Tests]: Support DTS for GatherElements (#3688)
* Support DTS for GatherElements
* Extract GatherBase to a common part
* Introduce tests on inference
* Introduce tests on function comparing
* Disable failing tests
2021-01-20 12:16:46 +03:00
Andrey Sokolov bfd8f1372c
[IE][VPU][TESTS]: add implementation of layer Round to Myriad Plugin (#3667)
* [IE tests] add opset4, opset5 to the opset list
* [IE VPU] add layer Round; support DTS
2021-01-12 11:50:35 +03:00
Andrew Bakalin f2f5e99f9f
[IE][VPU][Tests] Support DTS for Select (#3604)
* Support DTS + binary eltwise tests refactoring (avoid code duplication)
2020-12-17 12:08:22 +03:00
Irina Efode 602f8f2e08
[IE TESTS] Move SLT classes to `SharedTestClasses` lib & add serialization functionality to the common class (#3431)
* [IE TESTS] Changing functional test utils structure

* Example

* Remove extra

* Apply comments

* fixes

* [IE TESTS] Change the structure

* Continue

* step 3

* [IE TESTS] Complete transition single layer test classes

* [IE TESTS] Transition Subgraph

* Fix subgraph namespaces

* fix

* Apply comments

* latm fix
2020-12-15 22:32:00 +03:00
Andrey Sokolov fedd736913
[IE][VPU]: support DTS for Ceiling (#3562) 2020-12-15 12:32:17 +03:00
Andrew Bakalin d90c05aab4
[IE][VPU][Tests]: Support DTS for ScatterElementsUpdate (#3559)
* Enable DTS for ScatterElementsUpdate
* Update DTS tests
* Update inference tests
2020-12-11 12:46:26 +03:00
Andrew Bakalin 578ea2fc3c
[IE][VPU]: Support dynamic data in Broadcast DTS (#3548)
Ticket - #-44546
Changes:

* Support dynamic data as broadcast input in Broadcast DTS
* Update DTS tests to support both dynamic and static inputs
* Update inference tests:
  a) Refactor tests to have only one testing class - NonZero_Broadcast
  b) Make DSR_TestsCommon base class to reuse createInputSubgraphWithDSR and inputs generating utils.
  c) Add possibility to add additional results in DSR_TestsCommon, because NonZero doesn't support cases when both its outputs are unused, so we need to add at least one of them to function results.
2020-12-11 12:29:16 +03:00
Andrew Bakalin 9379247076
[IE][VPU]: GatherND DTS transformation (#3025)
* Implement GatherND DTS
* Introduce tests on DTS
* Introduce tests on DSR+GatherND
2020-11-12 17:30:41 +03:00
Maksim Doronin 9420b6e599
[IE][VPU]: Implement VPU Ngraph EIP->ReorgYolo transformation (#3066)
* We need to convert ExtractImagePatches op to ReorgYolo to restore the working capacity of myriad plugin while compiling Yolo-v2 models.
* It was previously removed in #2687
2020-11-11 22:04:59 +03:00
Andrew Bakalin 1c6772a9fc
[IE][VPU]: Support for Bidirectional mode in Broadcast DTS (#2873)
* [VPU][DTS] Update broadcast DTS to support BIDIRECTIONAL mode
* [VPU][Tests] Update tests with inference
* [VPU][Tests] Extend DTS tests
2020-11-03 11:59:06 +03:00
Andrew Bakalin 4043413529
[IE][VPU][DTS][Tests]: Remove WAs for networks with multiple outputs (#2828)
* Remove WAs for networks with multiple outputs
2020-10-29 13:44:52 +03:00
Polina Brzezinskaya 0040d47b00
[IE][VPU]: Bidirectional mode for broadcast on vpu (#2627)
* Support for bidirectional broadcast mode
2020-10-27 11:49:35 +03:00
Andrew Bakalin cab7a77cba
[IE][VPU][GT][DTS]: Update MyriadPlugin to work with dynamic NMS-5 (#2698)
* [VPU][GT][NGraph] Get rid of DynamicNMS and transformation
* [VPU][NGraph] Update DTS for NMS
* [VPU][NGraph] Update StaticShapeNMS to be inherrited from NMS-5
* [VPU][GT] Update StaticShapeNMS stage to work with updated NGraph op
* [VPU][Tests] Update tests
* [VPU][GT] Fix StaticShapeNMS to be inherited from NonMaxSuppressionIE3
* [VPU][GT] Remove unused NonMaxSuppression
2020-10-23 17:04:36 +03:00
Andrew Bakalin 0f2a4b1824
[IE][VPU]: Support DTS for Split (#2576)
* [IE Tests] Remove unnecessary cout
* [VPU] Add DTS for split
* [VPU][Tests] Add tests
2020-10-14 11:02:21 +03:00
Irina Efode 3205108821
[IE Tests] Added test filters for myriadFuncTests target (#2494) 2020-10-02 12:11:21 +03:00
Andrew Bakalin 8ebd3440c7
[IE][VPU]: Enable DTS for some eltwise operations (#2242)
* Enable DTS for Maximum, Minimum, Less, LogicalNot
2020-09-17 15:28:33 +03:00
Gladilov, Gleb e4f0d8053a
[IE][VPU][Tests]: Enables tests on MergeSubsequentDSROperations (#2149)
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
2020-09-15 10:44:25 +03:00
Ilya Lavrenov e2e2785131
Moved legacy API to legacy/ subfolder for include (#1677) 2020-08-10 18:33:25 +03:00
Gleb Kazantaev c518667e0a
ngraph::pass::ConvertPrecision transformation (#1312)
* In this PR I'll add ngraph::pass::ConvertPrecision transformation and change only CPU Plugin to decrease number of changes. Other plugins will be updated in separate PR.

* This PR also includes changes for TI body transformations. We need to call the same sequence of transformations including ConvertPrecision for TI body.
2020-08-03 22:21:38 +03:00
Alexander Perepelkin d8502bf7d3
Virtual inheritance to allow inheriting test classes and overriding common logic (#1557) 2020-07-30 23:57:01 +03:00
Andrew Bakalin dce1063526
[IE][VPU][NGraph] Move dynamic NMS from common to vpu folder (#1409)
* [IE][VPU]: Moves UpgradeNMS4ToNMSDynamic transformation into myriad plugin

* [IE][VPU]: Moves UpgradeNMS4ToNMSDynamic from common to vpu folder

* [IE][VPU]: Moves Dynamic NMS from common folder to vpu

* [VPU]: Makes NMS conversion unconditional

* [VPU][NGraph]: Changes dynamic NMS base class from v3 to v4

* [VPU]: Moves NMS4toDynamic transformation before common optimization
2020-07-23 10:23:35 +03:00
Ilya Lavrenov 949fee3cfc
Remove implicit conversion from getInputTo, getLayerCreator (#1274)
* Added ctor for CNNNetworkImpl to convert from ngraphImpl

* Re-use in all places instead of manual conversion

* Hide convertToCNNNetworkImpl usage

* Removed conversion from getCreatorLayer

* Fixes 2

* Fixes 3

* Fixes 4

* Fixed ieFuncTests

* Fixed more tests

* Fixed LPT tests

* Remove useless test

* Fixed GNA

* Fixed Gleb's comments

* Fixed Core integration tests

* Trying to fix python

* Fixed GPU tests

* Small fixes

* Fixed QueryNetwork after removing implicit conversion

* Fixed Core integration tests for QueryNetwork

* Fixed python; MULTI device QueryNetwork

* Fixed MULTI QueryNetwork

* Removed unused methods

* Enabled LPT FullyConnectedTestModel test

* Fixed typo in python
2020-07-16 16:44:48 +03:00
Gladilov, Gleb 543559f58c
[IE][VPU][nGraph]: Enables dynamic Reshape with non-const pattern support in myriad plugin (#1159)
* [IE][nGraph]: Introduces PartialShape ctor from values vector

Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>

* [IE][VPU][nGraph]: Moves evaluateTargetShape to common utilities

The same functionality - get upper-bound shape estimation for dynamic
input - is needed in dynamic Reshape along with dynamic Broadcast.
Return value type has been changed from PartialShape to vector<int64_t>.
The reason is Reshape encodes special values (0, -1) into input values
that define output shape. Representing those values (which upper-bound
provides evaluateTargetShape) as PartialShape leads to incorrect
representation vector with -1 as dynamic shape - which is not expected.

Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>

* [IE][VPU][nGraph]: Introduces StaticShapeReshape

In comparison with original Reshape StaticShapeReshape propagates
upper-bound shape through a function in case of dynamic input. To do so,
shape inference method gets upper-bound shape from evaluateTargetShape,
decodes special values (0, -1) in it and then propagate the result.

Output shape processing happens only once, because if shape inference
were called after ShapeOf operations have been optimized out on dynamic
path, then evaluateTargetShape will require evaluate method for all
operations that appear in function before current Reshape. Since
evaluate method is implemented not for all operations it lead to
Faster-RCNN compilation error.

Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>

* [IE][VPU][nGraph]: Updates Reshape DTS on StaticShapeReshape

In case of non-const Reshape input that defines output shape DTS uses
StaticShapeReshape which propagates upper-bound shape evaluated from
this input through a function.

Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>

* [IE][VPU][nGraph][Tests]: Refactoring DTS Reshape tests

The only changes are:

* header files include reordering
* indentation/wrapping fixing

Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>

* [IE][VPU][nGraph]: Moves ShapeOf transformation out of DTS scope

In comparison with DTS ShapeOf transformation needs to work on whole
function. Separating these 2 transformations makes testing easier since
now it's possible to call specific DTS without ShapeOf transformation
and vice versa.

Also DynamicToStaticShapeOf has been renamed into
EliminateShapeOfAfterDSR since transformation doesn't introduce new DSR
operations.

Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>

* [VPU][Tests]: Introduces DTS Reshape tests with non-const pattern

New StaticShapeReshape constructor has been added as well, since test
fixture should create it from reshape parameters, not reshape itself.

Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
2020-07-13 18:19:05 +03:00
Ilya Lavrenov 4f0225014d
Deprecated cnn layer (#1138)
* Deprecated getInputTo, getCreatorLayer

* Fixes

* Fixed ie_layers moving to legacy

* Fixed onnx importer dependency

* Fixed python

* Fix python API compilation

* Added comments not to use _impl from Data

Co-authored-by: Nadezhda Ageeva <nadezhda.ageeva@intel.com>
2020-07-03 20:57:28 +03:00
Evgeny Lazarev f596432268
NMS-4 op support (#1115)
* Specification for the NMS-4 operation (updated shape infer function)

* Enabled NMS-4 in the Model Optimizer

* Changed opset version for NMS with dynamic outputs and namespace to be "dynamic"

* Added NMS-4

* Added opset4 to the nGraph

* Added unit tests for NMS-4 type infer

* Renamed UpgradeNMS3ToNMS4 to UpgradeNMS3ToNMSDynamic. Added stub for ConvertNMS4ToLegacy

* Make IE aware of opset4 ops

* Updated NMSIE to have different shape infer function based on the NMS it was converted from. Implemented NMS4->NMSIE conversion

* Apply code style

* Updated StaticShapeNonMaximumSuppression op in the VPU

* Introduced new version of NMSIE operation with shape infer function from v4::NMS

* Fixed dynamicToStaticNonMaxSuppression transformation

* Added new version of NMSIE op with updated shape infer function

* Fixed NMS4 to NMSIE2 transformation

* Fixed constructors for nGraph ops v4::NM and dynamic::NMS

* Updated text in the opset4 specification document

* Code style fixes

* Fixed constructors for StaticShapeNMS + fixed test

* Minor change to the NMS op in the MO

* Fixed typo in the dynamic_to_static_shape_non_max_suppression transformation

* Removed redundant checks

* Refactored NMS infer and validate functions

* Added more checks to the validate_and_infer_types functions for NMS-3 and NMS-4

* Fixed compilation issue on Windows for op NMS

* Code style fixes

* Fixed typos in the NMSIE and NMSIE2 to CNNLayer op conversion

* Fixed typo in the ie_cnn_layer_builder_ngraph.cpp

* Fixed the NMSToLegacyNMS transformation. Added unit tests

* Apply code review comments

* Refactored NMSIE to use visitors

* Removed calling ConvertNMS4ToLegacy in the common optimizations

* Moved NMS4ToNMSLegacy to convert1_to_legacy group of transformations

* Removed useless include statement

* Removed copy-paste issue

Co-authored-by: Evgeny Lazarev <elazarev.nnov@gmail.com>
2020-06-30 14:04:31 +03:00
Ilya Lavrenov 3a9db885bf
Removed getLayerByName from public API (#1110)
* Fixed tests

* Removed getLayerByName from public API
2020-06-25 20:00:39 +03:00
Ilya Lavrenov 447f69c84e
Moved deprecated network iterator to legacy (#913)
* Removed deprecated iterator API

* Applied comments
2020-06-24 11:55:17 +03:00
Evgenya Stepyreva 543cccc8cf
[ DTS ] MatMul (#974)
* [ DTS ] MatMul

* [ TESTS ] Dynamic MatMul inference test disabled
2020-06-23 09:58:03 +03:00
Evgenya Stepyreva bb44f17a06
[ DTS ] Reduces (#940) 2020-06-18 11:36:07 +03:00
Evgenya Stepyreva 88cccee0b7
[ DYN NMS ] Static & Dynamic ops; DTS transformation; VPU tests (#884) 2020-06-18 00:16:20 +03:00
Evgenya Stepyreva a32d9662c2
[ DTS ] Exp, Softmax, Greater (#926)
- Dynamic to Static transformation enabled for Exp, Softmax, Greater
- Logic Elementwises default ctor sets autobroadcasting according to spec
2020-06-17 18:20:08 +03:00
Gladilov, Gleb f80bd537bf
[IE][VPU][nGraph]: Fixes DTS transformations to properly keep outputs names (#734)
* NonZero, Broadcast

* Concat

* Gather

* [IE][VPU][nGraph]: Fixes DTS transformations to correctly keep outputs names

* [IE][VPU][nGraph]: Fixes dynamic to static shape nonzero tests

Co-authored-by: Roman Vyunov <roman.vyunov@intel.com>
2020-06-05 11:16:52 +03:00
Alexey Suhov f30dcc218c publish master branch snapshot, revision 9df5eb1f84e13a35720a918f88324561222ab114 2020-05-20 01:13:06 +03:00
Alexey Suhov ba0a339888 publish master branch snapshot, revision 59af1853ca21ea08acf17b177da0b239753deb46 2020-05-18 17:21:58 +03:00
Alexey Suhov 5b428f0655 publish master branch snapshot, revision 49482ae3bea0cbaa07474f86f36db11943142687 2020-05-13 21:12:22 +03:00
Alexey Suhov 357cc7eb4c publish master branch snapshot, revision 0110d9c98fd7209589d06344f0d836f61d81f4b3 2020-04-27 21:21:29 +03:00
Alexey Suhov 127cbac5bc publish master branch snapshot, revision cdcab9d7ab48ffb0ee5629fabbfa06cb45debd9b 2020-04-15 19:01:57 +03:00