Commit Graph

203 Commits

Author SHA1 Message Date
Edward Shogulin 8390f40788
[LPT] Empty shape on weights handling: cherry-pick to master (#6170)
* [LPT] empty shape on weights fix

* [LPT] SplitTransformation naming fix

* [LPT] tests

Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
2021-06-17 12:36:25 +03:00
Edward Shogulin 72cb75ffc7
[LPT] Reshape folding extending: cherry-pick to master (#6151)
* [LPT] Reshape folding extending

* [LPT] tests addition

* typo quick fix
2021-06-16 11:14:29 +03:00
Edward Shogulin a16af0d2ea
[LPT] FakeQuantize folding fix to support ConvolutionBackpropData with FQ on weights (#6160) 2021-06-15 16:59:10 +03:00
Alina Kladieva 67c93ec6fa
Return sporadic GPU test cases (cannot reproduce 54436) (#6127) 2021-06-15 13:47:06 +03:00
Szymon Durawa 772465da1e
Add output shape and output padding for Convolution Backprop SLTs. (#5576)
* Create output shape for Convoution Backprop SLTs.

* Add output_padding attribute to SLT scope.

* Introduce SLT for Serializaton.

* Introduce new test layer class ConvolutionBackpropLayerTest which contains output_padding attribute and output_shape input. Old one is deprecated, but cannot be removed due to kmb plugin dependency.

* Add ConvolutionBackpropDataLayerTest into TEST_P.

* ConvolutionBackpropDataLayerTest left as legacy class used by kmb_plugin.

* Remove redundant variables.

* Switch to new API for gpu SLTs.

* Remove legacy API.

* Introduce legacy API to match dependency for KMB and ARM plugins.

* Create test cases for output_padding attribute.

* Fixing smoke_Deconv tests.
2021-06-15 07:08:10 +03:00
Patryk Elszkowski 6deec50b0b
Reshape OP: add SLT for special `-1` value in new shape dimensions (#5648)
* add test for special `-1` value in new shape dimensions

* add ticket with next steps
2021-06-15 07:07:18 +03:00
Katarzyna Mitrus 8dff04df28
ShuffleChannels ng op and reference implementation revision (#5764)
* Unblock shuffle channels tests from ie test manifest

* Add more backend tests

* ShiffleChannel reference impl update

* Update attr visitor test

* Remove unused get_pre_shuffle_shape helper function

* Update class descriprion

* Add type prop shape tests

* Remove NGRAPH_SUPPRESS_DEPRECATED macro

* Add single layer tests

* Update layer tests

* Remove unused header

* Move implementation to cpp file
2021-06-15 07:04:06 +03:00
Ilya Lavrenov 6e2d13937a
ImportNetwork with explicit device name only (#5689)
* Import with explicit name

* Fixed LoadHetero_MultiArchs tests

* Fixed MYRIAD tests on Windows

* Fixed compilation in tests

* Updated tesets

* Fixed test

* Removed useless lines

* Removed custom VPU tests, replaced with common ones

* Fixed Windows

* Reverted SKIP_IF_NOT_IMPLEMENTED macro
2021-06-09 10:09:25 +03:00
Vladimir Paramuzov aa4a18dda1
[IE CLDNN] Updated GPU device config (#6040) 2021-06-09 09:02:25 +03:00
Shoujiang Ma dcf36565b0
[AUTO plugin] AUTO plugin will ignore other plugins' configuration (#5979)
* AUTO plugin will ignore other plugins' configuration

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Update tests

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Support PER_COUNT config which is needed in benchmark_app

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Address reviewer comments: check config and throw exception for unsupported, but that begin with "AUTO_" will be ignored

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix CI tests issue

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
2021-06-08 12:11:58 +03:00
Andrei Gorbachev 64d7a40ae4
[IE CLDNN] 54304 fix reduce ops (#5986) 2021-06-07 18:36:38 +03:00
Ilya Lavrenov eff9f00320
Refactored ie_plugin_config.hpp (#5899) 2021-06-01 16:31:29 +03:00
Roman Lyamin c8a5044664
[IE CLDNN] Add Select int32/int16 input support (#5877) 2021-05-28 18:00:51 +03:00
Ilya Lavrenov 26bfa6f0ac
Tests for dynamic preprocessing in SetBlob (#5798)
* Corrected tests to match CVS-53713

* Fixed tests configs

* Skip tests on GPU

* Commented condition inside main SetBlob because of MYRIAD

* Adopted tests
2021-05-26 18:07:08 +03:00
Daria Mityagina 5ea8437c91
[VPU] Batch support for interpolate (#5520)
* batch support for interpolate

* hash update

* compilation errors solved

* changes in tests, so not to break other plugins

* changes in tests, so not to break other plugins

* Revert "changes in tests, so not to break other plugins"

This reverts commit 67e5c1e4ddba4f0cc858eb1293e50ce9d9ae0227.

* Revert "changes in tests, so not to break other plugins"

This reverts commit f6a537d2236f0b64f0ff028627af9e0e388a2d23.

* review corrections

* Firmware update
2021-05-21 12:54:58 +03:00
Yunji Kim cdc98d7286
[IE CLDNN] Fix DetectionOutput cpu implementation to be aligned with ngraph (#5544) 2021-05-20 11:04:50 +03:00
Shoujiang Ma 90a18d9cef
[AUTO] Implement auto-plugin limited devices feature (#5545)
* Update SelectDevice policy in auto plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>

* Implement limit device list for AUTO plugin

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add tests for AUTO limit device feature

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add gpu tests for auto-plugin

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix CI cpuFuncTests issue due to BATCHED_BLOB

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Override LoadNetwork(modelPath, config) in AUTO plugin

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Update SelectDevice() logic for LoadNetwork(model, config)

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Update GetNetworkPrecision logic for auto-plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>

* Address reviewers' comments

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Add tests for AUTO:GPU,CPU case

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Update logic in GetNetworkPrecision for auto-plugin

Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>

* Address reviewer's comment: clean and simplify code

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix wrong usage of convolution weight index

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Address reviewer comment: fix get network precision logic

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix rebase issue

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

* Fix ie_core.cpp header change

Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>

Co-authored-by: zhengtian.xie <zhengtian.xie@intel.com>
2021-05-19 23:47:54 +03:00
Vladimir Paramuzov d52c4d433a
[IE CLDNN] QueryAPI extension with gpu device info (#5440) 2021-05-19 16:44:40 +03:00
Andrei Gorbachev ae9f3ebc5d
[IE CLDNN] Add Gather-7 (#5360) 2021-05-19 15:03:47 +03:00
Vladimir Paramuzov 58c5682944
[IE CLDNN] Removed SortType::None from TopK func tests. Enabled all func tests (#5671) 2021-05-19 08:57:09 +03:00
Vladimir Zinoviev e41e25533d
[LPT] ConvolutionBackpropData support (#5313)
* [LPT] ConvolutionBackpropData support

* minor fixes

* [Transformations] Legacy subtract precision keep

* [LPT] ConvolutionBackpropData tests improvements

* [LPT] ConvolutionBackpropData weights folding when can't be transformed

* [LPT] CanBeTransformed unification and convolution weights folding

* [LPT] GPU INT8 optimizations condition flag

* [LPT] Concat precision predict improvement

* [LPT] Turn off asymmetric quantization for Deconvolution on GPU

* [LPT] Improvements from review

* [LPT] Check if layer after concat isQuantized and require per-tensor quantize

* [LPT] Improvement for Deconv->FQ pattern

* [LPT] Commented failing tests
2021-05-18 00:59:01 +03:00
Ilya Lavrenov a3448032ca
Minimized legacy usage in tests (#5591)
* Minimized legacy usage in tests

* Use legacy only for specific files

* Fixed code style

* Fixed linkage

* Removed old CPU / GPU tests binaries

* Test

* Disabled IB console

* Disabled test for AUTO QueryNetwork from parallel threads
2021-05-14 18:47:54 +03:00
Bartosz Lesniewski 61e9d020d4
Revise Unsqueeze op - tests (#5579)
* Add visitor test, separate backend test from common fused op file

* Add SSLT, separate empty axes squeeze case in SLT

* Add unsqueeze to trusted op list

* removing trailing whitespaces

* Add missing newlines at file end

* Review comments - actually running backend tests, fixed typo in visitor test
2021-05-14 07:44:48 +03:00
Ilya Lavrenov 07a49184c0
Fixed typo in length (#5611) 2021-05-13 07:52:55 +03:00
Sergey Shlyapnikov f458bd4384
[IE CLDNN] Disable CoreThreadingTestsWithIterations test skipping (#5495) 2021-05-12 13:56:12 +03:00
Bartosz Lesniewski 66b3efbb6c
Revise Squeeze op - tests (#5336) 2021-05-10 12:37:18 +02:00
Vladimir Zinoviev 8645c08396
[LPT] Zero point insertion in case of zero value on FQ output high (#5467)
* [LPT] Zero point insertion in case of zero value on FQ output high

* [LPT] Change precision in test on the real default precision[0]
2021-05-06 21:48:36 +03:00
Roman Donchenko 2c755aaf6f
Fix incorrect plural: childs -> children (#5532) 2021-05-06 20:08:42 +03:00
Gorokhov Dmitriy a19413c0c0
[CPU] Plugin migration on ngraph (#4344) 2021-05-06 19:49:24 +03:00
Ilya Lavrenov b47d11e31e
Removed useless iostream include (#5357)
* Removed useless iostream include

* Fixed samples compilation

* Klockwork fixes for template plugin
2021-05-03 17:12:00 +03:00
Alexandra Sidorova 03ca3d1ef7
[CPU] Fixed SoftPlus for large positive values (#4932) 2021-04-30 13:34:33 +03:00
Vladimir Zinoviev 19afae3638
[LPT] INT4 FakeQuantize not transform (#5082) 2021-04-29 18:24:21 +03:00
Alina Kladieva 1ae1757a5a
[inference-engine|tests|functional|gpu] Exclude sporadic (54436) (#5428) 2021-04-27 18:54:25 +03:00
Vladislav Golubev 32ac4f4e15
[LPT] Reduce*Transformation (#4713)
* [LPT] added notAllChildrensAreFQ to NetworkHelper

* [LPT] Added ReduceBaseTransformation class

* [LPT] ReduceMeanTransformation

* [LPT][TESTS] ReduceMeanTransformation: functional and plugin tests

* [LPT] ReduceMaxTransformation

* [LPT][TESTS] ReduceMaxTransformation: functional and plugin tests

* [LPT] ReduceMinTransformation

* [LPT][TESTS] ReduceMinTransformation: functional and plugin tests

* [LPT] RedueSumTransformation

* [LPT][TESTS] ReduceSumTransformation: functional and plugin tests

* [nGraph] TypeRelaxed::clone_with_new_inputs: added validate_and_infer_types()

* [LPT] ReduceMin/ReduceMax: handle mul with negative values

* [LPT] ReduceBaseTransformation:
    * fold for dequantization constants instead of manual manipulations
    * refactoring

* [TESTS] Reduce*Transformation template functional test-class and builder

* codestyle fix

* [LPT] ReduceMeanTransformation: removed WA

* [LPT] added description for ReduceBaseTransformation

* [LPT] NetworkHelper::foldDequantizationConstant quick fix

* [LPT][TESTS] reduce builder quick fix and fp16 tests for gpu enabled
2021-04-26 16:03:03 +03:00
Vladislav Golubev 05c23dfd94
[LPT][CommonOptimizations] ShuffleChannelsTransformation and ShuffleChannelsFusion (#4916)
* [nGraph] op::v0::ShuffleChannels: added type_info macros

* [LPT] ShuffleChannelsTransformation

* [CPU] ShuffleChannels decomposition disabled

* [LPT][TESTS] ShuffleChannelsTransformation functional tests

* [LPT][TESTS] ShuffleChannelsTransformation plugin tests

* [CommonOptimizations] Added ShuffleChannelsFusion transformation

* [CommonOptimizations][TESTS] ShuffleChannelsFusion tests

* refactoring and adding comments

* [CommonOptimizations] ShuffleChannelsFusion refactoring and fixes

* [CommonOptimizations] ShuffleChannelsFusion: removed unnecessary check

* [CommonOptimizations] transformation refactored and test-cases with dynamic shape added
2021-04-23 13:26:53 +03:00
Ilya Lavrenov 02bc98a03f
Removed suppressions for IInferRequest deprecation (#5310)
* Removed suppressions for IInferRequest deprecation

* Fixed Windows

* More fixes for Windows

* Fixed compilation on Windows

* Fixed comment in documentatipn

* Fixes for Andorid

* Fixes for old gcc 4.8

* WA for cross-compilations

* Fixed compilation

* Fixed HETERO plugin compilation for old compilers

* Flags

Co-authored-by: lab_ddpqa <lab_ddpqa@intel.com>
2021-04-21 16:05:30 +03:00
Mingyu Kim d4b071bd49
[IE CLDNN] Batched blob support is added for NV12 (#5230) 2021-04-15 11:18:34 +03:00
Kelvin Choi 9f93509b1c
[IE CLDNN] Add new operation GatherND-5 to IE clDNN plugin (#4857) 2021-04-12 07:41:16 +03:00
Vladislav Golubev 0b116620e2
[LPT] Split/VariadicSplit support (#5132)
* [LPT] Split support in ConcatTransformation

* [LPT] fixing functional problems after enabling Split/VariadicSplit transformations

* [LPT] added test case for StridedSliceTransformation, enabled tests with split

* [LPT] ConcatTransformation refactoring

* ConcatTransformation: added axis check

* [LPT] Added foldDequantizationConstant to NetworkHelper & SplitTransformation refactoring

* [LPT] Subgraph: returned and refactored quantizationPerChannel

* [LPT] foldDequantizationConstant refactoring

* [LPT] SplitTransformation refactoring

* [LPT] hbonets fix & ConcatTrasnformation refactoring

* [LPT] ConcatTransformation functional tests quick fix
2021-04-08 08:42:59 +03:00
Edward Shogulin 7f3d715f5d
Revert "[LPT] Split & VariadicSplit support (#4195)" (#5129)
This reverts commit 7877287301.
2021-04-07 12:12:34 +03:00
Vladislav Golubev 7877287301
[LPT] Split & VariadicSplit support (#4195)
* [LPT] Split support in ConcatTransformation

* [LPT] fixing functional problems after enabling Split/VariadicSplit transformations

* [LPT] added test case for StridedSliceTransformation, enabled tests with split

* [LPT] ConcatTransformation refactoring

* ConcatTransformation: added axis check

* [LPT] Added foldDequantizationConstant to NetworkHelper & SplitTransformation refactoring

* [LPT] Subgraph: returned and refactored quantizationPerChannel

* [LPT] foldDequantizationConstant refactoring

* [LPT] SplitTransformation refactoring

* [LPT] hbonets fix & ConcatTrasnformation refactoring
2021-04-07 11:02:43 +03:00
Vladislav Golubev a478475386
[LPT] Concat*Transformation: handled FQ with unexpected quantization levels (#5111)
* [LPT] TRANSFORMATION_EXCEPTION segfault fix

* [LPT] Concat*Transformation: handled FQ with unexpected quantization levels

* [TESTS] Concat*Transformation: added test-cases with unexpected quant levels
2021-04-06 12:13:47 +03:00
Vladimir Zinoviev e2ada66826
[LPT] Mixed precision GPU Plugin tests (#4498) 2021-04-05 18:04:34 +03:00
Taylor Yeonbok Lee b58c648d2d
[IE CLDNN] Build time optimization for OCL kernels (#4725)
Build OCL kernel batches of different buckets in parallel

Co-authored-by: Donghyeon Jeong <donghyeon.jeong@intel.com>
2021-03-31 10:22:19 +03:00
Wilson Seok 3eac187e2e
[IE CLDNN] Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now (#4913) 2021-03-26 08:35:06 +03:00
Ilya Lavrenov 8e261de0a8
Added PreprocessConversionTest tests (#4946)
* Added PreprocessConversionTest tests

* Disabled tests on GPU: CVS-51764

* Disabled some tests on VPU and TEMPLATE

* Support for input layout conversions in TEMPLATE plugin
2021-03-25 16:31:33 +03:00
Alexey Suhov a748c26fee
Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Mateusz Tabaka 9b829d2884
Introduce AddFakeQuantizeFusion and MulFakeQuantizeFusion transformat… (#4102) 2021-03-24 09:19:37 +01:00
Ivan Tikhonov a868d88d49
Do not convert Sequences to TensorIterator, when plugin supports the original primitive (#4631)
* do not convert Sequences to TensorIterator when plugin supports Sequence primitive

* fix referece implementations for Sequences, processing seq_len value == 0 case

* Adding new mode for LSTMSequence single layer tests

* update single layer tests

* fix failed unit tests, updated single layer tests for rnn/gru sequences

* fix failed unit tests

* fix single layer tests

* ignore failed single layer tests on gpu (known issue), fix review remarks
2021-03-22 06:46:46 +03:00
Mateusz Tabaka 93d2bae95a
Move Mul node before Reshape in GroupConvolutionMultiplyFusion (#4031)
* Move Mul node before Reshape in GroupConvolutionMultiplyFusion

In following scenario:

                                    +-----------+
                                    |  weights  |
                                    +-----------+
                                         |
                                         v
                                    +-----------+
                                    |  Reshape  |
                       ....         +-----------+
                          \              /
                           \            /
                            v          v
                       +--------------------+
                       |  GroupConvolution  |
                       +--------------------+
                                |
                                v
                           +-----------+      +----------+
                           |  Multiply | <--- | Constant |
                           +-----------+      +----------+

if a second input (weights) to GroupConvolution is a Reshape,
we should apply Multiply node directly to weights rather than Reshape node:

                                    +-----------+
                                    |  weights  |
                                    +-----------+
                                         |
                                         v
                                    +-----------+      +----------+
                                    |  Multiply | <--- | Constant |
                                    +-----------+      +----------+
                                         |
                                         v
                                    +-----------+
                                    |  Reshape  |
                       ....         +-----------+
                          \              /
                           \            /
                            v          v
                       +--------------------+
                       |  GroupConvolution  |
                       +--------------------+
                                |
                                v

That approach has no side effects in the usual scenario when weights are constant,
but it's necessary for models with FakeQuantize since it gives possibility to perform
GroupConvolutionTransformation from LPT transformations.

* remove unnecessary new lines

* simplify code

* check if input to reshape has shape that starts with G * O

* add pattern::has_static_dims({0, 1}) to weights

* Use K = 3 in WeightsWithFakeQuantizeAndReshape tests

* Add LPT tests for groupconvolution_qdq_transformation

* fix PullReshapeThroughDequantizationTransformation tests
2021-03-19 10:39:50 +03:00