Commit Graph

35 Commits

Author SHA1 Message Date
Szymon Irzabek 862176d1d4
[GNA] Add support for strides with dilations and POT fake quantize layers (#6900) 2021-08-06 14:45:11 +03:00
Mikhail Ryzhov 89fba123bb
[GNA] Added support of FQ layers for outputs (#6905)
* [GNA] Fixed FQ pass for several outputs

* Added tests

* Used the latest opeset8
2021-08-05 22:12:52 +03:00
Szymon Irzabek 063c240ed6
[GNA] Add decompose 2D convolutions transformation (#6382)
* [GNA] Add decompose 2D convolutions transformation

* [GNA] Use constant folding instead of creating copies

* [GNA] Enable more tests

* [GNA] Align ngraph opset
2021-08-03 10:33:11 +03:00
Elizaveta Lobanova e7a00e9b31
[GNA] Fix Transpose-Conv-Transpose pattern recognition for 2d convolution (#6715) 2021-07-21 12:48:35 +03:00
Dmitrii Khurtin e8fa1aaccb
fixed crash related to loading model with fq and sigmoid (#6644)
* fixed crash related with loading model with fq and sigmoid

* renamed multiple_input.* to multiple_input_fq.*; removed two unnecessary FQ layers from smoke_fq_fusion_with_sigmoid test; moved FQ params to test params
2021-07-20 15:38:39 +03:00
Ilya Lavrenov bc36425381
Added suggest-override flag (#6631) 2021-07-16 18:55:05 +03:00
Szymon Irzabek 34c20ad9a8
Add fake quantize support for convolution padding (#6577)
* [GNA] Add fake quantize support for convolution padding

Combine seven ngraph matcher passes into two.
Remove max pool size checking.
Add ngraph reference tests for subgraphs which were processed by POT.
Fix remaining issues with Max Pooling output calculations.
Add setting of default compile target based on execution target.

* [GNA] Remove redundant subgraph matcher

* [GNA] Remove redundant subgraph matcher
2021-07-14 16:29:10 +03:00
Szymon Irzabek afe60b3263
Gna padding tests (#6541)
* [GNA] Use built in ngraph padding calculation

* [GNA] Use less channels for tests

* [GNA] Rename tests file

* [GNA] Add ngraph reference tests and some minor fixes in the transformation itself

* [GNA] Add invalid ngraph reference tests

* [GNA] Align brace style

* [GNA] Remove unnecessary condition
2021-07-08 11:49:07 +03:00
Szymon Irzabek 0dfe44e465
[GNA] Add transformation of padded to valid convolutions (#6149)
* [GNA] Add transformation of padded convolutions to valid ones

* [GNA] Switch to ngraph matcher pass

* [GNA] Apply review changes

* [GNA] Simplify padding calculation algorithm, fix MaxPool detection, review fixes.
2021-07-02 10:30:40 +03:00
Ilya Lavrenov fa2f9c5201
Migrated to official GoogleTest repo (#6286)
* Move gtest to <root>/wqthirdparty

* Fixed inference engine tests

* Fixed unit-tests

* Fixed GPU

* Fixed clDNN_unit_tests compilation

* Reverted ngraph changes

* Fixed VPU tests

* Fixed deprecated tests compilation

* Removed OpenVINO clone

* Added public submodule

* Removed

* Fixed Windows

* More updates for INSTANTIATE_TEST_SUITE_P

* Use release-1.10.0

* Removed ngraph copy of gtest

* Revert "Removed ngraph copy of gtest"

This reverts commit ec9fe08d79.

* Fixes for TYPED_TEST_CASE

* Fixed GNA tests

* Updated submodule

* Updaed index

* TMP disabled tests

* Revert changes and fix compilation errors

* Fixed caching tests

* Revert back

* Revert back all

Co-authored-by: Michael Nosov <mikhail.nosov@intel.com>
2021-06-22 17:39:39 +03:00
Dmitrii Khurtin 9e7d98fca9
Additional checks are added to prevent errors from occurring on the GNA library (#5953)
* additional checks are added to prevent errors from occurring on the GNA library side

* fixing after review

* move AreLayersSupported from Cnn2D namespace

* GNA_DEBUG is commented

* batch size <= 8 test was added
2021-06-21 17:53:38 +03:00
Elizaveta Lobanova 5c55d390e8
[GNA] Allow 2d reshape of the first diagonal layer (#6115) 2021-06-16 16:19:21 +03:00
Elizaveta Lobanova f4ba0f28a9
[GNA] Convert Matmul with batch size > 8 to pointwise convolution (#5991)
* [GNA] Convert Matmul with batch size > 8 to pointwise convolution.
Support Eltwise split to more than 2 parts.
Fake Quantize support fixes.

* Put convolution split into a separate transformation

* Add separate transformations for cases with bias and fake quantize

* Rollback restriction for diagonal layer reshape
2021-06-09 18:15:39 +03:00
Szymon Irzabek 0f6f09bd3d
Gna revert padded to valid convolution and 2d convolution decomposition transforms (#5941)
* Revert "Gna conv2d decompose (#5604)"

This reverts commit f6c3b90364.

* Revert "GNA padded2conv tests & fixes (#5589)"

This reverts commit 5db77bf9e6.
2021-06-02 11:07:40 +03:00
Elizaveta Lobanova 4b486e6223
[GNA] Fix fq weights fusion and relu scale factors calculation (#5886)
* Fix FakeQuantize weights fusion when multiple operations were using the same const

* [GNA] Fix scale factor calculation for Relu if it has source and doesn't have destination statistics

Co-authored-by: Dmitrii Khurtin <dmitrii.khurtin@intel.com>
2021-06-02 10:11:11 +03:00
Dmitrii Khurtin 39c08e40f6
[GNA] Fix bug with broadcasting constant layer with fq layer (#5766)
* fix bug with broadcasting constant layer with fq layer

* BroadcastConstWithFakeQuantizePass is removed; BroadcastConstPass is moved up in pass list

* constLayer->outData.front()->setDims is moved to conditions

* prevLayer->outData.front()->setLayout(nextLayer->outData.front()->getLayout()); is added
2021-05-25 20:03:18 +03:00
Szymon Irzabek f6c3b90364
Gna conv2d decompose (#5604)
* adding conv2d decomposition

* save point

* build of conv_2d factorization succeeds

* working 2d conv decomposing transform

* added pseudo code for handling larger kernels

* fix conv splitting due to size

* active work on convolution 1xK without dilation

* validated NHWC ordered networks with convolution kernel sizes:
3x3
3x1
5x1
1x5
1x3

TODO: 2d max pooling

* removed debug printouts

* fusing max pooling/bias/af when -disable_nhwc_to_nchw option is used

* code cleanup

* [GNA] Fixes for CI run

* [GNA] Add tests, fix transform

* [GNA] Fix padded2valid and conv2d decomposition coexistence

* [GNA] Temporarily disable tests due to mock call count issues

* [GNA] Split tests for different hw versions

Co-authored-by: prozen <piotr.rozen@intel.com>
2021-05-20 11:01:29 +03:00
Elizaveta Lobanova 68b94a7c9f
[GNA] Support of Matmul with const as the first input and other fixes for softmax and layer norm patterns. (#5623)
* Swap inputs pass

* [GNA] Handle case Gemm layer

* [GNA] Convert Matmul to FC

* VS tests

* Move to common optimization

* Gemm execution such as FC

* Test calc scale_factor

* Some changes

* Working version

* [GNA] Insert transpose between convolution/pooling and reshape.
Insert copy layers after concat inputs with multiple connections to the concat.
Accept networks with input connected to layers with different orientations if one of input dimensions is 1.
Fix scale factor calculation for Eltwise layer.
Fixes for Gemm quantization.

* Insert transpose after Reshape and  before Matmul

* Fix concat input alignment when it's the network input

* Comments applying

Co-authored-by: Andrey Dmitriev <andrey.dmitriev@intel.com>
2021-05-19 14:44:00 +03:00
Szymon Irzabek 5db77bf9e6
GNA padded2conv tests & fixes (#5589)
* add conversion of padded to valid convolution without other parameters change

* [GNA] Fix graph loop when multiple connections exist from single layer to concat

* [GNA] Add 1d and 2d conv test cases

Add models covering all transform scenarios.
Add test cases covering 1d and 2d convolutions.
Update transform with the newest code.
Add minor fixes in transform and elsewhere.

* [GNA] Remove debug code

* [GNA] Fixes after review

* [GNA] Fix failing tests

Co-authored-by: prozen <piotr.rozen@intel.com>
2021-05-18 14:31:23 +03:00
Elizaveta Lobanova 696aa37c37
[GNA] Fix compilation of topologies with only 2 functional layers: convolution and pooling (#5501) 2021-05-07 12:01:44 +03:00
Elizaveta Lobanova 22e4566faa
[GNA] Remove extra reshape before maxpool. Fix activation and maxpool reordering. (#5404)
Fix convolution input transposition for Kaldi models with FakeQuantise layers.
Fix floating point error in gnaFuncTests with debug logs.
2021-04-30 15:42:27 +03:00
Ilya Lavrenov c52117a09f
Fixed compilation with ninja + clang (#5469) 2021-04-30 08:57:03 +03:00
Elizaveta Lobanova df5e0d68aa
[GNA] Enable convolution in height dimension for NHWC native models (#4864) 2021-04-02 09:35:50 +03:00
Alexey Suhov a748c26fee
Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Bartosz Sochacki 3daacb5e09
[GNA] POT enabling (#4358)
* POT enabling for GNA

* POT enabling for GNA

* POT enabling for GNA - accuracy improvements
2021-03-04 16:10:01 +03:00
Elizaveta Lobanova 65053df07c
[GNA] Convolution without --disable_nhwc_to_nchw option for TF models. (#3918) 2021-01-27 17:15:34 +03:00
Elizaveta Lobanova 36edd1fb38
[GNA] Fix handling of permutes around convolution for a case with 1 channel (#3481)
Fix of concat scale factors calculation causing infinite loop during memory layer requantization

Fix of copy layer unsupported batch size
2021-01-13 16:12:19 +03:00
Irina Efode 602f8f2e08
[IE TESTS] Move SLT classes to `SharedTestClasses` lib & add serialization functionality to the common class (#3431)
* [IE TESTS] Changing functional test utils structure

* Example

* Remove extra

* Apply comments

* fixes

* [IE TESTS] Change the structure

* Continue

* step 3

* [IE TESTS] Complete transition single layer test classes

* [IE TESTS] Transition Subgraph

* Fix subgraph namespaces

* fix

* Apply comments

* latm fix
2020-12-15 22:32:00 +03:00
Irina Efode a546d2d912
[IE Tests] Added test filters for gnaFuncTests target (#2492) 2020-10-02 12:11:36 +03:00
Anna Alberska 6357ce83c5
[GNA] add support for NCHW & NHWC layouts for exporting output (#2031)
* [GNA] add support for NCHW & NHWC ExportScores

* fix cpplint
2020-09-08 10:57:44 +03:00
Nikolay Shchegolev 43ec4a5695
[CPU] CTCLoss operation implementation. (#1482) 2020-09-01 12:52:31 +03:00
Andrey Dmitriev bdbb04f47b
[GNA] Added fix for eltwise layer with more 65k elements (#1943) 2020-08-28 18:26:31 +03:00
Anna Alberska a2b71aef56
[GNA] add support for 4d eltwise (#1353)
* [GNA] add support for 4d eltwise

* cpplint fix

* refactor

* fix FP16 broadcast pass

* change anonymous function to InferenceEngine::details::product

* introduce anonymous function to the pass & add layer checks

* refactor tileBlob lambda
2020-08-19 16:03:18 +03:00
Anna Alberska 93d3fec503
[GNA] fix scale factor issue in remove permutation test (#1740) 2020-08-12 17:37:00 +03:00
Anna Alberska 21f2a97402
[GNA] Support of NHWC conv2d with N=1 H=1 and 1xk Kernel (#1209)
* [GNA] Support of NHWC conv2d with N=1 H=1 and 1xk Kernel

* [GNA] add test for comparing optimization outputs & cpplint fixes

* fix getInputTo() & fix cpplint

* fix tests

* revert kernel padding

* add AddConvolutionKernelPadPass & refactor

* cpplint fix

* fix CI issues & add layout sensitive dimensions

* move kernel padding issue to another branch

* add more legible error descriptions

* fix legacy tests & disable 3d input convolution tests

* change comment messages

* fix additional convolution kernel padding for PWL case
2020-08-11 15:20:19 +03:00