Commit Graph

229 Commits

Author SHA1 Message Date
Anton Pankratv 54c889f876
Implemented base cancelation implementation (#3805) 2021-02-04 11:19:44 +03:00
Chenhu Wang db84033aa8
[CPU] Introduced Load/Store emitters (#3567)
- Created emitters for jitted load and store and apply to MVN node
- MVN template function removed
- Optimized tiles processing in MVN node implementation
2021-02-04 10:21:26 +03:00
Svetlana Dolinina dc1b605b7f
Ngraph: add methods for removing parameters from Function (#3854)
* added methods for parameters

* added tests

* remove parameter from low latency

* Revert "remove parameter from low latency"

This reverts commit 86a91ddcb0.

* comment added

* fix style

* review fix

* extended comments

* style fixes

* review fixes

* test fix

* added full pipeline test
2021-02-04 06:59:06 +03:00
Edward Shogulin f57f1fafc7
[LPT] Q/DQ support integration (#3575)
* [ MO ] New INT weights form

	Ticket #34096

	FQ = Quantize -> Dequantize =
	= FQ` -> Convert(int8) -> Convert(src_dtype) -> FQ =
	= Constant(int8) -> Convert(src_dtype) -> FQ =
	= Constant(int8) -> Convert(src_dtype) -> Subtract(zero_point) -> Multiply(scale)

* [LPT] Q/DQ representation support

Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2021-02-03 17:05:34 +03:00
Nikolay Shchegolev 8d7c9de090
[CPU] Enable MVN-6 operation. (#3400) 2021-02-03 16:49:37 +03:00
Jozef Daniecki 4b1efeb858
Group convolution (#3995)
* GroupConvolution SLT style refactoring.

* Add GroupConvolution 1D SLT.

* Add GroupConvolution Serialization SLT.

* Add GroupConvolution ref impl to evaluates_map.

* Add GroupConvolution ref impl.

* Fix compilation on master.

* GroupConvolution specification update.

* Readability refactoring.

* Specification refactoring.

* Added 'output' section in GropuConvolution spec.
2021-02-03 16:07:01 +03:00
Ilya Lavrenov be772c58bb
Fixed "Reverse input channels" case for common Plugin API (#4142)
* Added preprocessing for GetBlob

* Fixed preprocessing tests

* Added more test cases

* Skipped tests on GPU
2021-02-03 14:21:33 +03:00
Kamil Magierski 9ff8e262ee
Dynamic Batch Test (#3936)
* Dynamic Batch Test

Whitespace fixes

style fixes

Include path fix

whiteline fix

Review comments implementation

* MacOS build fix

* Move dynamic batch test to configuration_tests

* change test namespace
2021-02-03 13:16:48 +03:00
Nikolay Shchegolev 4d9a030ff2
[CPU] Enable CTCGreedyDecoderSeqLen. (#3890) 2021-02-03 12:36:41 +03:00
Vladislav Golubev d681582251
[LPT] MatMul: 3D quantization support (#3391)
* [LPT] MatMul: supported 3D quantization
[LPT] MatMul with constant: propagate subtract
[LPT] LayerTransformation:added canBeTransformedSpecialDimension for transformations that support not only per-channel/per-tensor quantization
[LPT] plugin tests: added 3D test-cases

* reshape_fully_connected naming fix

* [LPT] NetworkHelper: replaced onWeights with isConstantPath
[LPT] MatMulTransformation cpuFuncTests tests: rtPrecision check

* [LPT] constant folding FQ on weights if child operations aren't supported
[LPT] convolution with incorrect weights tests refactoring
[LPT] fq on weights with unsupported operations tests
2021-02-03 09:11:06 +03:00
Maksim Kutakov f0398212f8
[CPU] Split layer nspc -> ncsp special case put back. (#3839) 2021-02-02 15:40:50 +03:00
Mateusz Tabaka 4e601eb315
Move Extension tests from ieFuncTests to cpuFuncTests (#3927)
* Move Extension tests from ieFuncTests to cpuFuncTests

* Move extension directory up
2021-02-02 11:55:14 +03:00
Maxim Andronov c56f3cd170
[CPU] Fix NormalizeL2 + Multiply (#4047) 2021-02-02 11:43:35 +03:00
Jozef Daniecki c1b0b03750
Convolution (#3922)
* Move Convolution and ConvolutionBackpropData ref impls into separate files.

* Add convolution unit tests.

* New convolution reference implementation.

* Remove unused convolution ref impl argument.

* Fix style.

* Revert "Remove unused convolution ref impl argument."

This reverts commit 739065d0d0.

* WA for arm-plugin: additional include with ConvolutionBackpropData.

* Style format in Convolution SLT CPU instantiation.

* Add 1D Convolution SLT CPU tests.

* Add Convolution Serialization SLT.

* Update source banners with 2021 date.

* Specification review.

* Readability improvement in padding detection.

* Refactoring regarding Tensor usage.

* Iteration over tensor slices made more readable.

* Code refactored to use only one convolution implementation.

3D convolution is used to compute also in 1D & 2D case (parameters,
inputs and filters shapes are adjusted accordingly).

* Removed Tensor abstraction.

* Name unnamed namespace as convolution_details.

* Refactoring: replaced std::next + negative index with std::prev.

* Specification refactoring.

* Revert "Name unnamed namespace as convolution_details."

This reverts commit cea526ec49.

* Added new convolution() overload.

* Fix legacy convolution() overload (needed for kmb-plugin).

* Reduced number of template type arguments in convolution ref impl.

* Added 'output' section in Convolution spec.

* Remove floating round type configuration.
2021-02-02 11:05:39 +03:00
Aleksandr Pertovsky d754e9b311
[CPU] CumSum tensors with rank >= 6 support. (#3859) 2021-02-02 10:45:52 +03:00
Maxim Andronov 537179b235
[CPU] FakeQuantize decomposition (#3741) 2021-02-02 09:37:02 +03:00
Chenhu Wang 4570550636
[CPU] Interpolate node: 5d support for onnx_linear mode (#3471) 2021-02-01 19:25:57 +03:00
Yury Gaydaychuk 7500bbd3b1
[CPU] ROIPooling with 1x1 pooled shape in bilinear mode fixed (#4020) 2021-01-29 15:09:39 +03:00
Ilya Churaev 2ebae7cf30
Introduce the Broker API to map original framework names to OV (#3800)
* Added tests

* Fixed tests

* Added tests to check addOutput method

* Added support of port names in the IR

* Update copyrights

* Deprecate tensor name

* Fixed comments

* Enabled functional tests for GPU, GNA and Myriad

* Fixed get_tensor().get_names()

* Added unit test to check tensor names

* Fixed code style

* Skip add output test for GNA

* Added serialization support

* Added PythonAPI

* Fixed tests

* Fixed tests

* Fixed typo

* Try to disable GNA test

* Fixed tests

* Removed unused variables

* Fixed tests

* Update documentation

* Fixed comment
2021-01-29 06:28:31 +03:00
Yury Gaydaychuk a1422a49d7
[CPU] PSROIPooling node enhancements (#3851)
- bf support for PSROIPooling
- nhwc, blocking formats support
- code refactor & performance improvements
- cpu specific tests
2021-01-28 11:55:54 +03:00
Gorokhov Dmitriy d58b4c65c8
[CPU] Plugin migration on oneDNN (v1.6) (#3725) 2021-01-26 16:31:10 +03:00
Nikolay Shchegolev 245bc33e8a
[CPU] GatherElements implementation. (#3860) 2021-01-26 09:53:20 +03:00
Ilya Lavrenov 8311b98222
Pre-deprecation of ICNNNetwork (#3887)
* Deprecated ICNNNetwork

* MKLDNN plugin: partially

* MYRIAD plugin: partially

* Fixed Myriad Plugin

* Improved GNA; fixed MKLDNN

* Fixed tests

* Fixed GNA

* Fixed unit tests linkage

* Removed ICNNNetwork from tests

* Removed obsolete tests
2021-01-25 14:09:03 +03:00
Vladislav Golubev 2d39555191
ConcatTransformation naming fix (#3965)
* concat naming fix

* [LPT] concat with child and output plugin tests
2021-01-22 23:02:16 +03:00
Ilya Lavrenov 9cfe909e1e
Unused variables (#3963)
* Added -Wused-variable flag

* Fixes for clang compiler

* Removed wrong -Wno-error from protobuf compilation

* More fixes
2021-01-22 17:41:15 +03:00
Ilya Lavrenov 1044ed4352
Added export / import for Template and Hetero plugins (#3940)
* Added export / import for Template and Hetero plugins

* Added WA for Apple RTTI
2021-01-22 14:17:44 +03:00
Vladislav Golubev ef72e21213
[LPT] StridedSlice Transformation (#3817)
* [nGraph] evaluate_strided_slice: replace read_vec to host_tensor_2_vec

* [LPT] StridedSliceTransformation
2021-01-21 00:15:37 +03:00
Yury Gaydaychuk 1aeb7fb089
[CPU] ROIAlign: fixed misprint in input width value (#3853) 2021-01-20 11:16:02 +03:00
Maksim Kutakov 21e17dad4f
[IE TESTS][CPU] I8 and U8 precisions was enabled in the reverse sequence single layer test. (#3722) 2021-01-19 17:04:12 +03:00
Maksim Kutakov c20c3a9e3d
[IE TESTS][CPU] Fusing tests added to the CPU specific single layer tests. (#3015) 2021-01-19 11:51:08 +03:00
Gorokhov Dmitriy 2bfc941cf1
[CPU] Runtime precision for execution graph (#3886) 2021-01-19 11:25:28 +03:00
Liubov Batanina 3a21c99b48
Replaced size_t with int64_t (#3744) 2021-01-16 00:39:01 +03:00
Gabriele Galiero Casay a555908858
Develop Bucketize Reference Implementation (#3693)
* Bucketize: Revise op class and add type_prop unit tests

* Bucketize: Develop reference implementation

* Bucketize: Add unit tests

* Bucketize: Add single layer test and cpu instantiation

* Bucketize: Add unit test with empty buckets for INTERPRETER

* Bucketize: Typo in buckets element type check

* Bucketize: Add custom generated inputs in single layer test class

* Bucketize: Use random_device to generate seed for data blob

* Bucketize: Remove unsupported f64 precision

* Bucketize: Add function description

* Bucketize: Remove randomness of inputs generation by using static seed

* Bucketize: Support different precisions for data and bucket inputs

* Bucketize: Refactor type_prop tests and improve backend unit test coverage
2021-01-15 17:51:58 +03:00
Mateusz Tabaka 69af75e483
Allow FakeQuantize with output_low scalar to be transformed (#3812)
* Allow FakeQuantize with output_low scalar to be transformed

* add test case with scalar
2021-01-15 16:16:53 +03:00
Piotr Szmelczynski 9ddbfac6b1
Avgpool revise (#3674)
* Update the spec

* add unit-tests

* add avgPool unit-tests to CMakelist

* Remove second constructor and change the first one to take default values for rounding_type and pad_type

* add type_prop test for default values

* add 5d input single layer test instances

* add type_prop tests

* Require input to be 4D or 5D

* add validation check for pads size

* Update few tests to take 5D input instead of 6D

* Update validate_and_infer_types method

* Update infer_batched_pooling_forward and try_apply_auto_padding methods

* Update auto_padding_spatial_dims_dynamic type_prop test for binary_conv, conv, deformable_conv, group_conv and max_pool

* style-apply

* add validation check for kernel size

* add xfail for avgpool python backend test

* style-apply

* remove avgpool backend test from xfail list

* Update spec

* Allow the 3D input

* Update type_prop test with 3D input

* style-apply

* Remove xfail_issue_38709

* fix typo

* Update spec

* Update outputs section in spec

* Update spec

* fix typo

* clean file

* Update detailed description and fix xml examples

* fix exclude-type typo

* fix typo in outputs section
2021-01-14 00:23:26 +03:00
Ilya Lavrenov 0d22328a25
Partially removed ngraph cmake duplication with IE cmake (#3751)
* Partially removed cmake duplication with IE cmake

* Deprecated API usage: fixed or suppressed

* Fix for TypeRelaxed

* Canonical form for ngraph includes

* Removed extra visibilit settings; removed graphviz find_package

* Removed var_functions module; canonical includes for ngraph::reference

* Fixed deprecated API in ngraph tests

* Re-use standard cmake macro for shared libs

* Trying to fix ONNX importer tests
2021-01-11 14:49:33 +03:00
Yury Gaydaychuk 9069781659
CPU implementation for ROIAlign (#3579) 2021-01-11 12:04:45 +03:00
Gorokhov Dmitriy 37b6e75730
[CPU] Fixed Divide operation support for I32 precision (#3721)
* [CPU] Fixed Divide operation support for I32 precision
2020-12-28 19:18:19 +03:00
Alexandra Sidorova e82257d021
[CPU] Improvements for Pad implementation (#3267) 2020-12-28 13:28:56 +03:00
Vladislav Golubev 5943e1be73
[LPT] issue #37332: tests unification (#3277)
* [LPT] ieFuncTests unification

* [LPT] plugin tests unification

* [LPT] added removeStandaloneCleanup && removeTransforamtions refactoring
2020-12-28 12:06:38 +03:00
Maxim Andronov cdf7f5eff5
Added memory format attribute (#3395)
* [CPU] Added memory format attribute
2020-12-24 10:25:53 +03:00
Yury Gaydaychuk 6d320d7162
convert to bf is to be inserted only after non-const layer (#3597) 2020-12-24 10:20:44 +03:00
Krzysztof Bruniecki a497153dcd
Gna fix mt with iterations (#3297)
* Enable CoreThreadingTestsWithIterations tests for GNA

  Sync rest of GNA Lib API,
  Sync Config for MT tests
  Change models in CoreThreadingTestsWithIterations to be compat with GNA

* Use parameter for model set selection

* Fix style

* Disable HETERO CoreThreadingTestsWithIterations tests and create issue 45658
2020-12-21 16:10:05 +03:00
Irina Efode f511f77894
[IE TESTS] Disable CancellationTests.*canResetAfterCancelAsyncRequest tests (#3645) 2020-12-16 18:16:16 +03:00
Maksim Kutakov 95f531e9e0
[CPU] Improved Split layer (#3449)
* [CPU] Added more optimal Split implementation
2020-12-16 16:51:01 +03:00
Irina Efode 602f8f2e08
[IE TESTS] Move SLT classes to `SharedTestClasses` lib & add serialization functionality to the common class (#3431)
* [IE TESTS] Changing functional test utils structure

* Example

* Remove extra

* Apply comments

* fixes

* [IE TESTS] Change the structure

* Continue

* step 3

* [IE TESTS] Complete transition single layer test classes

* [IE TESTS] Transition Subgraph

* Fix subgraph namespaces

* fix

* Apply comments

* latm fix
2020-12-15 22:32:00 +03:00
Irina Efode 524b226906
[IE TESTS] Disable sporadic issue 45163 (#3611) 2020-12-14 22:57:24 +03:00
Dmitrii Ryzhkov 77ecd7e17c
Feature/drizshko/cancellable request (#2635)
Added Cancelability to an Infer Request class (actually implemented for the CPU only, with a stub for other devices)
2020-12-14 09:38:29 +03:00
Alexey Varyzgin 3bcac1641d
[BF16] BF16 simulator for AVX512 was done (#3424) 2020-12-10 16:25:01 +03:00
Maxim Shevtsov d0eef043fd
[MULTI]Data affinity remote context and blobs (#3342)
* zero-copy (assuming determenistic app-level scheduling) for the multi-device, via "borrowing" the corresponding device-specific blobs and letting the app to implicitly use these

* Optimized Infer Request Scheduling

* remoteblob checks in the conventional SetBlob

* correctly (with status) reporting NOT_IMPLEMENTED

* SetBlob to accomodate for the RemoteBobs

* Tests for remote blobs support via MULTI: creating the shared_test in case the other (closed source) plugins would want to use that (in the private shared_tests instantiations).
Also instantiating the remote blobs tests for the some basic combinations to test the MULTI supports them

* macos compilation (and general plugin platform support) fix

* shuffled files, so that the MULTI tests are now part of the ieFuncTests (and need no separate target). Also brushed the macro that handales the NOT_IMPLEMENTED as bit

* further shuffled files, so that the initial MULTI tests are now part of the IE tests, yet specific instances do need separate targets

* Fixed misprint

* Brushing the code and comments a bit

* further brushing of the ScheduleToWorkerRequest: moving the task execution directly into the loop over devices (avoids pointers and 'else' clause)

* 1) zero-copy (assuming determenistic app-level scheduling) for the multi-device, via "borrowing" the corresponding device-specific blobs and letting the app to implicitly use these

2) Initial MULTI section in the opt guide (primarily to document a tip on helping the MULTI to keep the zero-copy path)

* [MULTI] remote context support and associated scheduling (respecting the remote data affinity)

* fix CentOS (old) gcc issue: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=81880
since the intriduced therad_local string is template the bug manifests itself (and the string is not allocated/initialized).
the QA is to wrap the std::string into the function

* further fix for the old gcc versions issue, now with non-trivial thread_local destruction sefault: switching from the std::string to the plain const char*

* additional tests for the MULTI and remote blobs (no remote context and multi GPUs cases)

* fix for the tests (that now can check for more specific NotImplemented exeption).
Alos couple of line endings
2020-12-09 09:52:19 +03:00