Commit Graph

67 Commits

Author SHA1 Message Date
Ilya Lavrenov 92e3972853
Significant documentation fixes (#3364)
* Added VariableState to Plugin API documentation

* More fixes for plugin documentation

* Added ie_memory_state.hpp to documentation

* Added proper dependencies between C++ and Plugin API targets

* Fixed issues in public C++ API reference

* Fixed issues in public C++ API reference: part 2

* Removed obsolete entries from EXCLUDE_SYMBOLS in doxygen config

* Fixed path to examples, tag files for Plugin API doxygen file

* Put impl to a private section for VariableStatebase

* Fixed examples path to Plugin API: part 2

* Fixed path to examples in main ie_docs doxygen file

* Replaced path to snippets; otherwise path depends on how cloned repo is named

* Added path to snippets for ie_docs doxygen file as well

* Great amount of fixes for documentation

* Removed IE_SET_METRIC

* Fixes for C API documentation

* More fixes for documentation

* Restored Transformations API as a part of Plugin API

* Fixed tag files usage for Plugin API

* Fixed link to FakeQuantize operation
2020-11-26 14:32:12 +03:00
Dmitrii Ryzhkov 70c02d0fea
ngraph constant mem reuse (#2548)
* Memory re-use for nGraph Consstant

* Code style fixes

* Did remove setWeights from public API

* Fixes for tests

* Moving setWeightsPtr to CNNNetwork

* Removing setWeights function, set blob ptr directly to preallocated ngraph buffer

* Fix for code style

* Preallocated buffer refactored, rename to Shared, remove declaration from AlignedBuffer

* Fix for code style

* Remove setWeightsBlobPtr from mock classes.

* fixing bugs after merge

* Test fix

* Fix for cpu Functional tests

* Fix for Windows build

* Try to fix GNMT test failure.

* Releasing pointers what holds CNNNetwork

* Fix after merge

* mkl-dnn submodule update

* reverting back cloned network cleanup

* Fix for double allocation

* Code style...

* update mkl-dnn

* update mkl-dnn

* mkl-dnn bump

* update mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* update mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* mkl-dnn bump

* bump mkl-dnn

* update mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* mkl-dnn bump

* update mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* mkl-dnn bump

* update mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* update mkl-dnn

* bump mkl-dnn

* mkl-dnn bump

Co-authored-by: Tony Reina <g.anthony.reina@intel.com>
2020-11-19 14:03:12 +03:00
Rafik Saliev 9790c1253c
[BugFix] Fix compilation error caused by typo in #3109 (#3135) 2020-11-16 11:25:57 +03:00
Ilya Lavrenov fec3bc0990
Propogate DEVICE_ID for functions working with RemoteContext (#3109)
* Propogate DEVICE_ID for functions working with RemoteContext

* More fixes for RemoteContext

* Fixed tests compilation with VariableState
2020-11-13 19:44:40 +03:00
Svetlana Dolinina 7bd76dc12b
Move QueryState from ExecutableNetwork to InferRequest (#2818)
* QueryState moved to InferRequest

* deprecate ExecutableNetwork::QueryState,chaged tests (without any check yet)

* fix build

* review fixes + build fix

* build fix + review changes

* remove blank line

* style fixes

* test build fixes

* style fix

* style fix

* fixed build of tests

* fix

* mac build fix

* hddl plugin build fix

* clean up unneeded implementation for method

* fixed tests build

* add implementation for getstate, correct getName for MklDNN

* fixed description of state API in comments

* lint fixes

* Rename MemoryState to VariableState

* added tests for cpu for VariableStates, several small fixes in tests and code

* merge fix

* lint fix

* remove whitespaces

* spaces fix

* fix in test to make it workable for all plugins

* fix typo

* fix test for gna

* remove extra comment

* fix test for gna
2020-11-12 12:40:43 +03:00
Ivan Tikhonov 1c3208ffe0
Low Latency transformation (#2869)
* initial draft of adding sinks to ngraph::Function

* style fixes

* code style fixes

* code style fixes

* code style fix

* review fix+build fix

* code style fix

* fix build

* API changed according to latest discussion

* review fixes

* review fixes + tests

* initial draft of adding sinks to ngraph::Function

* style fixes

* code style fixes

* code style fixes

* code style fix

* review fix+build fix

* code style fix

* fix build

* API changed according to latest discussion

* review fixes

* review fixes + tests

* added 1 more ctor

* style fixes

* used new api in ir parser

* fixed build

* update low latency transformation, fix unroll transformation, add unit tests, modify subgraph tests

* fix low latency transformation

* Update low latency transformation, unit and sub-graph tests

* update LowLatency transformation and tests

* ngraph codestyle

* fix build, update description

* resolve review remarks

Co-authored-by: Svetlana Dolinina <svetlana.a.dolinina@intel.com>
2020-11-06 14:11:11 +03:00
Vladimir Paramuzov 6e7db6fb37
[IE CLDNN] Plugin-side kernels caching (#2871) 2020-11-05 23:44:45 +03:00
Rafik Saliev d225ba6e53
[IE] Add batched blob support (#2203)
* [IE] Add batched blob support

New `class BatchedBlob : public CompoundBlob` defined to allow to pass multiple blobs as 1 InferRequest input.

Motivation: There is the special user case when a number of plain images (e.g. `NV12Blob`) should be passed as one input for network which batch size > 1.

`class CompoundBlob` is not applicable for such cases due to:
1. `NV12Blob` is `CompoundBlob` which prevents to combine multiple NV12 images to a CompoundBlob
2. The default behavior in most of plugins - do not accept generic CompoundBlob as `SetBlob()` argument

Adding `SetBlob(name, vector<Blob::Ptr>...)` to `class IInferRequest`, `class InferRequest`, `class IInferRequestInternal`, ...  - is not effective solution due to limited and specific use cases for `batched inputs`.

+ Apply rule-of-zero to CompoundBlob and inherited classes.

* Add "BATCHED_BLOB" optimization capability metric

* Add BatchedBlob usage to hello_nv12_input_classification

* Apply offline code review outcome:

1. Revert CompoundBlob public .ctors signatures
2. Remove 'workaround' .ctor for `BatchedBlob`
3. Revert tensor descriptors of `I420Blob` `NV12Blob` back to the 'fake' value.

* Code review fix

* Add functional tests for CPU, GPU, MULTI, HETERO

* update doc comment

* Apply code review change requests.
2020-11-03 21:19:26 +03:00
Jozef Daniecki 34af04e1a8
Serialization of experimental and custom ops (#2862)
* Add IEGeneric node type handling.

* Remove dependency on plugin_api library.

IEGeneric type name is passed via Visiotr API as new syntetic atribute.

* Add custom operations support

* Fix charachter literals comparison.

* Pass custom opsets to CNNNetwork:serialize().

IE extensions are stored in ngraph CNNNetwork and later used to pass
custom opsets to serialization transformation.

* Refactor custom ops tests to use template_extension library.

* Add comment on __generic_ie_type__ purpose.
2020-10-30 07:31:27 +03:00
Alexander Peskov 6e5a4714ac
Make MVN behaviour deterministic (#2458)
* Change default parallel reduce alg into deternimistic way

Signed-off-by: Alexander Peskov <alexander.peskov@intel.com>

* Introduce ie::parallel_for semantic with group_id parameter

Signed-off-by: Alexander Peskov <alexander.peskov@intel.com>

* [CPU] Make MVN behaviour deterministic

Signed-off-by: Alexander Peskov <alexander.peskov@intel.com>
2020-10-26 21:01:38 +03:00
Roman Donchenko ba3fc7fb8a
Fix spelling errors in the API and bindings (#2781) 2020-10-23 09:17:03 +03:00
Mateusz Bencer c0d71900fd
Provide ONNX external data mechanism to ReadNetwork (#2588)
* added unit test

* added python test

* using pword approach

* Added passing path to onnx reader

* support for wstring

* Added more tests

* Apply suggestions from code review

Co-authored-by: Michał Karzyński <4430709+postrational@users.noreply.github.com>

* fix build for Windows

* styles applied

* Fixed Windows tests

* styles applied

* fixed styles in tests

* review remarks

* cmake order

* Used target_compile_definitions instead of add_definitions

* Move ONNX_TEST_MODELS to other scope

Co-authored-by: Michał Karzyński <4430709+postrational@users.noreply.github.com>
2020-10-14 12:30:53 +03:00
Alexey Varyzgin 4c87427818
[CPU][BF16] bf16 for Gemm or MatMul was enabled (#1920) 2020-09-04 10:04:02 +03:00
Vladimir Paramuzov b976782c70
[IE CLDNN] Fallback to FP16 for non-quantized layers in quantized FP16+INT8 IR (#941) 2020-09-03 17:41:29 +03:00
Maksim Doronin 66aa119b11
[IE][VPU]: Refactor vpu configs (#1334)
* [IE][VPU]: Refactor vpu configs

* [IE][VPU][GT]: Refactor vpu configs usage in GT

* [IE][VPU]: Refactor vpu configs usage in myriad plugin

* [IE][VPU]: Refactor vpu configs usage in tests

* [IE][VPU]: Refactor vpu configs usage in deprecated_tests

* [IE][VPU]: Refactor vpu configs usage in tools

* [IE][VPU]: Use hddl metric vars instead of macros

* [IE][VPU]: style fixes

* [IE][VPU]: Replace MYRIAD_FORCE_RESET with MYRIAD_ENABLE_FORCE_RESET

* [IE][VPU]: Resolve confilcts with MYRIAD_TILING_CMX_LIMIT_KB

* [IE][VPU]: Remove MYRIAD_PLATFORM from tools

* [IE][VPU]: Fix DISABLE_REORDER config in StridedSlice

* [IE][VPU]: Redesign config headers hierarchy

* [IE][VPU]: Clarify comments related to vpu configs

* [IE][VPU]: Leave default values of deprecated configs

* [IE][VPU]: Revert beh tests on VPU_MYRIAD_PLATFORM

* [IE][VPU]: Revert beh tests with deprecated configs

* [IE][VPU]: Resolve conflicts

* [IE][VPU]: Revert opencv dependency
2020-08-17 17:30:38 +03:00
Ilya Lavrenov a4dcfed1a9
Simplified plugin interfaces (#1745)
* Simplified plugin interface

* Allow not implemented

* Fixes

* Fixed CPU plugin tests

* Fixed tests dependencies

* Fixes

* Fixed GPU plugin compilation

* Renamed plugin

* Fixes

* Removed tests for plugin base

* Fix2

* Fix 2

* Define a macro to define plugin creation function

* Clean-up

* Fixed OSX build

* Fixed CentOS

* Fixed exception catch / throw

* Fixed clang issue

* Fixed python tests on macOsx
2020-08-14 12:11:54 +03:00
Ilya Lavrenov f95f756929
Changed ICNNNetwork to CNNNetwork in QueryNetwork (#1704) 2020-08-10 18:24:54 +03:00
Ilya Lavrenov 8c118ef8b2
Moved caseless to Plugin API (#1664) 2020-08-07 06:24:28 +03:00
Ilya Lavrenov 6a5993fb36
Implement unicode conversion using Windows native functions (#1590)
* Implement unicode conversion using Windows native functions

* NOCPPLINT

* Fixed deprecated c++ api usage in tests

* Moved impl to cpp

* Moved Unicode utils to Plugin API

* Added missed include for Windows

* Fixes for unit tests; CentOS fixes

* Fixed Windows compilation

* Fixed unit tests on Unix

* Fixed unix 2
2020-08-06 12:01:34 +03:00
Ilya Lavrenov b9c3825897
Moved QueryNetworkResult to ie_common.h (#1648) 2020-08-06 06:17:29 +03:00
Ilya Lavrenov 0339fff3bc
[IE CLDNN] Add push / pop macro for OpenCL header (#1645) 2020-08-05 23:55:42 +03:00
Alexander Peskov f56cfd3c4b Fix missprint
Signed-off-by: Alexander Peskov <alexander.peskov@intel.com>
2020-08-05 17:01:35 +03:00
Ilya Lavrenov 9f767f7b93
Hide implementation of SharedObjectLoader to cpp files (#1556)
* Hide implementation of SharedObjectLoader to cpp files

* Fixed GPU tests compilation

* Fixes for Unix; check OpenCL headers with strict flags

* Fixed Windows

* More fixes for Windows

* Fixed Unit tests

* Enabled compilation with libVA for new GPU tests

* Fixes for case when libVA is not available

* Removed useless NOMINMAX

* Useless include

* Fix

* Fixes

* Fixes for Intel compiler

* Fix for Windows + Intel compiler

* Fixed samples compilation with Intel compiler
2020-08-03 14:01:56 +03:00
Ilya Lavrenov 17e457d7c8
Updated inference_engine.hpp (#1539) 2020-07-30 18:40:28 +03:00
Ilya Churaev 6c3b7ee8ca
Avoid redundant clone and reshape (#1376)
* Avoid redundant clone and reshape

* Removed some constructors

* Fixed output precision
2020-07-29 19:30:59 +03:00
Vladislav Vinogradov 0b1ef99fd7
[IE] Add Blob::createROI method (#882)
* Add default implementation that throws exception.
* Implement `createROI` for `TBlob` and existing compound blobs.
* Use reference couting for TBlob memory buffer to prolong its life time for ROI blobs.
* Add private extension for ND ROI and use it as implementation detail for now:
  * Add `DimSlice` and `TensorSlice` structures for generic ND ROI support.
  * Add `make_roi_desc` function to create `TensorDesc` for ROI.
2020-07-28 11:26:38 +03:00
Ilya Lavrenov 3be1f6b6fa
Removed NgraphData (#1416) 2020-07-28 05:58:52 +03:00
Ilya Lavrenov 8e081c8388
Removed CNNLayer entries from ie_common.h (#1420)
* Removed useless header include

* Removed CNNLayer entries from ie_common.h
2020-07-22 06:44:05 +03:00
Ilya Churaev 32d7959b92
Added U32 precision (#1297) 2020-07-14 10:27:10 +03:00
Ilya Lavrenov 4f0225014d
Deprecated cnn layer (#1138)
* Deprecated getInputTo, getCreatorLayer

* Fixes

* Fixed ie_layers moving to legacy

* Fixed onnx importer dependency

* Fixed python

* Fix python API compilation

* Added comments not to use _impl from Data

Co-authored-by: Nadezhda Ageeva <nadezhda.ageeva@intel.com>
2020-07-03 20:57:28 +03:00
Ilya Churaev ac2ce80dae
Updated Core::ReadNetwork documentation (#1178) 2020-07-03 08:47:24 +03:00
Ilya Lavrenov b43d26ab8a
Cnnnetwork add layer (#1124)
* Removed addLayer from public interface

* Convert to CNNNetworkImpl
2020-06-29 16:21:48 +03:00
Ilya Lavrenov 3a9db885bf
Removed getLayerByName from public API (#1110)
* Fixed tests

* Removed getLayerByName from public API
2020-06-25 20:00:39 +03:00
Ilya Lavrenov 377531002c
Removed suppression macro usage (#1108) 2020-06-24 18:40:06 +03:00
Ilya Lavrenov fe7f08ca56
Exec extensions (#963)
* Fixes

* Removed some tests for extensions

* Added const

* Removed unknown pragma
2020-06-24 15:12:14 +03:00
Ilya Lavrenov 447f69c84e
Moved deprecated network iterator to legacy (#913)
* Removed deprecated iterator API

* Applied comments
2020-06-24 11:55:17 +03:00
Ilya Lavrenov 94c8b9e5a7
Removed deprecated ICNNNetwork::getData (#1093) 2020-06-24 05:53:28 +03:00
Ilya Lavrenov a7579d5c35
Removed ICNNNetReader interface (#1042)
* Removed ICNNNetReader interface

* Fixed stress tests

* Fixed comments in VPU plugin

* Removed duplicated stress tests

* Fixed watchdog tests
2020-06-23 22:34:26 +03:00
Ilya Lavrenov 370f9e7fe1
Removed deprecated Data ctor (#1078) 2020-06-23 16:10:00 +03:00
Ilya Lavrenov 28bdcb374d
Cnnnetwork deprecated methods (#1077)
* Removed getName with char *

* Removed getPrecision from ICNNNetwork
2020-06-23 16:09:40 +03:00
Ilya Lavrenov 0b2827e027
Moved plugin to hidden folder (#999) 2020-06-19 21:04:12 +03:00
Ilya Lavrenov 79ff221957
Removed VPU option (#1027) 2020-06-19 20:55:53 +03:00
Ilya Lavrenov e8aed763d2
Removed Int8 normalizer and statistics (#919)
* Removed Int8 normalizer and statistics

* Removed statistics handling from tests utils

* Fixed tests compilation with statistics
2020-06-19 15:10:21 +03:00
Ilya Lavrenov bf3f799927
Removed shape infer extension (#917) 2020-06-19 14:48:26 +03:00
Ilya Lavrenov c02ed9e0a8
Pass SizeVector by const reference in ie_layout.hpp (#965) 2020-06-17 14:34:38 +03:00
Ilya Lavrenov 351a11b730
Removed deprecated error listener, getmappedtopology (#915) 2020-06-16 15:06:48 +03:00
Ilya Lavrenov 3a900d0080
Removed PluginDispatcher; IEPlugin from python API (#920) 2020-06-16 15:03:32 +03:00
Ilya Lavrenov 88e14c9dd6
Updated dates of removal for deprecated API (#912) 2020-06-15 12:27:20 +03:00
Nikita Kudriavtsev ac65ea30fd
[ICV] Watchdog switch + ddr initialization (#554)
* [IE Myriad] Added XLinkBootFirmware method in XLink API for booting firmware buffer

* [IE Myriad] Patch firmware in mvnc. Added test to check device reset without connecting.

* [IE Myriad] Added option MOVIDIUS_DDR_TYPE for Myriad plugin

* [IE Myriad] Added tests for new option MOVIDIUS_DDR_TYPE

* [IE Myriad] Update firmware 1201 -> 1212

* [IE Myriad] Convolution3x3 tests are disabled due to firmware issue. #-32921
2020-06-08 20:51:45 +03:00
Alexey Varyzgin 85aa23ec8a
[CPU][BF16] Default Optimisation Capability of BF16 was enabled on CPX (#647) 2020-06-04 16:06:15 +03:00