Commit Graph

35 Commits

Author SHA1 Message Date
Ilya Churaev ff500b0bed
Fixed documentation code style (#7008) 2021-08-11 09:38:43 +03:00
Ilya Churaev 811f4c5ae9
Template reference tests (#6456)
* Added convert tests

* Moved convert tests to template plugin

* Fixed build

* Fixed comments

* Fixed templateFuncTests

* Fixed review comments

* Added dynamic registration of template plugin

* Fixed functional tests

* Fixed behavior tests

* Added ticket

* Try to avoid fails
2021-07-12 14:24:36 +03:00
Ilya Lavrenov 6e2d13937a
ImportNetwork with explicit device name only (#5689)
* Import with explicit name

* Fixed LoadHetero_MultiArchs tests

* Fixed MYRIAD tests on Windows

* Fixed compilation in tests

* Updated tesets

* Fixed test

* Removed useless lines

* Removed custom VPU tests, replaced with common ones

* Fixed Windows

* Reverted SKIP_IF_NOT_IMPLEMENTED macro
2021-06-09 10:09:25 +03:00
Ilya Lavrenov eff9f00320
Refactored ie_plugin_config.hpp (#5899) 2021-06-01 16:31:29 +03:00
Anton Pankratv d899606493
Merged plugin and exec network internal implementation (#4923)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-05-27 13:33:09 +03:00
Ilya Churaev cc810297f4
Align style doc with samples (#5709)
* Added clang-format config

* Fixed style

* Fixed code-style for snippets and fixed build

* Disable clang-format for snippets

* Fixed comments
2021-05-25 10:32:48 +03:00
Vladislav Volkov d2c9bddff1
Convert operation optimization for FP16 -> INT8 and FP32 -> INT8 (#5275)
Improvements for ConvertPrecision transformation pass
2021-05-14 13:48:02 +03:00
Ilya Lavrenov 8b1b900591
CVS-44774: Fixed preprocessing for template plugin (#4118)
* Fixed preprocessing for template plugin

* Added more tests instances

* Split common transformation to smaller ones which can be used by plugins

* Moved preprocessing transformation to Plugin API

* Added PreprocessConversionTest tests

* Disabled tests on GPU: CVS-51764

* Disabled some tests on VPU and TEMPLATE

* Support for input layout conversions in TEMPLATE plugin

* Improvements in Template Plugin

* Fixed compilation

* Fixes

* Disables some tests

* Fixed compilation on Windows

* Fixed docs
2021-04-30 10:47:29 +03:00
Ilya Lavrenov 6c83e0f8a5
Small refactoring in TEMPLATE plugin (#5398)
* Small refactoring in TEMPLATE plugin

* Fixed compilation on Windows

* Fixed code style
2021-04-27 18:52:45 +03:00
Anton Pankratv 46987def54
Merged internal Infer Request implementation (#5125) 2021-04-19 15:16:47 +03:00
Anton Pankratv b20d9b725c
Used internal exec network impl (#4922) 2021-04-08 12:29:41 +03:00
Ilya Lavrenov 8e261de0a8
Added PreprocessConversionTest tests (#4946)
* Added PreprocessConversionTest tests

* Disabled tests on GPU: CVS-51764

* Disabled some tests on VPU and TEMPLATE

* Support for input layout conversions in TEMPLATE plugin
2021-03-25 16:31:33 +03:00
Alexey Suhov a748c26fee
Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Anton Pankratv 3b3d9a0989
Used IE_THROW macro (#4869)
* Added ie throw macro

* Used IE_THROW macro
2021-03-23 18:57:12 +03:00
Anton Pankratv a2b8b974b8
Simplified IE Exceptions Implementation (#4258) 2021-03-18 16:30:16 +03:00
Mikhail Nosov 4c5d9c2a1b
[Template]: Metrics IMPORT_EXPORT_SUPPORT and DEVICE_ARCHITECTURE (#4818)
Test:
Use benchmark_app from this PR #4814

Run ./benchmark_app -h
Verify that template plugin is listed in supported caching devices

Run ./benchmark_app -m <model.onnx> -d TEMPLATE -i <file> -cache tmpCache
Verify that tmpCache is created and network is exported to blob
Verify that if model is ONNX (e.g. ResNet50) - that loading of network is performed faster when cache is available

Run several times: ./benchmark_app -m <model.onnx> -d TEMPLATE -i <file> -cache tmpCache -single_load
Verify that if model is ONNX (e.g. ResNet50) - that loading of network is performed faster when cache is available
Verify that in this mode loading of network is faster than without "-single_load" option
2021-03-17 12:15:53 +03:00
Ilya Lavrenov 5f982ca6ac
Removed obsolete ie_profiling.hpp (#4043) 2021-01-28 20:04:52 +03:00
Ilya Lavrenov 1044ed4352
Added export / import for Template and Hetero plugins (#3940)
* Added export / import for Template and Hetero plugins

* Added WA for Apple RTTI
2021-01-22 14:17:44 +03:00
Ilya Lavrenov 8685c20baf
Fixed HETERO + Template cases (#3580)
* Fixed tests compilation for Android ARM

* Small fixes

* Fixed issues CVS-44775, CVS-34206, CVS-34349

* Disabled KSO tests for Template

* Eliminated invalid subgraphs

* Enabled KSO QueryNetwork tests for Template

* Fixed other plugins as well

* Used NodeTypeInfo instead of std::string

Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
2020-12-16 12:17:29 +03:00
Anton Potapov 8aabcde925
[PP] Altered preprocessing tests to use existin posprocessing as well (#3554)
changed PreprocessingPrecisionConvertTest:
 - to force output precision to be same as input (and not FP32 always)

changed TEMPLATE plugin to allow U8 outputs
2020-12-11 12:49:38 +03:00
Ilya Lavrenov 2d75d8aff2
Removed global using namespace from Plugin API (#3451) 2020-12-03 17:52:55 +03:00
Ilya Lavrenov 6aa7c51de9
Removed ICNNNetwork from Plugin API (#3384)
* ICNNnetwork

* Removed ICNNNetwork from Plugin API
2020-11-27 16:30:02 +03:00
Ilya Lavrenov 1e66624799
Plugin interface refactoring (#2591)
* Simplified plugin interface

* Allow not implemented

* Fixes

* Fixed CPU plugin tests

* Fixed tests dependencies

* Fixes

* Fixed GPU plugin compilation

* Renamed plugin

* Fixes

* Removed tests for plugin base

* Fix2

* Fix 2

* Define a macro to define plugin creation function

* Clean-up

* Fixed OSX build

* Fixed CentOS

* Removed statuscode from IExecutableNetworkInternal interface

* Interface

* Removed not used macro

* QueryNetwork returns result using return value

* LoadNetwork interface

* Fixed compilation with private plugins

* Fixed compilation when NGRAPH_INTERP is not enabled

* Return ExecutableNetwork from ImportNetwork with fileName

* Updated GetContext method

* Return exec graph information as return value

* Message about deprecation of Export with file name

* Message about deprecation of QueryState

* Updated ExecutableNetwork::GetConfig signature

* Updated ExecutableNetwork::GetMetric signature

* Updated docs

* WIP createIR

* Simplified IR creation

* CreateInferRequest returns value

* Removed GetExecutor from ExecutableNetworkThreadSafeDefault

* execDataPreprocessing is protected

* Fixed mock test
2020-10-13 17:22:51 +03:00
Evgeny Talanin 83238b23db
Revert "Eliminated invalid subgraphs (#2196)" (#2250)
This reverts commit 89a6f926a4.
2020-09-15 19:24:57 +03:00
Anton Pankratv 89a6f926a4
Eliminated invalid subgraphs (#2196) 2020-09-15 14:03:24 +03:00
Anton Pankratv 7c1b87c7aa
Query network should return all supported layers (#1845)
* Query network should return all supported layers

* Added other plugins. Fixed hetero and multi

* IRv7 test use legacy impl
2020-08-26 15:33:37 +03:00
Ilya Lavrenov 5d328b94a6
Reuse make_executable_network in ImportNetwork (#1869)
* Reuse make_executable_network for ImportNetwork

* make_executable_network returns ExecutableNetwork cpp wrapper
2020-08-20 18:34:19 +03:00
Ilya Lavrenov a4dcfed1a9
Simplified plugin interfaces (#1745)
* Simplified plugin interface

* Allow not implemented

* Fixes

* Fixed CPU plugin tests

* Fixed tests dependencies

* Fixes

* Fixed GPU plugin compilation

* Renamed plugin

* Fixes

* Removed tests for plugin base

* Fix2

* Fix 2

* Define a macro to define plugin creation function

* Clean-up

* Fixed OSX build

* Fixed CentOS

* Fixed exception catch / throw

* Fixed clang issue

* Fixed python tests on macOsx
2020-08-14 12:11:54 +03:00
Ilya Lavrenov 2b81b947dc
Define a macro to define plugin creation function (#1727) 2020-08-12 12:00:30 +03:00
Ilya Churaev d791d295aa
Use clone_function instead of specialize_function (#1523)
* Try to use clone_function instead of specialize_function

* Try to fix stress tests

* Remove redundant specialize_function

* Fixed TI clone

* Removed redundant code

* Uncomment threading tests

* Fixed docs

* copy function friendly name too

* Fixed copy rt_info

* Fixed comments
2020-08-03 18:23:02 +03:00
Ilya Lavrenov 77345a7383
Template documentation update (#1519)
* Updated Inference Engine Plugin developer guide
after inference using ngraph reference backend is added

* Documentation fixes

* Fixed review comments
2020-07-29 19:56:24 +03:00
Anton Pankratv 18836f53cd
Implemented inference in template plugin (#1308)
* Implemented inference in template plugin

* Fixed tests

* Removed thirdparty dependency

* Simplified executor configuration

* removed half

* Fixed cmake

* Fixed ngraph node check

* device blob allocation

* Fixed enum error
2020-07-28 17:25:31 +03:00
Ilya Lavrenov a19a8645e8
Removed IInferencePluginAPI interface (#1497)
* Removed legacy library includes from plugin api headers

* Removed IInferencePluginAPI interface; merged with IInferencePlugin

* Removed pluginAPIInterface usage in Core implementation
2020-07-28 11:08:45 +03:00
Ilya Lavrenov 9440561fa4
Documentation updates (#1433) 2020-07-23 13:15:20 +03:00
Alexey Suhov 0064c299c3
add plugin template (#515) 2020-05-22 22:34:00 +03:00