Commit Graph

37 Commits

Author SHA1 Message Date
Anton Pankratv 91dcb515a3
Simplified cancel behavior (#4224) 2021-02-09 12:55:24 +03:00
Anton Pankratv 945da5ff4f
Removed template from base (#4045)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-02-04 17:43:20 +03:00
Anton Pankratv 0a63b9214a
Used std::string as API paramters (#4050) 2021-02-03 19:21:39 +03:00
Ilya Lavrenov 5f982ca6ac
Removed obsolete ie_profiling.hpp (#4043) 2021-01-28 20:04:52 +03:00
Ilya Lavrenov 1044ed4352
Added export / import for Template and Hetero plugins (#3940)
* Added export / import for Template and Hetero plugins

* Added WA for Apple RTTI
2021-01-22 14:17:44 +03:00
Ilya Lavrenov 8685c20baf
Fixed HETERO + Template cases (#3580)
* Fixed tests compilation for Android ARM

* Small fixes

* Fixed issues CVS-44775, CVS-34206, CVS-34349

* Disabled KSO tests for Template

* Eliminated invalid subgraphs

* Enabled KSO QueryNetwork tests for Template

* Fixed other plugins as well

* Used NodeTypeInfo instead of std::string

Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
2020-12-16 12:17:29 +03:00
Dmitrii Ryzhkov 77ecd7e17c
Feature/drizshko/cancellable request (#2635)
Added Cancelability to an Infer Request class (actually implemented for the CPU only, with a stub for other devices)
2020-12-14 09:38:29 +03:00
Anton Potapov 2495eaf56f
[PP] Addded ability to preprocess inputs into plugin (#857)
desired format

changed InferRequestInternal:
 - added _deviceInputs member to store plugin desired perprocessing
   targets
 - added default argument to preProcessingRequired to describe plugin
   specific desired preprocessing target
 - SetBlob and GetBlob to deal with plugin desired preprocessing targets
   (_deviceInputs)
 - added addInputPreProcessingFor helper method to avoid code
   duplication

changed TEMPLATE plugin to use new functionality:
 - removed explicit presicion conversion (to use built-in one of
   InferRequestInternal)
 - _networkInputBlobs to use InferRequestInternal::_deviceInputs
2020-12-11 20:22:25 +03:00
Anton Potapov 8aabcde925
[PP] Altered preprocessing tests to use existin posprocessing as well (#3554)
changed PreprocessingPrecisionConvertTest:
 - to force output precision to be same as input (and not FP32 always)

changed TEMPLATE plugin to allow U8 outputs
2020-12-11 12:49:38 +03:00
Ilya Lavrenov e4260cdc3f
Template device testing (#3521)
* Added template plugin testing on public CI

* Updated tests config

* Added DEVICE_TEMPLATE constant to tests

* Updated tests

* Disable template plugin by default

* Fixes

* Fixed HETERO tests
2020-12-09 17:13:32 +03:00
Ilya Lavrenov 2d75d8aff2
Removed global using namespace from Plugin API (#3451) 2020-12-03 17:52:55 +03:00
Gleb Kazantaev 3862477ce8
Gkazanta/update doc master (#3413)
* Updated transformations docs

* Added RTTI to examples

* Fixed grammar mistakes

* Mention Sinks in NG docs
2020-11-30 15:13:01 +03:00
Ilya Lavrenov 6aa7c51de9
Removed ICNNNetwork from Plugin API (#3384)
* ICNNnetwork

* Removed ICNNNetwork from Plugin API
2020-11-27 16:30:02 +03:00
Roman Donchenko a428c469ce
Fix spelling errors in samples and documentation (#2795)
* Fix spelling errors in samples

* Fix spelling errors in the documentation
2020-11-11 15:35:39 +03:00
Ilya Lavrenov 5be7f32f95
Enable LTO only for Release (#2968) 2020-11-05 11:31:32 +03:00
Ilya Lavrenov 82d0aaf1dd
used native LTO support from cmake 3.9.6 (#2625)
* used native LTO support from cmake 3.9.6

* Removed compilation flags push / pop

* Fixes

* Fixes for VPU unit tests

* Temp WA for old gcc
2020-10-14 10:43:24 +03:00
Ilya Lavrenov 1e66624799
Plugin interface refactoring (#2591)
* Simplified plugin interface

* Allow not implemented

* Fixes

* Fixed CPU plugin tests

* Fixed tests dependencies

* Fixes

* Fixed GPU plugin compilation

* Renamed plugin

* Fixes

* Removed tests for plugin base

* Fix2

* Fix 2

* Define a macro to define plugin creation function

* Clean-up

* Fixed OSX build

* Fixed CentOS

* Removed statuscode from IExecutableNetworkInternal interface

* Interface

* Removed not used macro

* QueryNetwork returns result using return value

* LoadNetwork interface

* Fixed compilation with private plugins

* Fixed compilation when NGRAPH_INTERP is not enabled

* Return ExecutableNetwork from ImportNetwork with fileName

* Updated GetContext method

* Return exec graph information as return value

* Message about deprecation of Export with file name

* Message about deprecation of QueryState

* Updated ExecutableNetwork::GetConfig signature

* Updated ExecutableNetwork::GetMetric signature

* Updated docs

* WIP createIR

* Simplified IR creation

* CreateInferRequest returns value

* Removed GetExecutor from ExecutableNetworkThreadSafeDefault

* execDataPreprocessing is protected

* Fixed mock test
2020-10-13 17:22:51 +03:00
Gleb Kazantaev 30eeb1a5a0
Updated Transformation development doc (#2391) 2020-09-23 17:26:12 +03:00
Evgeny Talanin 83238b23db
Revert "Eliminated invalid subgraphs (#2196)" (#2250)
This reverts commit 89a6f926a4.
2020-09-15 19:24:57 +03:00
Anton Pankratv 89a6f926a4
Eliminated invalid subgraphs (#2196) 2020-09-15 14:03:24 +03:00
Ilya Lavrenov c7b3bd0195
Fixed compilation when NGRAPH_INTERP is not enabled (#1998) 2020-08-31 06:47:42 +03:00
Anton Pankratv 7c1b87c7aa
Query network should return all supported layers (#1845)
* Query network should return all supported layers

* Added other plugins. Fixed hetero and multi

* IRv7 test use legacy impl
2020-08-26 15:33:37 +03:00
Ilya Lavrenov 5d328b94a6
Reuse make_executable_network in ImportNetwork (#1869)
* Reuse make_executable_network for ImportNetwork

* make_executable_network returns ExecutableNetwork cpp wrapper
2020-08-20 18:34:19 +03:00
Ilya Lavrenov a4dcfed1a9
Simplified plugin interfaces (#1745)
* Simplified plugin interface

* Allow not implemented

* Fixes

* Fixed CPU plugin tests

* Fixed tests dependencies

* Fixes

* Fixed GPU plugin compilation

* Renamed plugin

* Fixes

* Removed tests for plugin base

* Fix2

* Fix 2

* Define a macro to define plugin creation function

* Clean-up

* Fixed OSX build

* Fixed CentOS

* Fixed exception catch / throw

* Fixed clang issue

* Fixed python tests on macOsx
2020-08-14 12:11:54 +03:00
Ilya Lavrenov 2b81b947dc
Define a macro to define plugin creation function (#1727) 2020-08-12 12:00:30 +03:00
Ilya Churaev d791d295aa
Use clone_function instead of specialize_function (#1523)
* Try to use clone_function instead of specialize_function

* Try to fix stress tests

* Remove redundant specialize_function

* Fixed TI clone

* Removed redundant code

* Uncomment threading tests

* Fixed docs

* copy function friendly name too

* Fixed copy rt_info

* Fixed comments
2020-08-03 18:23:02 +03:00
Vladislav Volkov d946f6cfde
Common library to trace using Intel ITT and new performance counters (#1479) 2020-08-03 12:53:00 +03:00
Ilya Lavrenov 77345a7383
Template documentation update (#1519)
* Updated Inference Engine Plugin developer guide
after inference using ngraph reference backend is added

* Documentation fixes

* Fixed review comments
2020-07-29 19:56:24 +03:00
Anton Pankratv 18836f53cd
Implemented inference in template plugin (#1308)
* Implemented inference in template plugin

* Fixed tests

* Removed thirdparty dependency

* Simplified executor configuration

* removed half

* Fixed cmake

* Fixed ngraph node check

* device blob allocation

* Fixed enum error
2020-07-28 17:25:31 +03:00
Ilya Lavrenov a19a8645e8
Removed IInferencePluginAPI interface (#1497)
* Removed legacy library includes from plugin api headers

* Removed IInferencePluginAPI interface; merged with IInferencePlugin

* Removed pluginAPIInterface usage in Core implementation
2020-07-28 11:08:45 +03:00
Gleb Kazantaev bd42f09e98
nGraph Transformations refactoring (#931)
This PR introduces next changes:
1. Transformations *_tbl.hpp files were replaced with direct registration in cpp files.
2. Plugins use pass::Manager to call conversion passes.
3. Transformations callback was moved to PassBase class as there is no more need to keep it in separate class
4. All pattern based transformations must be inherited from MatcherPass class. GraphRewrite class will be used only for matchers registration and execution on function.
MatcherPass class adds new features to pattern-based transformations approach:
* Allows to run matcher pass on a single node.
* Operations that were created inside transformation callback can be added to execution list to be available for pattern matching within single GraphRewrite.
5. GraphRewrite MatchClosure was replaced with MatcherPass. So all matchers will be registered as a MatcherPass.
6. Added pass::Manager::clear_state() method to avoid dependency with nodes that no longer belongs to function after replacement.
7.  Some representative transformations were updated to use MatcherPass as an example.
8.  Mul->Add sequence fusion transformation was replaced with LinOpSequenceFusion.
9. Pattern and callback registration code was moved to class c-tors (will be finished for remaining passes in other PR) .
10. Updated pass::Manager to get pass names only when NGRAPH_PROFILE_PASS_ENABLE enabled.
11. Moving towards removing PassProperty.
12. Added ngraph::pattern::wrap_type<T>(inputs, pred) to simplify pattern creation.
13. GraphRewrite was updated to execute MatcherPass more efficient.
2020-07-27 19:47:37 +03:00
Ilya Lavrenov 07bedc5d6f
Network serializer for v7 is removed (#1414)
* Network serializer for v7 is removed

* Fixed compilation

* Fixed Windows build

* WA for GPU

* Create function 2 times

* Fixed compilation

* Added return
2020-07-23 16:23:19 +03:00
Ilya Lavrenov 9440561fa4
Documentation updates (#1433) 2020-07-23 13:15:20 +03:00
Ilya Churaev 5feeab37d4
Use ngraph.hpp in samples and documentation (#1240) 2020-07-09 06:09:28 +03:00
Gleb Kazantaev b8b8a21dc7
Added nGraph transformations developer guide (#947)
* Added nGraph transformations developer guide

* Added some more chapters

* Added Transformation writing essentials chapter

* Added working with ngraph::Function chapter

* Added two chapters

* Fix comments

* Moved code snippets to source files

* Moved ngraph test utils to common. Added transformations test examples to template plugin

* Added Common mistake section

* Added doxygen for CommoOptimization passes

* Fixed doxygen comments; added links in md files; fixed typos

* Fixed review comments
2020-06-30 18:02:26 +03:00
Ilya Lavrenov 0b2827e027
Moved plugin to hidden folder (#999) 2020-06-19 21:04:12 +03:00
Alexey Suhov 0064c299c3
add plugin template (#515) 2020-05-22 22:34:00 +03:00