Commit Graph

35 Commits

Author SHA1 Message Date
Vladislav Volkov a365ee768b
Fix for leaked ExecutorManager (#10070)
* Fix for leaked ExecutorManager

* Code style fix

* Fixed plugin pointer access from ExecutableNetwork
2022-02-05 14:03:50 +03:00
Ilya Churaev 03c38ca3fd
Changed code which check newAPI flag from Core (#10080)
* Changed code which check newAPI flag from Core

* Fixed typo
2022-02-03 10:36:23 +03:00
Katarzyna Mitrus e3ec1ac9b3
Allow duplicated outputs in ie_plugin_internal (#9882)
* Avoid duplicated outputs with the same name

* Revert onnx graph changes

* Allow output duplicates in ie_plugin_internal check

* Add test with onnx model

* Check get_tensor_ptr instead of any_name

* More outputs test

* Refactor to use std::transform

* test manifest update

* Remove redundant header

* INTERPRETER segfaults fix for duplicated output names

* Simplify duplication assert

* Update test names

* Test update
2022-01-29 02:58:09 +03:00
Alexey Suhov a79830cb55
Update year to 2022 in copyright notice (#9755) 2022-01-19 01:07:49 +03:00
Ilya Churaev ec6f57872f
Renamed ov::Function to ov::Model (#9051)
* Renamed ov::Function to ov::Model

* Fixed all for macos

* Fixed build

* Fixed build

* Revert changes in GPU plugin

* Fixed ngraphFunctions

* Fixed all for mac

* Fixed new test

* Fixed if for Windows

* Fixed unit tests and renamed Function in python API

* Fixed code style

* Fixed import

* Fixed conflict

* Fixed merge issues
2021-12-10 13:08:38 +03:00
Ilya Lavrenov e57a455b92
Added support of external modules in static build (#8518)
* Added support of external modules in static build

* Enable template plugin static run; disabled CPU tests run in dynamic build

* Make FEM library dynamic

* Fixed static build

* clang-format

* Fixed targets

* Python tests fix

* Fixed python API tests skip

* Fixed pattern

* Fixed pattern 2

* Don't run template plugin tests in static build
2021-11-12 08:56:57 +03:00
Ilya Churaev 0f3c10c810
Infer request api (#7962)
* Introduce new API

* Fixed comments

* Fixed code style

* Introduce some new API

* Fixed code style

* Reverted names

* Exend OVExecNetwork tests

* Changed executable network API

* Fixed tests

* Fixed comments

* Fixed style

* More tests

* Applied changes

* Fixed windows build

* Fixed typo

* Fixed some tests

* Fixed code style

* Fixed pre-proc tests

* Fixed documentation comments

* Added more comments

* Fixed code style

* Remove friend

* Removed find tensor API from internal classes

* Avoid old API in new constructors

* Fixed CPU tests

* Fixed comments

* Fixed template tests

* Extended test cases

* Revert data creation

* Fixed GNA and GPU plugins

* Fixed comments

* Fixed GNA tests

* Try to fix tests for GPU

* Fixed GNA tests

* Fixed GNA

* Try to fix Myriad tests

* Removed check to see an exception message

* Fixed HETERO import

* Reverted mkl-dnn submodule

* Fixed clang-format

Co-authored-by: y <ilya.lavrenov@intel.com>
2021-10-20 22:08:55 +03:00
Eugeny Volosenkov 3e48008c3f
Unroll If in ngraph (#7403)
* added unroll_if

* Fix interface function

* Fix code style

* add false test for unroll if

* add if transformation in subgraphs

* fix code style

* fix transformations

* delete internal transformations

* Fix comments

* fix to replace_node

* fix description fo transformation

* fix CompileNetwork

* fix comments

* fix comments

* add function get_ie_output_name(input);

* fix code style

* disable cpu test
2021-10-15 12:37:43 +03:00
Ilya Churaev 82f8f19d11
Moved serialization pass to public (#7862)
* Moved serialization pass to public

* Fixed unit tests

* Fixed code style

* Fixed tests

* Fix link

* Fix kmb

* Fixed build

* Removed InferenceEngine::Core from ngraph tests

* Add missed models

* Restore IR weights

* Fixed code style
2021-10-13 11:17:53 +03:00
Ilya Churaev c323775f2c
Add input/output to ov ExecNetwork (#7650)
* Added template for new tests

* Fixed simple test

* Added output tests

* Removed get_result/get_parameter methods

* Fixed documentation

* Fixed functional tests

* Fixed caching tests

* Added new test for import

* Added new tests

* Fixed code style

* Fixed comments

* Fixed tests

* Fixed code style

* Save version in the function
Fixed pre-post processing

* Change IR version

* Fixed documentation

* Fixed MockICore

* HETERO almost works

* Fixed tests and core logic

* Disabled some CPU tests

* Tmp disable fp16 for template

* Fixed tests and clang-format

* Small fixes

* Fix

* Simplified code in templatePlugin

* Added IE precisions checks

* Simplified hetero plugin

* Added ieImportExportedFunction test

* Added MYRIAD test

* Skip tests directly in tests

* More correct filter for CPU

* Fixed CPU tests

* Template plugin tests

* Some comments

* FIxed clanf-format

* Removed myriad tests

* Fixed comment

* small changes

* Fixed condition

* Fixed unit tests

* clang-format

* Comment

* Hetero plugin update

* Fixed tests

* Moved re-create under ig

* Fixed clang-format

* Fixed some caching_tests

* Disable some caching_tests

* Fixed setLayout with dynamic case

* Fixed clang-format

* Disable execution graph

* Disabled one more CPU test

* Simplified regex

* Disabled GNA tests

Co-authored-by: y <ilya.lavrenov@intel.com>
2021-10-12 13:11:25 +03:00
Ilya Churaev 3859990b1b
Introduce IR v11 (#7787)
* Enabled support of IR v11 in IR frontend

* Enabled serialization to v11

* Added indexes for Inputs/Outputs

* Fixed typo

* Fixed code style

* Fixed deserialization tests

* FIxed typo

* Avoid changes in the original serialized function

* Fixed TI tests

* Removed version from the function and indexes from parameters/results

* Restore function version

* Clone function rt info

* Removed v11 version
2021-10-05 13:09:59 +03:00
Ilya Churaev ff500b0bed
Fixed documentation code style (#7008) 2021-08-11 09:38:43 +03:00
Ilya Lavrenov 6e2d13937a
ImportNetwork with explicit device name only (#5689)
* Import with explicit name

* Fixed LoadHetero_MultiArchs tests

* Fixed MYRIAD tests on Windows

* Fixed compilation in tests

* Updated tesets

* Fixed test

* Removed useless lines

* Removed custom VPU tests, replaced with common ones

* Fixed Windows

* Reverted SKIP_IF_NOT_IMPLEMENTED macro
2021-06-09 10:09:25 +03:00
Anton Pankratv d899606493
Merged plugin and exec network internal implementation (#4923)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-05-27 13:33:09 +03:00
Ilya Churaev cc810297f4
Align style doc with samples (#5709)
* Added clang-format config

* Fixed style

* Fixed code-style for snippets and fixed build

* Disable clang-format for snippets

* Fixed comments
2021-05-25 10:32:48 +03:00
Ilya Lavrenov 8b1b900591
CVS-44774: Fixed preprocessing for template plugin (#4118)
* Fixed preprocessing for template plugin

* Added more tests instances

* Split common transformation to smaller ones which can be used by plugins

* Moved preprocessing transformation to Plugin API

* Added PreprocessConversionTest tests

* Disabled tests on GPU: CVS-51764

* Disabled some tests on VPU and TEMPLATE

* Support for input layout conversions in TEMPLATE plugin

* Improvements in Template Plugin

* Fixed compilation

* Fixes

* Disables some tests

* Fixed compilation on Windows

* Fixed docs
2021-04-30 10:47:29 +03:00
Ilya Lavrenov 02bc98a03f
Removed suppressions for IInferRequest deprecation (#5310)
* Removed suppressions for IInferRequest deprecation

* Fixed Windows

* More fixes for Windows

* Fixed compilation on Windows

* Fixed comment in documentatipn

* Fixes for Andorid

* Fixes for old gcc 4.8

* WA for cross-compilations

* Fixed compilation

* Fixed HETERO plugin compilation for old compilers

* Flags

Co-authored-by: lab_ddpqa <lab_ddpqa@intel.com>
2021-04-21 16:05:30 +03:00
Anton Pankratv 46987def54
Merged internal Infer Request implementation (#5125) 2021-04-19 15:16:47 +03:00
Alexey Suhov a748c26fee
Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Anton Pankratv 3b3d9a0989
Used IE_THROW macro (#4869)
* Added ie throw macro

* Used IE_THROW macro
2021-03-23 18:57:12 +03:00
Anton Pankratv a2b8b974b8
Simplified IE Exceptions Implementation (#4258) 2021-03-18 16:30:16 +03:00
Anton Pankratv 2fcf92be42
Removed IRelease Interface (#4032) 2021-03-05 12:08:01 +03:00
Anton Pankratv 945da5ff4f
Removed template from base (#4045)
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-02-04 17:43:20 +03:00
Ilya Lavrenov 5f982ca6ac
Removed obsolete ie_profiling.hpp (#4043) 2021-01-28 20:04:52 +03:00
Ilya Lavrenov 1044ed4352
Added export / import for Template and Hetero plugins (#3940)
* Added export / import for Template and Hetero plugins

* Added WA for Apple RTTI
2021-01-22 14:17:44 +03:00
Ilya Lavrenov 2d75d8aff2
Removed global using namespace from Plugin API (#3451) 2020-12-03 17:52:55 +03:00
Roman Donchenko a428c469ce
Fix spelling errors in samples and documentation (#2795)
* Fix spelling errors in samples

* Fix spelling errors in the documentation
2020-11-11 15:35:39 +03:00
Ilya Lavrenov 1e66624799
Plugin interface refactoring (#2591)
* Simplified plugin interface

* Allow not implemented

* Fixes

* Fixed CPU plugin tests

* Fixed tests dependencies

* Fixes

* Fixed GPU plugin compilation

* Renamed plugin

* Fixes

* Removed tests for plugin base

* Fix2

* Fix 2

* Define a macro to define plugin creation function

* Clean-up

* Fixed OSX build

* Fixed CentOS

* Removed statuscode from IExecutableNetworkInternal interface

* Interface

* Removed not used macro

* QueryNetwork returns result using return value

* LoadNetwork interface

* Fixed compilation with private plugins

* Fixed compilation when NGRAPH_INTERP is not enabled

* Return ExecutableNetwork from ImportNetwork with fileName

* Updated GetContext method

* Return exec graph information as return value

* Message about deprecation of Export with file name

* Message about deprecation of QueryState

* Updated ExecutableNetwork::GetConfig signature

* Updated ExecutableNetwork::GetMetric signature

* Updated docs

* WIP createIR

* Simplified IR creation

* CreateInferRequest returns value

* Removed GetExecutor from ExecutableNetworkThreadSafeDefault

* execDataPreprocessing is protected

* Fixed mock test
2020-10-13 17:22:51 +03:00
Ilya Lavrenov 77345a7383
Template documentation update (#1519)
* Updated Inference Engine Plugin developer guide
after inference using ngraph reference backend is added

* Documentation fixes

* Fixed review comments
2020-07-29 19:56:24 +03:00
Anton Pankratv 18836f53cd
Implemented inference in template plugin (#1308)
* Implemented inference in template plugin

* Fixed tests

* Removed thirdparty dependency

* Simplified executor configuration

* removed half

* Fixed cmake

* Fixed ngraph node check

* device blob allocation

* Fixed enum error
2020-07-28 17:25:31 +03:00
Gleb Kazantaev bd42f09e98
nGraph Transformations refactoring (#931)
This PR introduces next changes:
1. Transformations *_tbl.hpp files were replaced with direct registration in cpp files.
2. Plugins use pass::Manager to call conversion passes.
3. Transformations callback was moved to PassBase class as there is no more need to keep it in separate class
4. All pattern based transformations must be inherited from MatcherPass class. GraphRewrite class will be used only for matchers registration and execution on function.
MatcherPass class adds new features to pattern-based transformations approach:
* Allows to run matcher pass on a single node.
* Operations that were created inside transformation callback can be added to execution list to be available for pattern matching within single GraphRewrite.
5. GraphRewrite MatchClosure was replaced with MatcherPass. So all matchers will be registered as a MatcherPass.
6. Added pass::Manager::clear_state() method to avoid dependency with nodes that no longer belongs to function after replacement.
7.  Some representative transformations were updated to use MatcherPass as an example.
8.  Mul->Add sequence fusion transformation was replaced with LinOpSequenceFusion.
9. Pattern and callback registration code was moved to class c-tors (will be finished for remaining passes in other PR) .
10. Updated pass::Manager to get pass names only when NGRAPH_PROFILE_PASS_ENABLE enabled.
11. Moving towards removing PassProperty.
12. Added ngraph::pattern::wrap_type<T>(inputs, pred) to simplify pattern creation.
13. GraphRewrite was updated to execute MatcherPass more efficient.
2020-07-27 19:47:37 +03:00
Ilya Lavrenov 07bedc5d6f
Network serializer for v7 is removed (#1414)
* Network serializer for v7 is removed

* Fixed compilation

* Fixed Windows build

* WA for GPU

* Create function 2 times

* Fixed compilation

* Added return
2020-07-23 16:23:19 +03:00
Ilya Churaev 5feeab37d4
Use ngraph.hpp in samples and documentation (#1240) 2020-07-09 06:09:28 +03:00
Gleb Kazantaev b8b8a21dc7
Added nGraph transformations developer guide (#947)
* Added nGraph transformations developer guide

* Added some more chapters

* Added Transformation writing essentials chapter

* Added working with ngraph::Function chapter

* Added two chapters

* Fix comments

* Moved code snippets to source files

* Moved ngraph test utils to common. Added transformations test examples to template plugin

* Added Common mistake section

* Added doxygen for CommoOptimization passes

* Fixed doxygen comments; added links in md files; fixed typos

* Fixed review comments
2020-06-30 18:02:26 +03:00
Alexey Suhov 0064c299c3
add plugin template (#515) 2020-05-22 22:34:00 +03:00