Commit Graph

161 Commits

Author SHA1 Message Date
Ilya Lavrenov 4ad20fb53f
Use system dependencies (#11419)
* Try to improve gflags

* Try to improve gflags: part 2

* Tried to use dependencies on system

* Use nlohmann_jsonConfig from system

* Enabled nlohmann_json from system

* Improvements

* handle system gflags in developer package

* Simplifications

* Simplify dependency management

* Corrected package names

* Fixed subgraphsDumper configure stage

* Try to fix rhel8

* Try to fix macosx

* Fixed VPUX build

* Fixed aliasing issues

* Suppress some wanrings

* export gflags when build it

* Fixed some LTO

* Try to fix Mac

* revert

* use gflags as private dependency

* Aligned targets in developer package

* Fixed frontends tests build on U20 with LTO

* PAssed

* Don't use pkg_search_module(zlib ..) during cross-compilation

* Removed unused variables

* Fixed finding of zlib during cross-compilation
2022-04-05 04:47:22 +03:00
Ilya Lavrenov 4fcc18c00e
Tbb 2018 and older usage (#11411)
* fixed TBB

* Fixed compilation with old TBBs

* Fixed installation for custom provided TBB
2022-04-02 11:11:13 +03:00
Ilya Lavrenov 3c724a1dee
Build with system TBB (#11244)
* Build with system TBB

* Fixes

* Check whether system TBB is available

* Try to fix ONNX Runtime build with system TBB

* Test

* Fixed compilation of threading.cpp

* Fixed unset of cache dirs

* Limit dearch paths of TBB

* Try to enable pip packages with custom TBB

* Fix for TBB 2021.2

* Install only needed TBB libraries

* Install TBB from system to pip package

* Reverted usage of TBBROOT

* Fixed oneTBB case

* Try to fix Android

* Escape some paths

* Added samples path

* Fixed TBBBind usage for case of system TBB
2022-03-31 18:05:59 +03:00
Ilya Lavrenov 19d0e5ba52
CMAKE: IE_VERSION => OpenVINO_VERSION (#11242)
* IE_VERSION => OpenVINO_VERSION

* Reverted installation of python unconditionally
2022-03-28 19:32:21 +03:00
Ilya Churaev 4dc0d6e711
Fixed comments after #11155 (#11202)
* Fixed comments after #11155

* Add information about plugin option
2022-03-25 16:02:18 +03:00
Ilya Lavrenov a883dc0b85
DOCS: ported changes from 2022.1 release branch (#11206)
* Extensibility guide with FE extensions and remove OV_FRAMEWORK_MAP from docs

* Rework of Extensibility Intro, adopted examples to missing OPENVINO_FRAMEWORK_MAP

* Removed OPENVINO_FRAMEWORK_MAP reference

* Frontend extension detailed documentation

* Fixed distributed snippets

* Fixed snippet inclusion in FE extension document and chapter headers

* Fixed wrong name in a snippet reference

* Fixed test for template extension due to changed number of loaded extensions

* Update docs/Extensibility_UG/frontend_extensions.md

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>

* Minor fixes in extension snippets

* Small grammar fix

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>

Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>

* DOCS: transition banner (#10973)

* transition banner

* minor fix

* update transition banner

* updates

* update custom.js

* updates

* updates

* Documentation fixes (#11044)

* Benchmark app usage

* Fixed link to the devices

* More fixes

* Update docs/OV_Runtime_UG/multi_device.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Removed several hardcoded links

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Updated documentation for compile_tool (#11049)

* Added deployment guide (#11060)

* Added deployment guide

* Added local distribution

* Updates

* Fixed more indentations

* Removed obsolete code snippets (#11061)

* Removed obsolete code snippets

* NCC style

* Fixed NCC for BA

* Add a troubleshooting issue for PRC installation (#11074)

* updates

* adding gna to linux

* add missing reference

* update

* Update docs/install_guides/installing-model-dev-tools.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Update docs/install_guides/installing-model-dev-tools.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Update docs/install_guides/installing-model-dev-tools.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Update docs/install_guides/installing-model-dev-tools.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* Update docs/install_guides/installing-model-dev-tools.md

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* update

* minor updates

* add gna item to yum and apt

* add gna to get started page

* update reference formatting

* merge commit

* add a troubleshooting issue

* update

* update

* fix CVS-71846

Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>

* DOCS: fixed hardcoded links  (#11100)

* Fixes

* Use links

* applying reviewers comments to the Opt Guide (#11093)

* applying reviewrs comments

* fixed refs, more structuring (bold, bullets, etc)

* refactoring tput/latency sections

* next iteration (mostly latency), also brushed the auto-batching and other sections

* updates sync/async images

* common opts brushed

* WIP tput redesigned

* minor brushing of common and auto-batching

* Tput fully refactored

* fixed doc name in the link

* moved int8 perf counters to the right section

* fixed links

* fixed broken quotes

* fixed more links

* add ref to the internals to the TOC

* Added a note on the batch size

Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>

* [80085] New images for docs (#11114)

* change doc structure

* fix manager tools

* fix manager tools 3 step

* fix manager tools 3 step

* new img

* new img for OV Runtime

* fix steps

* steps

* fix intendents

* change list

* fix space

* fix space

* code snippets fix

* change display

* Benchmarks 2022 1 (#11130)

* Minor fixes

* Updates for 2022.1

* Edits according to the review

* Edits according to review comments

* Edits according to review comments

* Edits according to review comments

* Fixed table

* Edits according to review comments

* Removed config for Intel® Core™ i7-11850HE

* Removed forward-tacotron-duration-prediction-241 graph

* Added resnet-18-pytorch

* Add info about Docker images in Deployment guide (#11136)

* Renamed user guides (#11137)

* fix screenshot (#11140)

* More conservative recommendations on dynamic shapes usage in docs (#11161)

* More conservative recommendations about using dynamic shapes

* Duplicated statement from C++ part to Python part of reshape doc (no semantical changes)

* Update ShapeInference.md (#11168)

* Benchmarks 2022 1 updates (#11180)

* Updated graphs

* Quick fix for TODO in Dynamic Shapes article

* Anchor link fixes

* Fixed DM config (#11199)

* DOCS: doxy sphinxtabs (#11027)

* initial implementation of doxy sphinxtabs

* fixes

* fixes

* fixes

* fixes

* fixes

* WA for ignored visibility attribute

* Fixes

Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>
Co-authored-by: Sergey Lyubimtsev <sergey.lyubimtsev@intel.com>
Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Ilya Naumov <ilya.naumov@intel.com>
Co-authored-by: Evgenya Stepyreva <evgenya.stepyreva@intel.com>
2022-03-24 22:27:29 +03:00
Ilya Churaev b5dbabe41d
Fixed registration of template plugin (#11155)
* Fixed registration of template plugin

* Added option for template plugin

* Fixed static build
2022-03-24 14:39:20 +03:00
Nikita Semaev 5dcb6c2cee
Correcting a regular expression (#10822) 2022-03-22 13:41:23 +03:00
Ilya Churaev a4d164eda4
Fixed macro for plugin registration. Register only required plugins (#11031) 2022-03-18 13:13:33 +03:00
Mikhail Nosov 4b3dd808df
[First Inference] Read time improvements via using 'mmap/munmap' (#10907)
* Performance improvement for constant creation

The issue is that 'are_all_data_elements_bitwise_identical()' is called every time in Constant constructor, and it potentially checks all buffer which is O(N) complexity.
While it is needed only if client uses 'get_all_data_elements_bitwise_identical'

Solution:
- Defer calculation until first call of 'get_all_data_elements_bitwise_identical'
- Store calculated value in mutable class member to reuse it on next calls of 'get_all_data_elements_bitwise_identical'

Test verifies both cases:
a) that constant creation with shared memory data (now O(1)) is significantly faster than creation+bitwiseCheck O(N)
b) Than once calculated, value is taken from cache, which is significantly faster than re-calculation

* fix clang-format

* Stash - Linux implementation

* Windows mmap implementation + unicode

* Clang for windows

* removed debug print

* Add handling of empty bin file

* fix windows includes

* Fix python test

* Unit tests
Fix for Constant with size > 4GB

* Fix review comments
2022-03-17 17:16:06 +03:00
Serhii Pavlovskyi 948347f3dd
ncc build fixes (#10367)
* fix .ncc_style target names

it was breaking configure on system with libclang-12-dev, clang-12,
ninja and cmake 3.17+(ninja complains about duplicate
target). with lower cmake version configure succeeds, but build exits
immediately with error. by replacing ninja with make error becomes
warning(it's still significant, make just skips duplicate rules, i.e.
doesn't check style of some source files, rule duplication is genuine
bug). without libclang-12-dev and clang-12 ENABLE_NCC_STYLE is OFF and
bug is not triggered

* silence uninitialized warning in core_integration

probably it was always initialized before use, but compiler wasn't made
aware of it

* fix function spelling to unbreak code style checks in benchmark_app

* include <thread> for std::this_thread

existing code was relying on namespace pollution by old libstdc++

* replace is_pod with is_standard_layout && is_trivial

is_pod is deprecated, it breaks build on current gcc

Co-authored-by: Serhii Pavlovskyi <spavlovskyi@lohika.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
2022-03-09 13:42:06 +03:00
Ilya Churaev 1fec99afa3
Removed duplicated words (#10754) 2022-03-03 06:50:54 +00:00
FanJiangIntel 7ba71f9c20
Enable apivalidator check when BUILD_SHARED_LIBS=OFF (#10461)
* enable apivalidator for static build

* add target _ie_plugins_hpp as dependency of inference_engine_obj
2022-03-03 07:39:52 +03:00
Pavel Zamelin 9cd3bff7df
Fix install failures for static libs with `EXCLUDE_FROM_ALL` (#10706)
* Remove EXCLUDE_FROM_ALL for some static targets

* Add install check for static libs
2022-03-02 03:39:30 +03:00
Ilya Lavrenov 6b067bc0ed
Fixed install on Apple (#8302)
* Fixed Apple install

* Update path to libs in setupvars.sh

* Fix IE_CPACK_RUNTIME_PATH for Apple

* Fix wheels packaging

Co-authored-by: Alexey Suhov <alexey.suhov@intel.com>
2022-03-01 16:56:15 +03:00
Ilya Lavrenov e9e59cb954
Moved ngraphConfig.cmake to root (#10618) 2022-02-25 15:47:21 +03:00
Ilya Lavrenov d26fd3aa22
Ability to fully override OUTPUT_DIR (#10524) 2022-02-21 22:39:26 +03:00
Maxim Gordeev 3144c5fab8
Added processing of layout for speech sample (#10254)
* Added processing of layout for speech sample

* fixed notes

* some improvements

* Code style format

* changed NCC value for NullStatement

* improved batch processing

* added loading batch for imported model

* fixed notes

* fixed notes

* added layout parameter to azure tests
2022-02-17 16:11:57 +03:00
Ilya Lavrenov f2f281e60b
Renamed ov_runtime => openvino, ov_ => openvino_ prefix (#10069)
* Renamed ov_runtime => openvino, ov_ => openvino_ prefix

* Coverage fix

* More fixes

* Fixed MO tests with custom FE
2022-02-03 20:03:41 +03:00
Anton Pankratov 8993c4c18a
Deprecated ov::Any implicit cast to any types (#9409)
* Depricated Any implicit cast

* Fixed test

* fixed gna build

* Fixed warnings in benchmark_app

* Fixed test build

* ncc exception for PrintTo

* Error mesage in test

* Error mesage in test

* fixed build
2022-02-03 19:10:52 +03:00
Andrey Somsikov 9dd4476c58
Reduce noise from security tests (#9774)
* Mute noicy undefined behavior checks

* Fix GCC build error with unsupported option

* Fix missprint
2022-02-02 12:48:21 +03:00
Alexey Suhov e1e467f23f
[CMake] Add debug postfix on mac (#10027) 2022-02-01 12:41:26 +03:00
Nikolay Tyukaev 622027bee5
fix errors in documentation (#9384)
* add sphinx log parsing

* fix

* fix log

* fixes

* fixes

* fixes

* fixes

* fixes

* fixes

* fixes

* fixes

* fixes

* fixes

* doxygen-xfail

* fixes

* fixes

* fixes

* fixe

* fixes

* fixes

* fix pot

* add pot check

* fixes

* fixes

* Fixed POT docs

* Fixed POT docs

* Fixes

* change heading markup

* fixes

Co-authored-by: azaytsev <andrey.zaytsev@intel.com>
2022-01-27 19:39:49 +03:00
Pavel Zamelin 578afb9bb8
Allow to specify cpack component in addItTargetTest (#9945) 2022-01-27 17:01:46 +03:00
Mikhail Nosov cf328d299f
More fixes of plugins.xml generation (#9942)
* Further fixes of plugins.xml generation
1) Unregistration is done by name (e.g. CPU), not by file name (ov_cpu_plugin)
2) Unregistered line is searched by name="MULTI" instead of just 'MULTI' to not conflict with MULTI_WORK_MODE_AS_AUTO entry
3) Removed list of all possible plugins from ov_runtime as logic shall not rely on this (not possible to add 3rd party plugins)

* Revert ov_runtime - some CI jobs require plugins.xml even though plugins are not built

Registration - if some entry already exists in XML - don't copy it.
E.g.
- Registration of 'TEMPLATE' is performed
- Registration loops through existing plugins.xml
   - If name="TEMPLATE" is found - don't take it to newContent
   - If name like "myCustomPlugin" is found - take it
- As result - "myCustomPlugin" will exist after update, but old "TEMPLATE" will be removed

* Add missing change
2022-01-27 16:54:21 +03:00
Xin Wang 26ccbe9ebc
Change internal function name to avoid loop issue. (#9890)
* Change internal function name to avoid loop issue.

* Fix comment.
2022-01-26 17:35:31 +03:00
Mikhail Nosov 2ea52bae6e
Fixes of plugins.xml generation (#9922)
- Added registration (and unregistration) of ov_auto_batch_plugin. Otherwise 'BATCH' plugin will always produce new XML line without removing old one
- Added unregistration of legacy plugin names (<= 2021.4 release). Otherwise old lines like "libHeteroPlugin.so" will not be removed from plugins.xml file
2022-01-26 16:00:04 +03:00
Ilya Lavrenov 138fb37fde
Use clang-12 for U20 (#9867) 2022-01-24 14:23:16 +03:00
Mikhail Nosov d8e557b39c
FrontEnds.cmake: FEM include headers as public (#9792)
ONNX/Paddle/TF frontends: added 'standalone_build' target to verify that frontends can be used standalone by applications
2022-01-21 13:43:07 +03:00
Alexey Suhov a79830cb55
Update year to 2022 in copyright notice (#9755) 2022-01-19 01:07:49 +03:00
Pavel Zamelin 2e59029e68
Fix build error with -DBUILD_SHARED_LIBS=OFF (#9639)
* Add _ov_frontends_hpp dependency to frontend_common_obj

* Move _ov_frontends_hpp dependency to frontend_common_obj
2022-01-14 07:53:14 +03:00
Ilya Lavrenov 9ef48cbe6d
Moved NCC check to U20 (#9631) 2022-01-14 07:50:55 +03:00
Ilya Lavrenov 5affdc3284
Added NCC support for source files (#9630) 2022-01-14 07:50:30 +03:00
mei, yang e6d062e395
remove option ENABLE_SHUTDOWN_PROTOBUF (#9619)
* remove option ENABLE_SHUTDOWN_PROTOBUF

* shutdown protobuf library is enabled automatically if protobuf is used in frontend
2022-01-14 05:02:26 +03:00
Ilya Lavrenov 9fe5165ffa
Support of clang-11 (#9620) 2022-01-13 14:31:25 +03:00
mei, yang 6ae0ba481e
fix build issue on android on shutdown protobuf (#9615)
* fix build issue on android on shutdown protobuf

* add ie_dependent_option for shutdown protobuf
2022-01-13 11:47:54 +03:00
mei, yang 613facafde
ShutdownProtobufLibrary when unload paddle frontend dynmaic library t… (#9442)
* ShutdownProtobufLibrary when unload paddle frontend dynmaic library to fix probuf memory leak

* ShutdownProtobufLibrary if the frontend libraries use protobuf

* make shutdown_protobuf a library
2022-01-12 13:07:51 +03:00
Ilya Churaev 5e1d241c11
Renamed template plugin and tests (#9389)
* Renamed template plugin and plugin's tests

* Renamed template_extension
2021-12-23 14:59:24 +03:00
Ilya Lavrenov 4eea535e78
Includes in frontends (#9378)
* Used full paths in public includes

* Fixed install of ONNX include
2021-12-23 11:37:06 +03:00
Ilya Churaev 42350a705e
Remove legacy targets (#9333)
* Remove some legacy targets

* Replace some targets

* Removed inference_engine_plugin_api dependency

* Minor comment for developer config

* Fixed include paths

* Small fixes for static build

* Try to fix build pyopenvino

* Fixed comments

* Try to fix build

* Include OpenVINODeveloperPackage inside InferenceEngineDeveloperPackageConfig

* Try to fix GAPI tests
2021-12-23 08:16:23 +03:00
Ivan Tikhonov 0bbda24186
Paddle FrontEnd Refactoring (#9157)
* Refactor PaddlePaddle FrontEnd

* Codestyle

* FrontEnd,InputModel,Place base classes -> abstract, renamed model file

* Fix unit tests

* fix unit tests

* ngraph:: to ov::

* Rename frontends dir to frontend

* Rename paddlepaddle to paddle; pdpd to paddle

* add missing file

* codestyle

* Remove local change

* paddlepaddle -> paddle for azure configs and .md files

* fix package name, fix config files

* Fix win build

* Revert Broadcast/AutoBroadcast changes

* codestyle

* fix FronEnd class

* fix ngraph_cpp_api.config

* codestyle

* merge master

* fix build

* refactoring; revert broadcast/autobroadcast changes

* codestyle

* fix MacOS config
2021-12-22 11:20:54 +03:00
Ilya Churaev dbf8fcf556
Create ov_runtime library (#9199)
* Create ov_runtime library

* Added dev target

* Fixed SOURCE_DIR property for interface lib

* Fixed missed include path

* Fixed SOURCES for plugins and frontends

* Fixed Windows export

* Try to fix preproc build

* Fixed MKLDNNPlugin

* Fix C API

* Try to fix public CI

* Fixed comments

* Use TARGET_NAME variable

* Fixed static build

* Fixed target name in comfig

* Revert "Fixed target name in comfig"

This reverts commit f61c1e0c09.

* Try to remove WA with include path

* Try to fix TBB dependency for old CMake

* Revert install to lib for legacy tests

* Try to fix public tests

* Add WA for v7 reader

* Fixed dev export name

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-12-20 11:59:08 +03:00
Ilya Churaev be86ec51ab
Renamed frontends from *ov_frontend to ov_*_frontend (#9275)
* Renamed frontends from *ov_frontend to ov_*_frontend

* Fixed MO

* Fixed include
2021-12-18 13:25:42 +03:00
Ivan Tikhonov 59fca61dd5
[FrontEnds]: Fix build issue on Win platforms (#9274)
* include place.hpp into input_model.hpp

* resolve issues in api validator

* set full namespaces for Place::Ptr in input_model
2021-12-17 13:37:16 +03:00
Ivan Tikhonov dbd2b5dc08
ONNX/IR/Common FrontEnds Refactoring (#9174)
* Refactor ONNX,IR,Common FrontEnds

* Rename frontends dir to frontend

* Rename frontend_manager, frontend_defs -> manager, defs; move Place, InputModel to src for Paddle FE

* remove exports for ir/input_model

* fix unit tests

* Fix unit tests

* revert ONNX_API/IR_API defines

* move manager.hpp to frontend dir

* delete common folder; rename defs to visibility; fix includes

* revert local changes

* codestyle

* fix build: set correct includes

* fix includes

* fix build; resolve review comments

* fix install paths

* correct installation folder for onnx_import

* use IE_THROW in ir frontend
2021-12-17 08:05:30 +03:00
Ilya Lavrenov 02e7706776
Merged ngraph & core components (#9101) 2021-12-09 15:38:44 +03:00
Ilya Lavrenov e0ae61b06d
Added optional for exclude_from_all targets (#9100) 2021-12-09 08:51:21 +03:00
Evgeny Talanin fb103e1dd0
Revert "Revert "disable debug postfix on mac (#6827)" (#8974)" (#9000)
This reverts commit e81e60b233.
2021-12-03 13:03:17 +03:00
Ilya Lavrenov e81e60b233
Revert "disable debug postfix on mac (#6827)" (#8974)
This reverts commit 6f23458534.
2021-12-02 12:30:01 +03:00
Alexander Sesorov 4b8d6c59e3
Update sanitizer flags for windows (#8830) 2021-12-02 01:33:34 +03:00