Commit Graph

43 Commits

Author SHA1 Message Date
Ilya Lavrenov 0934d2a7dd
Moved all tensorflow proto files to a folder with ov prefix to avoid ODR (#20636)
conflicts
2023-10-22 01:02:32 +04:00
Ilya Lavrenov ead4b8a0ec
Moved cmake functions, variables to API 2.0 naming style (#20281)
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU
2023-10-09 22:30:32 +04:00
Ilya Lavrenov 95e3096684
Added build on RedHat system to build & test RPM packages (#20134)
* Added GHA workflow for RPM packages

* Avoid rebuild for RPM / Debian packages

* Removed conditional include headers

* try only post-build

* Beautification

* Fixed testdata generation for mulit-config generators
2023-10-01 23:23:06 +04:00
Ilya Lavrenov db395155b3
Removed warnings suppressions for extra modukes (#16479) 2023-09-15 02:53:32 +00:00
Ilya Lavrenov 35a0706dff
Replaced several cmake utilities with new ov_ prefix (#19819)
* Replaced several cmake utilities with new ov_ prefix

* Replaced several cmake utilities with new ov_ prefix
2023-09-14 16:22:50 +04:00
Ilya Lavrenov 7173f530cc
Fixed static build from build tree (#19556) 2023-09-04 08:08:50 +04:00
Ilya Lavrenov aebf1edec7
Fixed build without protobuf-lite (#19164) 2023-08-14 11:57:35 +04:00
Ilya Lavrenov 6067ab17ba
Aligned target and files (libraries) names (#19161) 2023-08-13 11:31:44 +04:00
Mateusz Bencer c59746fd27
Implementation of MMAP for ONNX FE (#18026)
* Implementation of MMAP for ONNX FE

* fix win offsets

* added virtual dtor to MappedMemory

* review remarks. part.1

* added disable mmap flag to MO

* added additional checks to mmap

* remove unnecessary const

* fix pybind default value

* Added args.disable_mmap = False to MO tests

* fixed MO test

* avoid global headers

* fix casting for win

* disable mmap for legacy frontends flow

* review remarks

* Fixed passing parameters

* added doc to MappedMemory and load_mmap_object
2023-07-13 19:17:58 +00:00
Ilya Lavrenov 84db7d0ee6
Build using conanfile.txt (#17580)
* Build using conanfile.txt

* Update .ci/azure/linux_arm64.yml

* Several improvements

* Removed conanfile.py

* Try to use activate / deactivate

* Fixed clang-format code style

* Supported TBB version from Conan

* Added more NOMINMAX

* Fixed static build

* More improvements for static build

* Add usage of static snappy in case of static build

* More fixes

* Small fixes

* Final fixes
2023-05-19 14:01:39 +04:00
Ilya Lavrenov 04171416f4
Put mingw on gcc code path (#16101)
* Supported mingw-w64

* Supported mingw-w64

* Supported mingw-w64
2023-05-17 00:47:55 +04:00
Ilya Lavrenov 7743e175b7
Warn if OpenVINO symbols require new CXX ABI (#16080)
* Warn if OpenVINO symbols require new CXX ABI

* Fixed warnings / errors on Windows
2023-04-29 01:17:52 +01:00
Ilya Lavrenov a34ef680f2
Made plugins.hpp generation to be CONFIG dependent (#17139) 2023-04-24 14:48:45 +04:00
Ilya Lavrenov f080a0d9cf
Added NCC style for frontends sources (#16200)
* Ability to provide several source dirs for ncc-style checks

* Fixed include headers; added NCC to TF common

* Fixed NCC for frontends

* Fixed NCC for frontends

* Extra fixes

* Fixest push --f

* Clang-format

* Apply comments

* Add an option to specify required clang-format version

* Update src/frontends/tensorflow/src/decoder_proto.cpp

* Update src/frontends/tensorflow/src/decoder_proto.cpp
2023-03-13 14:54:00 +00:00
Ilya Lavrenov ba19d945ac
Fixed clang-format for C API (#16024) 2023-03-01 16:36:20 +04:00
Ilya Lavrenov 6d7b94b8cd
Improved API validator logic (#15942) 2023-02-25 01:11:50 +04:00
Evgenya Stepyreva 0513a79a79
Tensorflow Lite frontend (#14977)
* Infrastructure for tflite

* Removed submodule flatbuffers

* Added flatbuffers submodule. Fixed version to v22.12.06 aka acf39ff

* Move headers back

* Flatbuffers integration

* Small fixes

* Started parsing the Model

* flatbuffer changes

* decoder_flatbuffer changes

* Lite Input Model -- not needed as of now but looks cool

* Rolled back inherritance from ov::frontend::tensorflow::InputModel

* Results are not treated as outputs, but its ok

* Fix missplaced input vs output

* Refactor

* Load model op-by-op. Frontend API finalized

* Debugging still, there are prints here and there. Decoder is not sane

* Convolution with all attributes is translated and quantization is applied for inputs and constatants. TODO: quantize intermediate tensors, separate decoder specific logic?

* Float ssd and posenet models are showing good accuracy

* Need to refactor but work flawlessly

* Telemetry and lightweight model cutting

* Code style and test changes. Extensions supported

* Quantization and style

* Style refinements

* Move onednn back

* New portion of operations enabled

* TFLite FE doesn't inherrit TF FE

* Moved files to another directory

* Rename header op_table.hpp to common_op_table.hpp for all files in src/frontends/tensorflow_common/src/op/

* Removed visability macroses

* CMake changes

* Unit-test execution in .ci

* Update labeler.yml

* Codeowners

* Style check and fix

* Static Build arrangement

* Addressing the comments

* install common headers to previous place

* New approach with public decoder and graph_iterator

* New approach with public decoder and graph_iterator

* Move GraphIterator back

* Comments addressed

* Comments adressed

* Preliminary TF FE README.md changes

* Added target_compile_definitions OPENVINO_STATIC_LIBRARY for static build

* Fixed conflicts and added TF to common places

* Frontends use only openvino::core::dev API

* Merged common tensorflow changes and made code build and work on selective number of models

* Style

* Rollback unnecessary changes from Tensorflow FE

* Rollback unnecessary changes from Tensorflow Common

* Minor refactor

* cmake minor refactoring

* Mixed commit

* Style and merge fix

* Low hanging fruit operations

* Fix windows build

* Refactor quantization parameters representation

* license compliance. approved by OS PDT

* copyrights in generic file

* dependabot

* labeler

* Unit Test to be triggered in CI

* cmake variables naming. corrected copyright years in copyrights/generic file

* library renamed in .ci/ calls

* Copyright year update

* Set openvino-tf-frontend-maintainers as owner of /src/frontends/tensorflow_lite/

* Fixed flatc corss-compilation

* Cleaned flatbuffers header usage

* Nitpicks solved

* Update cmake/templates/OpenVINOConfig.cmake.in

* Compile with flatbuffers headers

* Fixed "which is prefixed in the source directory"

* Fixed typo in flatbuffers cmake

* Removed flatbuffers submodule

* Added fork submodule

* Fixed static build

* Fixed cross-compilatio

* Fixed -Wshadow warning

* Fixed warning on Windows

* Use only headers from flatbuffers library

* Added LTO and fixed compilation errors on Windows

* Fixed warnings in tensorflow_common

* Move ctors implementation to cpp file

* Added information about new frontends to common FEm part

* Temporaryily disable warnings

* Fixed code style using clang-format

* Fixed Windows

* reverted changes in onnx

* Revert changes in onnx_common

* Removed pragma once frm cpp

Co-authored-by: missjane <estepyreva@gmail.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-01-27 06:27:59 +04:00
Ilya Churaev 0c9abf43a9
Updated copyright headers (#15124)
* Updated copyright headers

* Revert "Fixed linker warnings in docs snippets on Windows (#15119)"

This reverts commit 372699ec49.
2023-01-16 11:02:17 +04:00
Ilya Lavrenov 5c4564c214
Tensorflow func tests (#13198)
* Added auto-detect for SHUTDOWN_PROTOBUF option

* Hide some helper variables as internal ones

* Update frontends cmake files not to include tests folders

* Added an ability to test private API for TF FE

* Added an ability to test private API for TF FE

* Improved mock frontends in python tests

* Fixed compilation error

* Fixed link on WIndows
2022-09-25 16:54:26 +04:00
Ilya Lavrenov 836765874e
LTO for frontends and python (#12890) 2022-09-05 08:10:11 +04:00
Ilya Lavrenov fb8423dcee
Apple "cross compilation" for protoc (#12881) 2022-09-03 10:50:01 +04:00
Ilya Lavrenov e19df6f85f
Updated ia32 toolchain with system / processor (#12784)
* Updated ia32 toolchain with system / processor

* Allow pkg-config during cross-compilation

* added error message

* Search TBB using tbb.pc as well

* WA

* Fix for yocto

* Added print

* Use tbb.pc only when system libs are enabled

* Improved OpenVINOConfig.cmake

* Don't find pkg-config as required
2022-09-01 14:33:47 +04:00
Ilya Lavrenov 27cbc1a969
Debian packages for frontends (#12649)
* Created dedicated debian packages for frontends

* Fixed Azure CI

* Install TF FE with both names

* Disabled 2 QN tests

* Install python samples differently
2022-08-23 01:39:23 +04:00
Ilya Lavrenov 6ca47b074d
Library versions & made tests relocatable (#12416)
* Fixes for cases when TBB_DIR env var is set

* Don't use make in build_samples.sh script

* First version of Windows installer

* WIndows NSIS installer

* Improved version of debian packages

* Improvements

* Improvements

* Debian packages now look good

* Library versioning

* Fixed tests to run against debian packages

* Fixed frontend tests

* Fixed code style

* FIxed Windows

* Fixed python tests

* Fixed paths in tests

* fdvfdv

* Fixes

* USe versioning only for debian packages

* Relocatable tests

* Fixed

* Fixed all tests

* Fixed clang-format

* Fixed more tests

* Fixed some tests

* Absolute paths in .ci

* Fixes

* Added support of OpenCV 3.4

* Trying to fix gnaUnitTests
2022-08-08 13:59:24 +04:00
Ilya Lavrenov b449481439
Improved OpenVINO debian packages (#12385) 2022-08-03 07:20:26 +04:00
Ilya Lavrenov 3c0b17f108
Debian packages: base version (#11387) 2022-07-19 09:07:26 +03:00
Ilya Lavrenov 19d0e5ba52
CMAKE: IE_VERSION => OpenVINO_VERSION (#11242)
* IE_VERSION => OpenVINO_VERSION

* Reverted installation of python unconditionally
2022-03-28 19:32:21 +03:00
Mikhail Nosov 4b3dd808df
[First Inference] Read time improvements via using 'mmap/munmap' (#10907)
* Performance improvement for constant creation

The issue is that 'are_all_data_elements_bitwise_identical()' is called every time in Constant constructor, and it potentially checks all buffer which is O(N) complexity.
While it is needed only if client uses 'get_all_data_elements_bitwise_identical'

Solution:
- Defer calculation until first call of 'get_all_data_elements_bitwise_identical'
- Store calculated value in mutable class member to reuse it on next calls of 'get_all_data_elements_bitwise_identical'

Test verifies both cases:
a) that constant creation with shared memory data (now O(1)) is significantly faster than creation+bitwiseCheck O(N)
b) Than once calculated, value is taken from cache, which is significantly faster than re-calculation

* fix clang-format

* Stash - Linux implementation

* Windows mmap implementation + unicode

* Clang for windows

* removed debug print

* Add handling of empty bin file

* fix windows includes

* Fix python test

* Unit tests
Fix for Constant with size > 4GB

* Fix review comments
2022-03-17 17:16:06 +03:00
Ilya Lavrenov f2f281e60b
Renamed ov_runtime => openvino, ov_ => openvino_ prefix (#10069)
* Renamed ov_runtime => openvino, ov_ => openvino_ prefix

* Coverage fix

* More fixes

* Fixed MO tests with custom FE
2022-02-03 20:03:41 +03:00
Mikhail Nosov d8e557b39c
FrontEnds.cmake: FEM include headers as public (#9792)
ONNX/Paddle/TF frontends: added 'standalone_build' target to verify that frontends can be used standalone by applications
2022-01-21 13:43:07 +03:00
Alexey Suhov a79830cb55
Update year to 2022 in copyright notice (#9755) 2022-01-19 01:07:49 +03:00
Pavel Zamelin 2e59029e68
Fix build error with -DBUILD_SHARED_LIBS=OFF (#9639)
* Add _ov_frontends_hpp dependency to frontend_common_obj

* Move _ov_frontends_hpp dependency to frontend_common_obj
2022-01-14 07:53:14 +03:00
Ilya Lavrenov 5affdc3284
Added NCC support for source files (#9630) 2022-01-14 07:50:30 +03:00
mei, yang e6d062e395
remove option ENABLE_SHUTDOWN_PROTOBUF (#9619)
* remove option ENABLE_SHUTDOWN_PROTOBUF

* shutdown protobuf library is enabled automatically if protobuf is used in frontend
2022-01-14 05:02:26 +03:00
mei, yang 6ae0ba481e
fix build issue on android on shutdown protobuf (#9615)
* fix build issue on android on shutdown protobuf

* add ie_dependent_option for shutdown protobuf
2022-01-13 11:47:54 +03:00
mei, yang 613facafde
ShutdownProtobufLibrary when unload paddle frontend dynmaic library t… (#9442)
* ShutdownProtobufLibrary when unload paddle frontend dynmaic library to fix probuf memory leak

* ShutdownProtobufLibrary if the frontend libraries use protobuf

* make shutdown_protobuf a library
2022-01-12 13:07:51 +03:00
Ilya Lavrenov 4eea535e78
Includes in frontends (#9378)
* Used full paths in public includes

* Fixed install of ONNX include
2021-12-23 11:37:06 +03:00
Ilya Churaev 42350a705e
Remove legacy targets (#9333)
* Remove some legacy targets

* Replace some targets

* Removed inference_engine_plugin_api dependency

* Minor comment for developer config

* Fixed include paths

* Small fixes for static build

* Try to fix build pyopenvino

* Fixed comments

* Try to fix build

* Include OpenVINODeveloperPackage inside InferenceEngineDeveloperPackageConfig

* Try to fix GAPI tests
2021-12-23 08:16:23 +03:00
Ilya Churaev dbf8fcf556
Create ov_runtime library (#9199)
* Create ov_runtime library

* Added dev target

* Fixed SOURCE_DIR property for interface lib

* Fixed missed include path

* Fixed SOURCES for plugins and frontends

* Fixed Windows export

* Try to fix preproc build

* Fixed MKLDNNPlugin

* Fix C API

* Try to fix public CI

* Fixed comments

* Use TARGET_NAME variable

* Fixed static build

* Fixed target name in comfig

* Revert "Fixed target name in comfig"

This reverts commit f61c1e0c09.

* Try to remove WA with include path

* Try to fix TBB dependency for old CMake

* Revert install to lib for legacy tests

* Try to fix public tests

* Add WA for v7 reader

* Fixed dev export name

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2021-12-20 11:59:08 +03:00
Ilya Churaev be86ec51ab
Renamed frontends from *ov_frontend to ov_*_frontend (#9275)
* Renamed frontends from *ov_frontend to ov_*_frontend

* Fixed MO

* Fixed include
2021-12-18 13:25:42 +03:00
Ivan Tikhonov dbd2b5dc08
ONNX/IR/Common FrontEnds Refactoring (#9174)
* Refactor ONNX,IR,Common FrontEnds

* Rename frontends dir to frontend

* Rename frontend_manager, frontend_defs -> manager, defs; move Place, InputModel to src for Paddle FE

* remove exports for ir/input_model

* fix unit tests

* Fix unit tests

* revert ONNX_API/IR_API defines

* move manager.hpp to frontend dir

* delete common folder; rename defs to visibility; fix includes

* revert local changes

* codestyle

* fix build: set correct includes

* fix includes

* fix build; resolve review comments

* fix install paths

* correct installation folder for onnx_import

* use IE_THROW in ir frontend
2021-12-17 08:05:30 +03:00
Ilya Lavrenov 02e7706776
Merged ngraph & core components (#9101) 2021-12-09 15:38:44 +03:00
Ilya Lavrenov c02fe4b813
Static OpenVINO frontends (#8868)
* Static OpenVINO frontends

* ONNX tests with shared extension CustomOpUser_ONNXImporter

* Resolved issues with ONNX's NCC style check

* Reverted openvino => ngraph for frontend includes install

* Try to fix ONNX / Protobuf

* Try to fix CI

* Try

* Fixed cmake stage with BUILD_SHARED_LIBS

* Fixed export for linkable frontends

* Fixed warnings on Linux

* Fixed after ngraph => src
2021-11-28 21:36:24 +03:00