Commit Graph

154 Commits

Author SHA1 Message Date
Ivan Novoselov e56310999c
[Snippets] TPP FP32 MHA support (#22210)
### Details:
 - *Enable FP32 MHA lowering using TPP backend*
- *This PR is a productization of the [TPP integration
POC](https://github.com/openvinotoolkit/openvino/pull/20956)*
### Prerequisites:
- https://github.com/openvinotoolkit/openvino/pull/21303
- https://github.com/openvinotoolkit/openvino/pull/21672

Branch to Branch PR in to review the changes before the Prerequisites
are merged: https://github.com/IvanNovoselov/openvino/pull/18

---------

Co-authored-by: egeorgan <evangelos.georganas@intel.com>
2024-04-22 14:52:42 +00:00
Ilya Lavrenov 007ed84886
Improved cross-compilation with python (#24160)
### Details:
 - Improved cross-compilation with python
 - It's important for RISC-V enablement 
 - Depends on https://github.com/openvinotoolkit/openvino/pull/24140
2024-04-22 18:33:05 +04:00
Xin Wang 8463eee2f6
Upstream Intel NPU Plugin (#23537)
### Details:
 - Add ENABLE_INTEL_NPU option
 - Add ENABLE_NPU_DEBUG_CAPS option
 - Add npu plugin codes to src/plugins/intel_npu/
 - Add src/inference/include/openvino/runtime/intel_npu/properties.hpp
- Add thirdparty level-zero and level-zero-ext to
src/plugins/intel_npu/thirdparty
- Export openvino::openvino_npu_al and
openvino::openvino_npu_logger_utils

### Tickets:
 -  E-115936

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2024-04-03 12:31:11 +04:00
Vishniakov Nikolai 3051d3a893
[OV JS] Disable building nodejs bindings for emscripten (#23708)
### Details:
 - JS is not available for emscripten compilation

### Tickets:
 - Closes https://github.com/openvinotoolkit/openvino/issues/23701

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2024-03-30 23:13:19 +00:00
Ilya Lavrenov fc5da9d935
Fixed Android x86_64 build (#23679)
### Details:
 - JS is not available on Android

### Tickets:
 - Closes https://github.com/openvinotoolkit/openvino/issues/23494
2024-03-27 10:23:51 +00:00
Jacek Pawlak 239466ca5d
copyright year update (#23370)
New PR due to merge
conflicts(https://github.com/openvinotoolkit/openvino/pull/22917)

Updated the copyright year from 2018-2023 to 2018-2024 in all openvino
files

Ref. to script: CVS-101144

Command used:
```bash
git grep -lz '2018-2023 Intel Corporation' | xargs -0 sed -i '' -e 's/2018-2023 Intel Corporation/2018-2024 Intel Corporation/g'
```
2024-03-14 09:37:02 +00:00
Vishniakov Nikolai 329489c538
[JS OV] Extend js bindings supported platforms (#21995)
* Fix npm variables list

* Fix typo

* Provide instructions for js bindings arm compilation

* Remove extra spaces

* Set optimal scope of flags for both archs

* Support windows compilation

* Extend .gitignore

* Unify compilation instruction

* Exclude async infer from windows build

* Enable js on windows

* Activate js validation in windows workflow

* Fix precision
2024-01-30 07:14:45 +00:00
Vishniakov Nikolai 0a8f138382
[OV JS] Conditional enabling of JS API (#22139)
* Disable js api building for vcpkg

* Disable JS API by default

* Add disable JS API conditions in features.cmake

* Update cmake/features.cmake

* Update src/bindings/js/CMakeLists.txt

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2024-01-13 12:33:49 +04:00
Fang Xu ebe366c67d
set minimal tbb version on arm64 ubuntu22 (#22057)
* set minimal tbb version on arm64 ubuntu22

* disable pkg_search_module for tbb on ARM64 Ubuntu22

* set minimal tbb version for all linux arm64
2024-01-11 10:31:15 +04:00
Vitaliy Urusovskij 2eaed979a4
Remove G-API (#21131)
* Remove G-API

* Apply comments

* Revert "Apply comments" - tests shared classes only

This reverts commit 8d07082341.

---------

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2023-12-25 14:50:54 +01:00
Ilya Lavrenov c79ae17bbf
Removed GNA plugin from 2024.0 (#21800) 2023-12-21 13:39:06 +01:00
Ilya Lavrenov 3a6a62558a
Disable system TBB on Linux arm64 (#21769)
* Disable system TBB on Linux arm64

* Update cmake/features.cmake
2023-12-20 10:53:49 +04:00
Chenhu Wang 6aa0a6677d
[SnippetS] Binary size reduce, executor cache disabled if enable perf count (#21494) 2023-12-18 09:53:43 +04:00
Ilya Lavrenov b13cb8ce12
Make RPM packages compatible with wide range of RHEL systems (#20762) 2023-10-31 10:25:35 +04:00
Ilya Lavrenov 2a3d5b9d14
Disable OMP threading on macOS (#20405) 2023-10-12 11:34:01 +04:00
Ilya Lavrenov ead4b8a0ec
Moved cmake functions, variables to API 2.0 naming style (#20281)
* Merge Linux CC + static build + clang compiler

* Improvements

* Removed ie prefixes from cmake scripts

* Fixes for NPU
2023-10-09 22:30:32 +04:00
Ilya Lavrenov ffbffed749
Enabled warnings as errors for static Ubuntu 22.04 (#20302) 2023-10-08 23:23:54 +04:00
Ilya Lavrenov d6c2a10b38
Merge Linux CC + static build + clang compiler (#20243)
* Merge Linux CC + static build + clang compiler

* Improvements

* Fixes
2023-10-06 00:30:11 +04:00
Ilya Lavrenov d37326b37e
Disable pkg-config search on Android via CMAKE_DISABLE_FIND_PACKAGE_PkgConfig (#20179) 2023-10-03 09:16:56 +04:00
Fang Xu 2f9727aef9
fix compilation issue on Windows arm64 (#19873)
* fix compilation issue on Windows arm64

* fix build issue

* fix build issue

* disable clang compiler for Windows on ARM

* disable clang compiler for cpu plugin

* Update CMakeLists.txt

removed fatal_error from cpu cmake

* Update features.cmake

disable Intel CPU plugin by default on Windows ARM64 with clangl-cl compiler

* update comments

* fix build issue

---------

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-09-28 05:56:10 +00:00
Ilya Lavrenov 8349849e1c
Use FindPython3.cmake (#19847)
* Use FindPython3.cmake

* Fixed compilation on macOS 14 with new core development tools

* Try to use Python3_SOABI instead of PYTHON_MODULE_EXTENSION

* Use Development.Module

* Keep specifying only Python3_EXECUTABLE

* Print PYTHON_MODULE_EXTENSION

* Added check for minimal cmake version for python API

* Returned Python3_INCLUDE_DIR for cross-compilation case

* Try to allow cmake older than 3.18

* Use build python interpreter to check cython dependency

* revert changes in .ci/openvino-onnx/Dockerfile

* removed unused code

* Fixed issue with variables scope

* Experiment: remove include dirs

* Corrected docs

* Use pybind11 function to set extension

* Revert "Experiment: remove include dirs"

This reverts commit 6f7f90211c.

* Refactor ConvolutionBackpropDataLayerTest, ConvolutionLayerTest, DeformableConvolutionLayerTest (#19810)

* Refactor ConvolutionBackpropDataLayerTest

* Refactor ConvolutionLayerTest

* Refactor DeformableConvolutionLayerTest

* Apply comments

* Apply comments

* Fix

* Updated minimum cmake version for Windows

* Simplified check

* Removed useless message status

* Use puiblic option

---------

Co-authored-by: Oleg Pipikin <oleg.pipikin@intel.com>
2023-09-26 20:57:29 +02:00
Ilya Lavrenov 5616c26d19
Debian packages on GHA (#20033)
* Refactored Linix GHA pipeline

* Move ONNX tests to Unit

* Install tests together with openvino

* Added checks for GNA usage in docs python snippets

* Install openssl for working pip

* Disabled onnx_dyn_shapes_expand_1_dyn_shape ONNX test

* exclude dyn shapes from onnx

* Migrated samples tests

* Fixed ONNX tests

* caches for PT tests dependencies

* Build Contrib separately from main OpenVINO

* More fixes

* Added python install for samples stage

* Installed manifests for ONNX FE tests

* Try to avoid libgl1 dependency in tests

* Clean-up

* Fixed issue with manifests in ONNX tests

* Try to build debian packages in GHA

* Fixed debian packages build for multi-config generators
2023-09-26 01:54:41 +04:00
Ilya Lavrenov 253ca8c746
Fixed GPU plugin static build with oneDNN (#19811)
* Fixed GPU plugin static build with oneDNN

* Fixed issue with absolute paths inside installed OpenVINOConfig.cmake

* Fixed absolute paths in installed OpenVINOConfig.cmake

* Changed components for installation
2023-09-18 13:58:20 +04:00
Ilya Lavrenov 0b8237f508
Removed testdata repo usage (#19890) 2023-09-18 06:59:56 +04:00
Ilya Lavrenov ba67db66ae
Properly enable CMAKE_COMPILE_WARNING_AS_ERROR (#19828)
* Properly enable CMAKE_COMPILE_WARNING_AS_ERROR_DEFAULT

* Properly enable CMAKE_COMPILE_WARNING_AS_ERROR
2023-09-15 01:20:00 +04:00
Ilya Lavrenov 00b06adee4
Fixed order of dependent cmake options (#19551)
* Fixed order of dependent cmake options

* Update .ci/azure/linux_cuda.yml

fixed typo in option name
2023-09-04 08:32:01 +04:00
Ilya Lavrenov 2b12780588
Use prebuilt TBB on macos arm64 (#18923) 2023-08-02 14:34:59 +04:00
Ilya Lavrenov 94887bed38
Removed prebuilt OpenCV usage (#17838) 2023-07-28 16:08:09 +00:00
Ilya Churaev b69190c2c1
Proxy plugin 2.0 (#17416)
* Initial commit for proxy plugin

* Include proxy to openvino library

* Fixed some tests

* Added plugin properties

* Added readme

* Support Compile model for the proxy plugin

* Fixed python

* Remove gmock

* Fixed some tests

* Fixed load plugin tests

* Removed internal PROXY_FALLBACK_PRIORITIES initialization property

* Fixed code style

* Added new tests

* Create architecture.md

* Fixed some proxy tests

* Implement not implemented functions

* Fixed ICore mock

* Remove redundant code

* Added import/export tests

* Fixed hetero import/export tests

* Fixed ICore mock

* Fixed import tests

* Fixed build

* Remove redundant parse config

* Fixed some comments

* Try to fix Windows build

* Fixed incorrect logic

* Small fix in tests

* Fixed python API

* Fixed typo

* Try to fix python

* Switch GPU under proxy

* Fixed GPU name

* Revert GPU plugin under proxy

* Small changes in CMake files

* Temp commit

* Build without proxy

* Revert "Temp commit"

This reverts commit 1ac9824bdf.

* Fixed test linking

* Removed tests from ncc check

* Add option to disable proxy plugin

* Fixed minor comments

* Disable some proxy tests if IR frontend is disabled

* Enable Intel GPU under the proxy

* Fixed typo

* Fixed segfault in tests

* Small fix for case if only GPU is registered

* Fixed code style

* Added remote context tests

* Added proxy tests to CI

* Fixed mock engine

* Test change

* Revert "Test change"

This reverts commit 2d1d67766f.

* Add new tests

* Removed some tests

* Revert "Removed some tests"

This reverts commit 090398652f.

* Revert incorrect logic

* Removed unused variables

* Use original name for the GPU plugin

* Fixed CMake

* Do not show hidden devices

* Try to fix GPU remote context

* Fixed GPU plugin build

* Added interface for proxy remote context

* Remove local properties

* Remove redundant API

* Fixed typo

* Added remote tensors

* Fixed code style

* Fixed some comments

* Unwrap remote tensors before conversion to Blob

* Added cast for legacy API

* Fixed some cldnn tests

* Do not add preprocessing for proxy plugin

* Enabled more tests and wrap tensors in infer request

* Use hardware request inside conversion wrapper

* Fixed hand on cache calculation

* Try to fix some tests

* Support set tensor for remote tensors in proxy plugin

* Revert "Support set tensor for remote tensors in proxy plugin"

This reverts commit 5a927de590.

* Remove redundant friend from compiled model and fix life time for infer
request

* Fixed code style

* Add additional so pointers to the tensor

* Rewrite approach for compile model and tensor

* Removed API from proxy

* Fixed is/as Blob for wrapped Blobs

* Wrap tensor when set tensor to plugin

* Fixed recursive call

* Don't unwrap tensors for AUTO plugin

* Fixed Some Multi tests with remote blob for proxy

* Align context name with tests

* Fixed code style

* Try to fix more tests

* Some minor changes

* Try to fix OVHoldersTests

* Try to save low level SO in high level wrappers

* Revert "Try to save low level SO in high level wrappers"

This reverts commit 430ff8a526.

* Revert "Try to fix OVHoldersTests"

This reverts commit 32604f0d3e.

* Disable some tests

* Fixed DynamicBatchShapeTests

* Fixed caching tests and skip OVHoldersTest

* Small refactoring

* Fixed import model

* Small fix

* Fix typo which causes fails of caching tests

* Disabled AUTO BATCH for proxy device

* Support Export in Auto batch

* Small changes

* Fixed initialization fallback to plugin with proxy name

* Added more values for tests

* Ask all devices and create context if no device id

* Support export in auto batch

* Fixed some comments

* Fixed some comments and removed auto batch

* Fixed some comments

* Fixed auto batch test and some comments

* Fixed build

* Removed proxy plugin class from dev api

* Fixed code style

* Fixed disabled tests
2023-07-07 13:45:20 +04:00
Anastasiya(Asya) Pronina 84d35ab6f9
Removed compile_tool and benchmark_app_legacy from OpenVINO repo (#18350) 2023-07-04 19:35:51 +04:00
Ilya Lavrenov 15e69c280a
Used pip wheel to build OpenVINO wheel (#18029)
* Used pip wheel to build OpenVINO wheel

* Improvements

* Added python api properly into deb / rpm packages

* Use cmake -E variant from cmake 3.13

* Improvements to fix CI

* Some refactoring

* Don't use developer package for scripts projects

* Final fixes
2023-06-23 09:17:02 +04:00
Ilya Lavrenov 5574acc6ca
Fixed Snappy dependent option default value (#18128) 2023-06-18 21:33:57 +04:00
Ilya Lavrenov 50c85f01ab
ARM static build (#17970) 2023-06-10 23:40:39 +04:00
Ilya Lavrenov 2ff430fa80
Try to use system flatbuffers on Android (#17954) 2023-06-08 21:22:33 +04:00
Ilya Lavrenov b1b1014a34
Enable python API in deb / rpm packages (#17923)
* Enable python API in debian package

* Enable python API in debian package
2023-06-08 15:35:27 +04:00
Ilya Lavrenov 0b6b16c83a
Added vcpkg build to CI (#17808) 2023-06-01 10:31:10 +04:00
Ilya Lavrenov 72993e70c0
Fixed Android build (#17704)
* Fixed Android build

* Update thirdparty/dependencies.cmake
2023-05-27 15:02:03 +04:00
Egor Duplenskii 0501434032
[CPU][GPU] Fix ENABLE_DEBUG_CAPS configuration in cmake (#17639) 2023-05-21 11:12:13 +00:00
Ilya Lavrenov 84db7d0ee6
Build using conanfile.txt (#17580)
* Build using conanfile.txt

* Update .ci/azure/linux_arm64.yml

* Several improvements

* Removed conanfile.py

* Try to use activate / deactivate

* Fixed clang-format code style

* Supported TBB version from Conan

* Added more NOMINMAX

* Fixed static build

* More improvements for static build

* Add usage of static snappy in case of static build

* More fixes

* Small fixes

* Final fixes
2023-05-19 14:01:39 +04:00
Ilya Lavrenov 04171416f4
Put mingw on gcc code path (#16101)
* Supported mingw-w64

* Supported mingw-w64

* Supported mingw-w64
2023-05-17 00:47:55 +04:00
Mingyu Kim 5d9424f84d
[doc] typo (#17528)
* [doc] typo

* [doc] more typo

* [doc] more typo
2023-05-15 17:45:53 +04:00
Ilya Lavrenov 7743e175b7
Warn if OpenVINO symbols require new CXX ABI (#16080)
* Warn if OpenVINO symbols require new CXX ABI

* Fixed warnings / errors on Windows
2023-04-29 01:17:52 +01:00
Maksim Doronin 9776f4d11f
Fix enable_plugins_xml (#17294) 2023-04-29 00:02:49 +04:00
Ilya Lavrenov 1ec22a3180
32 bits support in Intel CPU plugin (#16900) 2023-04-19 22:10:20 +04:00
Ilya Lavrenov 85f9d1392c
Used cmake interface in ARM compute (#16929) 2023-04-13 22:35:03 +04:00
Gorokhov Dmitriy c283d21215
[CPU] ARM architecture support (#15256)
* [CPU] ARM architecture support

This patch extends existing CPU plugin capabilities with ARM CPUs optimized support
2023-04-12 18:42:05 +04:00
Ilya Lavrenov 2638014d00
Enable build with system version of snappy (#16549)
* Enable build with system version of snappy

* Create Snappy::snappy alia
2023-03-27 10:01:11 +04:00
Georgy Krivoruchko c5b348dd4f
[POC][TF FE] Support SavedModel format (with compression) (#16317)
* Added Saved Model proto descriptors

* Included Google's protobuf repository

* Added wstring version of ov::util::directory_exists

* Added initial implementation of Saved Model iterator

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Added missing proto files to repository

* Implemented reading of variables index and data files

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Renamed class

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Fix for cross-platform directory_exists

* Fixed codestyle and simplified code

* CI fixes

* Separeted Saved Model iterator from Proto iterator

* Moved variables index into separate class

* Added initial implementation of reading a variables from
saved model

# Conflicts:
#	src/frontends/tensorflow/src/frontend.cpp

* Added external variable mapping

* Code cleanup

* Commit is for discussion purposes!!!
Implemented RestoreV2 with a workaround for strings
Not optimized, includes mem leak

* In progress...

* Added DT_STRING coverage into decoder_proto

* m_variables_index moved into underlying class

* Updated copyrgihts, added space between license and code

* Moved string constant to separate class

* Added AssignVariableOp operation

* Changed behavior of RestoreV2
Updated stubs for other ops

* Second working implementation, enabled:
Program-only models
Variables reading from data files

* Extended docs

* Fixed dynamic type

* Fixed naming

* Added Snappy submodule to support compression in TF FE

* Enabled Snappy Compression for TF FE

* Make static linkage of Snappy
Changing Warning as error behavior for 3rd party

* CI fixes

* Added Snappy copyright info

* Aligned behavior of StringConstant with UnsupportedConstant

* Added correct naming and removing unused inputs/outputs
2023-03-24 15:07:16 +04:00
Ilya Churaev c23a1170ba
Remove plugins xml (#16470)
* Update core_impl.cpp

Add first implementation of register_compile_time_plugins (needs to depend on the actual CMake configuration as a next step).

* Update core.cpp

Check for missing plugins.xml

* Update core_impl.cpp

Avoid exception for missing plugins.xml

* Update core_impl.hpp

Add register_compile_time_plugins function definition

* Plugin loading based on CMake configuration

* Remove debug output command

* Unify static/dynamic plugin loading

* Add CMake option for plugins.xml that defaults to off

* Move GENERATE_PLUGINS_XML option to features.cmake

* Add missing brace

* Remove unnecessary #ifdef check

* Prepare to resolve conflicts

* Fix compile error

* Activate generation of plugins.xml in OpenVINODeveloperPackageConfig.cmake

* Fix CMake installation

* Plugin loading logic implemented in ie_core.cpp as well

* Fix format

* Small fixes

* Fixed code style

* Skip if xml file wasn't found

* Added function to find compiled plugins

* Generalize plugins hpp

* Use new API

* Fixed old core

* Fixed static build

---------

Co-authored-by: CSBVision <bjoern.boeken@csb.com>
2023-03-22 15:51:07 +00:00
Ilya Lavrenov 0d798b7431
Building GPU plugin for Linux ARM64 (#16008)
* Building GPU plugin for ARM64

* changed order of headers

* Fixed clang-format
2023-03-02 12:43:33 +04:00