openvino/src/inference
yanlan song 14e0b1fd2c
Do not clean batch setting if proxy plugin (#19508)
* do not clean batch setting if proxy plugin

Signed-off-by: fishbell <bell.song@intel.com>

* add tests

Signed-off-by: fishbell <bell.song@intel.com>

---------

Signed-off-by: fishbell <bell.song@intel.com>
2023-09-07 07:47:45 +04:00
..
dev_api Remove some legacy headers from inference component (#19325) 2023-08-23 15:13:30 +04:00
docs [DOCS] Link adjustment for dev docs + fix to build.md CPU link for master (#17744) 2023-05-31 13:27:20 +04:00
include Increment OV version to 2023.2.0 (#19248) 2023-08-17 15:03:14 +02:00
src Do not clean batch setting if proxy plugin (#19508) 2023-09-07 07:47:45 +04:00
tests Move Inference Functional Caching Tests to new API (#19513) 2023-09-05 00:42:11 +04:00
CMakeLists.txt Rename cmake ie_ macros and ie_parallel script (#19606) 2023-09-05 19:31:52 +02:00
README.md DOCS: Developer documentation Inference component update (#13895) 2022-11-08 07:42:10 +04:00

README.md

OpenVINO™ Inference

OpenVINO Inference is a part of the OpenVINO Runtime library. The component is responsible for model inference on hardware devices and provides API for OpenVINO Plugin development.

OpenVINO Inference uses the common coding style rules.

Key contacts

People from the openvino-ie-maintainers group have the rights to approve and merge PRs to the inference component. They can assist with any questions about the component.

Components

OpenVINO Inference has the following structure:

  • dev_api contains developer API required to develop OpenVINO Plugins. To use this API, link your component against openvino::runtime::dev.
  • include contains public API. Find more information in the OpenVINO Inference API document.
  • src contains sources of the component.

OpenVINO Inference has unit and functional tests. Unit tests are located in src/tests/unit/inference_engine, functional tests are located in src/tests/functional/inference_engine.

See also