openvino/src/inference
Xuejun Zhai daba3713c0
[Wrapper] Avoid creating new threads when converting legacy inference request to API 2.0 (#19376)
* Fix error in CVS-115961, caused by wrapper covert 1.0 req to 2.0 req create 2 more threads

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

* Eable the test of compareAutoBatchingToSingleBatch with batch size 4 & num req 64, after fix issue 115961

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>

---------

Signed-off-by: Zhai, Xuejun <xuejun.zhai@intel.com>
2023-08-24 11:46:02 +04:00
..
dev_api [CPU] Add max_threads_per_core setting into StreamExecutor (#18857) 2023-08-11 14:12:38 +00:00
docs [DOCS] Link adjustment for dev docs + fix to build.md CPU link for master (#17744) 2023-05-31 13:27:20 +04:00
include [EISW-89824] [master] Rename VPUX to NPU (#19004) 2023-08-10 00:20:07 +04:00
src [Wrapper] Avoid creating new threads when converting legacy inference request to API 2.0 (#19376) 2023-08-24 11:46:02 +04:00
tests [CPU] Add max_threads_per_core setting into StreamExecutor (#18857) 2023-08-11 14:12:38 +00:00
CMakeLists.txt Proxy plugin 2.0 (#17416) 2023-07-07 13:45:20 +04:00
README.md DOCS: Developer documentation Inference component update (#13895) 2022-11-08 07:42:10 +04:00

README.md

OpenVINO™ Inference

OpenVINO Inference is a part of the OpenVINO Runtime library. The component is responsible for model inference on hardware devices and provides API for OpenVINO Plugin development.

OpenVINO Inference uses the common coding style rules.

Key contacts

People from the openvino-ie-maintainers group have the rights to approve and merge PRs to the inference component. They can assist with any questions about the component.

Components

OpenVINO Inference has the following structure:

  • dev_api contains developer API required to develop OpenVINO Plugins. To use this API, link your component against openvino::runtime::dev.
  • include contains public API. Find more information in the OpenVINO Inference API document.
  • src contains sources of the component.

OpenVINO Inference has unit and functional tests. Unit tests are located in src/tests/unit/inference_engine, functional tests are located in src/tests/functional/inference_engine.

See also