[DOCS] README files for Samples + name update for Get Started for master (#21157)
This commit is contained in:
Maciej Smyk
GitHub
parent
90437f7efa
commit
95accde9df
|
|
@ -0,0 +1,43 @@
|
|||
# Hello Classification C Sample
|
||||
|
||||
This sample demonstrates how to execute an inference of image classification networks like AlexNet and GoogLeNet using Synchronous Inference Request API and input auto-resize feature.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_c_samples_hello_classification_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ---------------------------| ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [alexnet](https://docs.openvino.ai/2023.2/omz_models_model_alexnet.html), [googlenet-v1](https://docs.openvino.ai/2023.2/omz_models_model_googlenet_v1.html) |
|
||||
| Model Format | Inference Engine Intermediate Representation (\*.xml + \*.bin), ONNX (\*.onnx) |
|
||||
| Validated images | The sample uses OpenCV\* to [read input image](https://docs.opencv.org/master/d4/da8/group__imgcodecs.html#ga288b8b3da0892bd651fce07b3bbd3a56) (\*.bmp, \*.png) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C++](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_classification_README.html), |
|
||||
| | [Python](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_hello_classification_README.html) |
|
||||
|
||||
Hello Classification C sample application demonstrates how to use the C API from OpenVINO in applications.
|
||||
|
||||
| Feature | API | Description |
|
||||
| -------------------------| ------------------------------------------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| OpenVINO Runtime Version | ``ov_get_openvino_version`` | Get Openvino API version. |
|
||||
| Basic Infer Flow | ``ov_core_create``, | Common API to do inference: read and compile a model, create an infer request, configure input and output tensors |
|
||||
| | ``ov_core_read_model``, | |
|
||||
| | ``ov_core_compile_model``, | |
|
||||
| | ``ov_compiled_model_create_infer_request``, | |
|
||||
| | ``ov_infer_request_set_input_tensor_by_index``, | |
|
||||
| | ``ov_infer_request_get_output_tensor_by_index`` | |
|
||||
| Synchronous Infer | ``ov_infer_request_infer`` | Do synchronous inference |
|
||||
| Model Operations | ``ov_model_const_input``, | Get inputs and outputs of a model |
|
||||
| | ``ov_model_const_output`` | |
|
||||
| Tensor Operations | ``ov_tensor_create_from_host_ptr`` | Create a tensor shape |
|
||||
| Preprocessing | ``ov_preprocess_prepostprocessor_create``, | Set image of the original size as input for a model with other input size. Resize and layout conversions are performed automatically by the corresponding plugin just before inference. |
|
||||
| | ``ov_preprocess_prepostprocessor_get_input_info_by_index``, | |
|
||||
| | ``ov_preprocess_input_info_get_tensor_info``, | |
|
||||
| | ``ov_preprocess_input_tensor_info_set_from``, | |
|
||||
| | ``ov_preprocess_input_tensor_info_set_layout``, | |
|
||||
| | ``ov_preprocess_input_info_get_preprocess_steps``, | |
|
||||
| | ``ov_preprocess_preprocess_steps_resize``, | |
|
||||
| | ``ov_preprocess_input_model_info_set_layout``, | |
|
||||
| | ``ov_preprocess_output_set_element_type``, | |
|
||||
| | ``ov_preprocess_prepostprocessor_build`` | |
|
||||
|
||||
|
|
@ -0,0 +1,33 @@
|
|||
# Hello NV12 Input Classification C Sample
|
||||
|
||||
This sample demonstrates how to execute an inference of image classification networks like AlexNet with images in NV12 color format using Synchronous Inference Request API.
|
||||
|
||||
Hello NV12 Input Classification C Sample demonstrates how to use the NV12 automatic input pre-processing API in your applications.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_c_samples_hello_nv12_input_classification_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| ---------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [alexnet](https://docs.openvino.ai/2023.2/omz_models_model_alexnet.html) |
|
||||
| Model Format | Inference Engine Intermediate Representation (\*.xml + \*.bin), ONNX (\*.onnx) |
|
||||
| Validated images | An uncompressed image in the NV12 color format - \*.yuv |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C++](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_nv12_input_classification_README.html) |
|
||||
|
||||
The following C++ API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| --------------------------| ----------------------------------------------------------|--------------------------------------------------------|
|
||||
| Node Operations | ``ov_port_get_any_name`` | Get a layer name |
|
||||
| Infer Request Operations | ``ov_infer_request_set_tensor``, | Operate with tensors |
|
||||
| | ``ov_infer_request_get_output_tensor_by_index`` | |
|
||||
| Preprocessing | ``ov_preprocess_input_tensor_info_set_color_format``, | Change the color format of the input data |
|
||||
| | ``ov_preprocess_preprocess_steps_convert_element_type``, | |
|
||||
| | ``ov_preprocess_preprocess_steps_convert_color`` | |
|
||||
|
||||
|
||||
Basic Inference Engine API is covered by [Hello Classification C sample](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_c_samples_hello_classification_README.html).
|
||||
|
||||
|
||||
|
|
@ -0,0 +1,31 @@
|
|||
# Sync Benchmark C++ Sample
|
||||
|
||||
This sample demonstrates how to estimate performance of a model using Synchronous Inference Request API. It makes sense to use synchronous inference only in latency oriented scenarios. Models with static input shapes are supported. Unlike [demos](https://docs.openvino.ai/2023.2/omz_demos.html) this sample doesn't have other configurable command line arguments. Feel free to modify sample's source code to try out different options.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_sync_benchmark_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| -------------------------------| -------------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [alexnet](https://docs.openvino.ai/nightly/omz_models_model_alexnet.html), |
|
||||
| | [googlenet-v1](https://docs.openvino.ai/nightly/omz_models_model_googlenet_v1.html), |
|
||||
| | [yolo-v3-tf](https://docs.openvino.ai/nightly/omz_models_model_yolo_v3_tf.html), |
|
||||
| | [face-detection-0200](https://docs.openvino.ai/nightly/omz_models_model_face_detection_0200.html) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation |
|
||||
| | (\*.xml + \*.bin), ONNX (\*.onnx) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [Python](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_sync_benchmark_README.html) |
|
||||
|
||||
The following C++ API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| -------------------------| ---------------------------------------------|----------------------------------------------|
|
||||
| OpenVINO Runtime Version | ``ov::get_openvino_version`` | Get Openvino API version. |
|
||||
| Basic Infer Flow | ``ov::Core``, ``ov::Core::compile_model``, | Common API to do inference: compile a model, |
|
||||
| | ``ov::CompiledModel::create_infer_request``, | create an infer request, |
|
||||
| | ``ov::InferRequest::get_tensor`` | configure input tensors. |
|
||||
| Synchronous Infer | ``ov::InferRequest::infer``, | Do synchronous inference. |
|
||||
| Model Operations | ``ov::CompiledModel::inputs`` | Get inputs of a model. |
|
||||
| Tensor Operations | ``ov::Tensor::get_shape``, | Get a tensor shape and its data. |
|
||||
| | ``ov::Tensor::data`` | |
|
||||
|
|
@ -0,0 +1,36 @@
|
|||
# Throughput Benchmark C++ Sample
|
||||
|
||||
This sample demonstrates how to estimate performance of a model using Asynchronous Inference Request API in throughput mode. Unlike [demos](https://docs.openvino.ai/2023.2/omz_demos.html) this sample doesn't have other configurable command line arguments. Feel free to modify sample's source code to try out different options.
|
||||
|
||||
The reported results may deviate from what [benchmark_app](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_benchmark_app_README.html) reports. One example is model input precision for computer vision tasks. benchmark_app sets ``uint8``, while the sample uses default model precision which is usually ``float32``.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_throughput_benchmark_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| -------------------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [alexnet](https://docs.openvino.ai/nightly/omz_models_model_alexnet.html), |
|
||||
| | [googlenet-v1](https://docs.openvino.ai/nightly/omz_models_model_googlenet_v1.html), |
|
||||
| | [yolo-v3-tf](https://docs.openvino.ai/nightly/omz_models_model_yolo_v3_tf.html), |
|
||||
| | [face-detection-](https://docs.openvino.ai/nightly/omz_models_model_face_detection_0200.html) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation |
|
||||
| | (\*.xml + \*.bin), ONNX (\*.onnx) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [Python](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_throughput_benchmark_README.html) |
|
||||
|
||||
The following C++ API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| -------------------------| ---------------------------------------------|----------------------------------------------|
|
||||
| OpenVINO Runtime Version | ``ov::get_openvino_version`` | Get Openvino API version. |
|
||||
| Basic Infer Flow | ``ov::Core``, ``ov::Core::compile_model``, | Common API to do inference: compile a model, |
|
||||
| | ``ov::CompiledModel::create_infer_request``, | create an infer request, |
|
||||
| | ``ov::InferRequest::get_tensor`` | configure input tensors. |
|
||||
| Asynchronous Infer | ``ov::InferRequest::start_async``, | Do asynchronous inference with callback. |
|
||||
| | ``ov::InferRequest::set_callback`` | |
|
||||
| Model Operations | ``ov::CompiledModel::inputs`` | Get inputs of a model. |
|
||||
| Tensor Operations | ``ov::Tensor::get_shape``, | Get a tensor shape and its data. |
|
||||
| | ``ov::Tensor::data`` | |
|
||||
|
||||
|
||||
|
|
@ -0,0 +1,15 @@
|
|||
# Benchmark C++ Tool
|
||||
|
||||
This page demonstrates how to use the Benchmark C++ Tool to estimate deep learning inference performance on supported devices.
|
||||
|
||||
> **NOTE**: This page describes usage of the C++ implementation of the Benchmark Tool. For the Python implementation, refer to the [Benchmark Python Tool](https://docs.openvino.ai/2023.2/openvino_inference_engine_tools_benchmark_tool_README.html) page. The Python version is recommended for benchmarking models that will be used in Python applications, and the C++ version is recommended for benchmarking models that will be used in C++ applications. Both tools have a similar command interface and backend.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_benchmark_app_README.html)
|
||||
|
||||
## Requriements
|
||||
|
||||
To use the C++ benchmark_app, you must first build it following the [Build the Sample Applications](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_Samples_Overview.html) instructions and then set up paths and environment variables by following the [Get Ready for Running the Sample Applications](https://docs.openvino.ai/2023.2/openvino_docs_get_started_get_started_demos.html) instructions. Navigate to the directory where the benchmark_app C++ sample binary was built.
|
||||
|
||||
> **NOTE**: If you installed OpenVINO Runtime using PyPI or Anaconda Cloud, only the [Benchmark Python Tool](https://docs.openvino.ai/2023.2/openvino_inference_engine_tools_benchmark_tool_README.html) is available, and you should follow the usage instructions on that page instead.
|
||||
|
||||
The benchmarking application works with models in the OpenVINO IR, TensorFlow, TensorFlow Lite, PaddlePaddle, PyTorch and ONNX formats. If you need it, OpenVINO also allows you to [convert your models](https://docs.openvino.ai/2023.2/openvino_docs_MO_DG_Deep_Learning_Model_Optimizer_DevGuide.html).
|
||||
|
|
@ -0,0 +1,29 @@
|
|||
# Image Classification Async C++ Sample
|
||||
|
||||
This sample demonstrates how to do inference of image classification models using Asynchronous Inference Request API.
|
||||
|
||||
Models with only one input and output are supported.
|
||||
|
||||
In addition to regular images, the sample also supports single-channel ``ubyte`` images as an input for LeNet model.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_classification_sample_async_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ---------------------------| -------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [alexnet](https://docs.openvino.ai/2023.2/omz_models_model_alexnet.html), |
|
||||
| | [googlenet-v1](https://docs.openvino.ai/2023.2/omz_models_model_googlenet_v1.html) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation (\*.xml + \*.bin), ONNX (\*.onnx) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [Python](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_classification_sample_async_README.html) |
|
||||
|
||||
The following C++ API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| -------------------------| ----------------------------------------------------------------------|----------------------------------------------------------------------------------------|
|
||||
| Asynchronous Infer | ``ov::InferRequest::start_async``, ``ov::InferRequest::set_callback`` | Do asynchronous inference with callback. |
|
||||
| Model Operations | ``ov::Output::get_shape``, ``ov::set_batch`` | Manage the model, operate with its batch size. Set batch size using input image count. |
|
||||
| Infer Request Operations | ``ov::InferRequest::get_input_tensor`` | Get an input tensor. |
|
||||
| Tensor Operations | ``ov::shape_size``, ``ov::Tensor::data`` | Get a tensor shape size and its data. |
|
||||
|
||||
|
|
@ -0,0 +1,40 @@
|
|||
# Hello Classification C++ Sample
|
||||
|
||||
This sample demonstrates how to do inference of image classification models using Synchronous Inference Request API.
|
||||
|
||||
Models with only one input and output are supported.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_classification_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| ------------------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [alexnet](https://docs.openvino.ai/2023.2/omz_models_model_alexnet.html), |
|
||||
| | [googlenet-v1](https://docs.openvino.ai/2023.2/omz_models_model_googlenet_v1.html) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation (\*.xml + \*.bin), ONNX (\*.onnx) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_c_samples_hello_classification_README.html), |
|
||||
| | [Python](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_hello_classification_README.html) |
|
||||
|
||||
The following C++ API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| --------------------------| ---------------------------------------------------------------|----------------------------------------------------------------------------------------|
|
||||
| OpenVINO Runtime Version | ``ov::get_openvino_version`` | Get Openvino API version |
|
||||
| Basic Infer Flow | ``ov::Core::read_model``, | Common API to do inference: read and compile a model, create an infer request, |
|
||||
| | ``ov::Core::compile_model``, | configure input and output tensors |
|
||||
| | ``ov::CompiledModel::create_infer_request``, | |
|
||||
| | ``ov::InferRequest::set_input_tensor``, | |
|
||||
| | ``ov::InferRequest::get_output_tensor`` | |
|
||||
| Synchronous Infer | ``ov::InferRequest::infer`` | Do synchronous inference |
|
||||
| Model Operations | ``ov::Model::inputs``, | Get inputs and outputs of a model |
|
||||
| | ``ov::Model::outputs`` | |
|
||||
| Tensor Operations | ``ov::Tensor::get_shape`` | Get a tensor shape |
|
||||
| Preprocessing | ``ov::preprocess::InputTensorInfo::set_element_type``, | Set image of the original size as input for a model with other input size. Resize |
|
||||
| | ``ov::preprocess::InputTensorInfo::set_layout``, | and layout conversions are performed automatically by the corresponding plugin |
|
||||
| | ``ov::preprocess::InputTensorInfo::set_spatial_static_shape``, | just before inference. |
|
||||
| | ``ov::preprocess::PreProcessSteps::resize``, | |
|
||||
| | ``ov::preprocess::InputModelInfo::set_layout``, | |
|
||||
| | ``ov::preprocess::OutputTensorInfo::set_element_type``, | |
|
||||
| | ``ov::preprocess::PrePostProcessor::build`` | |
|
||||
|
|
@ -0,0 +1,31 @@
|
|||
# Hello NV12 Input Classification C++ Sample
|
||||
|
||||
This sample demonstrates how to execute an inference of image classification models with images in NV12 color format using Synchronous Inference Request API.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_nv12_input_classification_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| --------------------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [alexnet <omz_models_model_alexnet](https://docs.openvino.ai/2023.2/omz_models_model_alexnet.html) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation (\*.xml + \*.bin), ONNX (\*.onnx) |
|
||||
| Validated images | An uncompressed image in the NV12 color format - \*.yuv |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_c_samples_hello_nv12_input_classification_README.html) |
|
||||
|
||||
|
||||
The following C++ API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| -------------------------| ------------------------------------------------------------|-------------------------------------------|
|
||||
| Node Operations | ``ov::Output::get_any_name`` | Get a layer name |
|
||||
| Infer Request Operations | ``ov::InferRequest::set_tensor``, | Operate with tensors |
|
||||
| | ``ov::InferRequest::get_tensor`` | |
|
||||
| Preprocessing | ``ov::preprocess::InputTensorInfo::set_color_format``, | Change the color format of the input data |
|
||||
| | ``ov::preprocess::PreProcessSteps::convert_element_type``, | |
|
||||
| | ``ov::preprocess::PreProcessSteps::convert_color`` | |
|
||||
|
||||
|
||||
Basic OpenVINO™ Runtime API is covered by [Hello Classification C++ sample](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_classification_README.html).
|
||||
|
||||
|
|
@ -0,0 +1,21 @@
|
|||
# Hello Query Device C++ Sample
|
||||
|
||||
This sample demonstrates how to execute an query OpenVINO™ Runtime devices, prints their metrics and default configuration values, using [Properties API](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_query_api.html).
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_query_device_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ------------------------------| ----------------------------------------------------------------------------------------------------------------------------|
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [Python](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_hello_query_device_README.html) |
|
||||
|
||||
The following C++ API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| -------------------------| --------------------------------------|-------------------------------------------------------------------|
|
||||
| Available Devices | ``ov::Core::get_available_devices``, | Get available devices information and configuration for inference |
|
||||
| | ``ov::Core::get_property`` | |
|
||||
|
||||
Basic OpenVINO™ Runtime API is covered by [Hello Classification C++ sample](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_classification_README.html).
|
||||
|
|
@ -0,0 +1,32 @@
|
|||
# Hello Reshape SSD C++ Sample
|
||||
|
||||
This sample demonstrates how to do synchronous inference of object detection models using [input reshape feature](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_ShapeInference.html).
|
||||
Models with only one input and output are supported.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_reshape_ssd_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| -----------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [person-detection-retail-0013](https://docs.openvino.ai/nightly/omz_models_model_person_detection_retail_0013.html) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation (\*.xml + \*.bin), ONNX (\*.onnx) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [Python](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_hello_reshape_ssd_README.html) |
|
||||
|
||||
The following C++ API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| -------------------------| ------------------------------------------------------------|------------------------------------------------|
|
||||
| Node operations | ``ov::Node::get_type_info``, | Get a node info |
|
||||
| | ``ngraph::op::DetectionOutput::get_type_info_static``, | |
|
||||
| | ``ov::Output::get_any_name``, | |
|
||||
| | ``ov::Output::get_shape`` | |
|
||||
| Model Operations | ``ov::Model::get_ops``, | Get model nodes, reshape input |
|
||||
| | ``ov::Model::reshape`` | |
|
||||
| Tensor Operations | ``ov::Tensor::data`` | Get a tensor data |
|
||||
| Preprocessing | ``ov::preprocess::PreProcessSteps::convert_element_type``, | Model input preprocessing |
|
||||
| | ``ov::preprocess::PreProcessSteps::convert_layout`` | |
|
||||
|
||||
|
||||
Basic OpenVINO™ Runtime API is covered by [Hello Classification C++ sample](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_classification_README.html).
|
||||
|
|
@ -0,0 +1,46 @@
|
|||
# Model Creation C++ Sample
|
||||
|
||||
This sample demonstrates how to execute an synchronous inference using [model](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_Model_Representation.html) built on the fly which uses weights from LeNet classification model, which is known to work well on digit classification tasks.
|
||||
|
||||
You do not need an XML file to create a model. The API of ov::Model allows creating a model on the fly from the source code.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_model_creation_sample_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| -------------------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | LeNet |
|
||||
| Model Format | model weights file (\*.bin) |
|
||||
| Validated images | single-channel ``MNIST ubyte`` images |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [Python](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_model_creation_sample_README.html) |
|
||||
|
||||
The following C++ API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| --------------------------| ----------------------------------------|---------------------------------------|
|
||||
| OpenVINO Runtime Info | ``ov::Core::get_versions`` | Get device plugins versions |
|
||||
| Shape Operations | ``ov::Output::get_shape``, | Operate with shape |
|
||||
| | ``ov::Shape::size``, | |
|
||||
| | ``ov::shape_size`` | |
|
||||
| Tensor Operations | ``ov::Tensor::get_byte_size``, | Get tensor byte size and its data |
|
||||
| | ``ov::Tensor:data`` | |
|
||||
| Model Operations | ``ov::set_batch`` | Operate with model batch size |
|
||||
| Infer Request Operations | ``ov::InferRequest::get_input_tensor`` | Get a input tensor |
|
||||
| Model creation objects | ``ov::opset8::Parameter``, | Used to construct an OpenVINO model |
|
||||
| | ``ov::Node::output``, | |
|
||||
| | ``ov::opset8::Constant``, | |
|
||||
| | ``ov::opset8::Convolution``, | |
|
||||
| | ``ov::opset8::Add``, | |
|
||||
| | ``ov::opset1::MaxPool``, | |
|
||||
| | ``ov::opset8::Reshape``, | |
|
||||
| | ``ov::opset8::MatMul``, | |
|
||||
| | ``ov::opset8::Relu``, | |
|
||||
| | ``ov::opset8::Softmax``, | |
|
||||
| | ``ov::descriptor::Tensor::set_names``, | |
|
||||
| | ``ov::opset8::Result``, | |
|
||||
| | ``ov::Model``, | |
|
||||
| | ``ov::ParameterVector::vector`` | |
|
||||
|
||||
Basic OpenVINO™ Runtime API is covered by [Hello Classification C++ sample](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_classification_README.html).
|
||||
|
|
@ -0,0 +1,38 @@
|
|||
# Automatic Speech Recognition C++ Sample
|
||||
|
||||
> **NOTE**: This sample is being deprecated and will no longer be maintained after OpenVINO 2023.2 (LTS). The main reason for it is the outdated state of the sample and its extensive usage of GNA, which is not going to be supported by OpenVINO beyond 2023.2.
|
||||
|
||||
This sample demonstrates how to execute an Asynchronous Inference of acoustic model based on Kaldi\* neural networks and speech feature vectors.
|
||||
|
||||
The sample works with Kaldi ARK or Numpy* uncompressed NPZ files, so it does not cover an end-to-end speech recognition scenario (speech to text), requiring additional preprocessing (feature extraction) to get a feature vector from a speech signal, as well as postprocessing (decoding) to produce text from scores.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_speech_sample_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ---------------------------| -----------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | Acoustic model based on Kaldi\* neural networks (see |
|
||||
| | [Model Preparation](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_speech_sample_README.html) |
|
||||
| | section) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation (*.xml + *.bin) |
|
||||
| Supported devices | See [Execution Modes](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_speech_sample_README.html#execution-modes) |
|
||||
| | section below and [List Supported Devices](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
|
||||
The following C++ API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| -------------------------| ------------------------------------------------------------------------------|------------------------------------------------------------------------------|
|
||||
| Available Devices | ``ov::Core::get_available_devices``, ``ov::Core::get_property`` | Get information of the devices for inference |
|
||||
| Import/Export Model | ``ov::Core::import_model``, ``ov::CompiledModel::export_model`` | The GNA plugin supports loading and saving of the GNA-optimized model |
|
||||
| Model Operations | ``ov::set_batch``, ``ov::Model::add_output``, ``ov::CompiledModel::inputs``, | |
|
||||
| | ``ov::CompiledModel::outputs`` | Managing of model: configure batch_size, input and output tensors |
|
||||
| Node Operations | ``ov::OutputVector::size``, ``ov::Output::get_shape`` | Get node shape |
|
||||
| Asynchronous Infer | ``ov::InferRequest::start_async``, ``ov::InferRequest::wait`` | Do asynchronous inference and waits until inference result becomes available |
|
||||
| InferRequest Operations | ``ov::InferRequest::query_state``, ``ov::VariableState::reset`` | Gets and resets CompiledModel state control |
|
||||
| Tensor Operations | ``ov::Tensor::get_size``, ``ov::Tensor::data``, | |
|
||||
| | ``ov::InferRequest::get_tensor`` | Get a tensor, its size and data |
|
||||
| Profiling | ``ov::InferRequest::get_profiling_info`` | Get infer request profiling info |
|
||||
|
||||
|
||||
Basic OpenVINO™ Runtime API is covered by [Hello Classification C++ sample](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_classification_README.html).
|
||||
|
|
@ -0,0 +1,21 @@
|
|||
# Bert Benchmark Python Sample
|
||||
|
||||
This sample demonstrates how to estimate performance of a Bert model using Asynchronous Inference Request API. Unlike [demos](https://docs.openvino.ai/2023.2/omz_demos.html) this sample doesn't have configurable command line arguments. Feel free to modify sample's source code to try out different options.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_bert_benchmark_README.html)
|
||||
|
||||
The sample downloads a model and a tokenizer, export the model to onnx, reads the exported model and reshapes it to enforce dynamic input shapes, compiles the resulting model, downloads a dataset and runs benchmarking on the dataset.
|
||||
|
||||
## Requirements
|
||||
|
||||
The following Python API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| -------------------------| ------------------------------------------------|----------------------------------------------|
|
||||
| OpenVINO Runtime Version | [openvino.runtime.get_version] | Get Openvino API version. |
|
||||
| Basic Infer Flow | [openvino.runtime.Core], | Common API to do inference: compile a model. |
|
||||
| | [openvino.runtime.Core.compile_model] | |
|
||||
| Asynchronous Infer | [openvino.runtime.AsyncInferQueue], | Do asynchronous inference. |
|
||||
| | [openvino.runtime.AsyncInferQueue.start_async], | |
|
||||
| | [openvino.runtime.AsyncInferQueue.wait_all] | |
|
||||
| Model Operations | [openvino.runtime.CompiledModel.inputs] | Get inputs of a model. |
|
||||
|
|
@ -0,0 +1,31 @@
|
|||
# Sync Benchmark Python Sample
|
||||
|
||||
This sample demonstrates how to estimate performance of a model using Synchronous Inference Request API. It makes sense to use synchronous inference only in latency oriented scenarios. Models with static input shapes are supported. Unlike [demos](https://docs.openvino.ai/2023.2/omz_demos.html) this sample doesn't have other configurable command line arguments. Feel free to modify sample's source code to try out different options.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_sync_benchmark_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| -----------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [alexnet](https://docs.openvino.ai/2023.2/omz_models_model_alexnet.html), |
|
||||
| | [googlenet-v1](https://docs.openvino.ai/2023.2/omz_models_model_googlenet_v1.html), |
|
||||
| | [yolo-v3-tf](https://docs.openvino.ai/2023.2/omz_models_model_yolo_v3_tf.html), |
|
||||
| | [face-detection-0200](https://docs.openvino.ai/2023.2/omz_models_model_face_detection_0200.html) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation |
|
||||
| | (\*.xml + \*.bin), ONNX (\*.onnx) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C++](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_sync_benchmark_README.html) |
|
||||
|
||||
The following Python API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| --------------------------| ------------------------------------------------|----------------------------------------------|
|
||||
| OpenVINO Runtime Version | [openvino.runtime.get_version] | Get Openvino API version. |
|
||||
| Basic Infer Flow | [openvino.runtime.Core], | Common API to do inference: compile a model, |
|
||||
| | [openvino.runtime.Core.compile_model], | configure input tensors. |
|
||||
| | [openvino.runtime.InferRequest.get_tensor] | |
|
||||
| Synchronous Infer | [openvino.runtime.InferRequest.infer], | Do synchronous inference. |
|
||||
| Model Operations | [openvino.runtime.CompiledModel.inputs] | Get inputs of a model. |
|
||||
| Tensor Operations | [openvino.runtime.Tensor.get_shape], | Get a tensor shape and its data. |
|
||||
| | [openvino.runtime.Tensor.data] | |
|
||||
|
|
@ -0,0 +1,37 @@
|
|||
# Throughput Benchmark Python Sample
|
||||
|
||||
This sample demonstrates how to estimate performance of a model using Asynchronous Inference Request API in throughput mode. Unlike [demos](https://docs.openvino.ai/2023.2/omz_demos.html) this sample doesn't have other configurable command line arguments. Feel free to modify sample's source code to try out different options.
|
||||
|
||||
The reported results may deviate from what [benchmark_app](https://docs.openvino.ai/2023.2/openvino_inference_engine_tools_benchmark_tool_README.html) reports. One example is model input precision for computer vision tasks. benchmark_app sets uint8, while the sample uses default model precision which is usually float32.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_sync_benchmark_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| -------------------------------| -----------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [alexnet](https://docs.openvino.ai/2023.2/omz_models_model_alexnet.html), |
|
||||
| | [googlenet-v1](https://docs.openvino.ai/2023.2/omz_models_model_googlenet_v1.html), |
|
||||
| | [yolo-v3-tf](https://docs.openvino.ai/2023.2/omz_models_model_yolo_v3_tf.html) |
|
||||
| | [face-detection-0200](https://docs.openvino.ai/2023.2/omz_models_model_face_detection_0200.html) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation |
|
||||
| | (\*.xml + \*.bin), ONNX (\*.onnx) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C++](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_sync_benchmark_README.html) |
|
||||
|
||||
The following Python API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| --------------------------| ------------------------------------------------|----------------------------------------------|
|
||||
| OpenVINO Runtime Version | [openvino.runtime.get_version] | Get Openvino API version. |
|
||||
| Basic Infer Flow | [openvino.runtime.Core], | Common API to do inference: compile a model, |
|
||||
| | [openvino.runtime.Core.compile_model] | configure input tensors. |
|
||||
| | [openvino.runtime.InferRequest.get_tensor] | |
|
||||
| Asynchronous Infer | [openvino.runtime.AsyncInferQueue], | Do asynchronous inference. |
|
||||
| | [openvino.runtime.AsyncInferQueue.start_async], | |
|
||||
| | [openvino.runtime.AsyncInferQueue.wait_all], | |
|
||||
| | [openvino.runtime.InferRequest.results] | |
|
||||
| Model Operations | [openvino.runtime.CompiledModel.inputs] | Get inputs of a model. |
|
||||
| Tensor Operations | [openvino.runtime.Tensor.get_shape], | Get a tensor shape and its data. |
|
||||
| | [openvino.runtime.Tensor.data] | |
|
||||
|
||||
|
|
@ -0,0 +1,28 @@
|
|||
# Image Classification Async Python Sample
|
||||
|
||||
This sample demonstrates how to do inference of image classification models using Asynchronous Inference Request API.
|
||||
|
||||
Models with only 1 input and output are supported.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_classification_sample_async_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ---------------------------| -----------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [alexnet](https://docs.openvino.ai/2023.2/omz_models_model_alexnet.html) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation (.xml + .bin), ONNX (.onnx) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C++](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_classification_sample_async_README.html) |
|
||||
|
||||
The following Python API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| -------------------| ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|---------------------------|
|
||||
| Asynchronous Infer | [openvino.runtime.AsyncInferQueue](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.AsyncInferQueue.html), | Do asynchronous inference |
|
||||
| | [openvino.runtime.AsyncInferQueue.set_callback](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.AsyncInferQueue.html#openvino.runtime.AsyncInferQueue.set_callback), | |
|
||||
| | [openvino.runtime.AsyncInferQueue.start_async](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.AsyncInferQueue.html#openvino.runtime.AsyncInferQueue.start_async), | |
|
||||
| | [openvino.runtime.AsyncInferQueue.wait_all](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.AsyncInferQueue.html#openvino.runtime.AsyncInferQueue.wait_all), | |
|
||||
| | [openvino.runtime.InferRequest.results](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.InferRequest.html#openvino.runtime.InferRequest.results) | |
|
||||
|
||||
Basic OpenVINO™ Runtime API is covered by [Hello Classification Python Sample](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_hello_classification_README.html).
|
||||
|
|
@ -0,0 +1,38 @@
|
|||
# Hello Classification Python Sample
|
||||
|
||||
This sample demonstrates how to do inference of image classification models using Synchronous Inference Request API.
|
||||
|
||||
Models with only 1 input and output are supported.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_hello_classification_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| ----------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [alexnet](https://docs.openvino.ai/2023.2/omz_models_model_alexnet.html), |
|
||||
| | [googlenet-v1](https://docs.openvino.ai/2023.2/omz_models_model_googlenet_v1.html) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation (.xml + .bin), ONNX (.onnx) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C++](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_classification_README.html), |
|
||||
| | [C](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_c_samples_hello_classification_README.html) |
|
||||
|
||||
The following Python API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| ------------------| --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------------------------------------------------------------------------------|
|
||||
| Basic Infer Flow | [openvino.runtime.Core](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Core.html) , | |
|
||||
| | [openvino.runtime.Core.read_model](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Core.html#openvino.runtime.Core.read_model), | |
|
||||
| | [openvino.runtime.Core.compile_model](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Core.html#openvino.runtime.Core.compile_model) | Common API to do inference |
|
||||
| Synchronous Infer | [openvino.runtime.CompiledModel.infer_new_request](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.CompiledModel.html#openvino.runtime.CompiledModel.infer_new_request), | Do synchronous inference |
|
||||
| Model Operations | [openvino.runtime.Model.inputs](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Model.html#openvino.runtime.Model.inputs), | Managing of model |
|
||||
| | [openvino.runtime.Model.outputs](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Model.html#openvino.runtime.Model.outputs), | |
|
||||
| Preprocessing | [openvino.preprocess.PrePostProcessor](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.preprocess.PrePostProcessor.html), | Set image of the original size as input for a model with other input size. |
|
||||
| | [openvino.preprocess.InputTensorInfo.set_element_type](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.preprocess.InputTensorInfo.html#openvino.preprocess.InputTensorInfo.set_element_type), | Resize and layout conversions will be performed automatically by the corresponding plugin just before inference |
|
||||
| | [openvino.preprocess.InputTensorInfo.set_layout](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.preprocess.InputTensorInfo.html#openvino.preprocess.InputTensorInfo.set_layout), | |
|
||||
| | [openvino.preprocess.InputTensorInfo.set_spatial_static_shape](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.preprocess.InputTensorInfo.html#openvino.preprocess.InputTensorInfo.set_spatial_static_shape), | |
|
||||
| | [openvino.preprocess.PreProcessSteps.resize](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.preprocess.PreProcessSteps.html#openvino.preprocess.PreProcessSteps.resize), | |
|
||||
| | [openvino.preprocess.InputModelInfo.set_layout](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.preprocess.InputModelInfo.html#openvino.preprocess.InputModelInfo.set_layout), | |
|
||||
| | [openvino.preprocess.OutputTensorInfo.set_element_type](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.preprocess.OutputTensorInfo.html#openvino.preprocess.OutputTensorInfo.set_element_type), | |
|
||||
| | [openvino.preprocess.PrePostProcessor.build](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.preprocess.PrePostProcessor.html#openvino.preprocess.PrePostProcessor.build) | |
|
||||
|
||||
|
|
@ -0,0 +1,22 @@
|
|||
# Hello Query Device Python Sample
|
||||
|
||||
This sample demonstrates how to show OpenVINO™ Runtime devices and prints their metrics and default configuration values using [Query Device API feature](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_query_api.html).
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_hello_query_device_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| --------------------------------------------------------------------------------------------------------|
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C++](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_query_device_README.html) |
|
||||
|
||||
The following Python API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| --------------| ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------------------------|
|
||||
| Basic | [openvino.runtime.Core](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Core.html) | Common API |
|
||||
| Query Device | [openvino.runtime.Core.available_devices](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Core.html#openvino.runtime.Core.available_devices) , | Get device properties |
|
||||
| | [openvino.runtime.Core.get_metric](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.inference_engine.IECore.html#openvino.inference_engine.IECore.get_metric) , | |
|
||||
| | [openvino.runtime.Core.get_config](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.inference_engine.IECore.html#openvino.inference_engine.IECore.get_config) | |
|
||||
|
||||
|
|
@ -0,0 +1,26 @@
|
|||
# Hello Reshape SSD Python Sample
|
||||
|
||||
This sample demonstrates how to do synchronous inference of object detection models using [Shape Inference feature](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_ShapeInference.html).
|
||||
|
||||
Models with only 1 input and output are supported.
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| ---------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | [mobilenet-ssd](https://docs.openvino.ai/2023.2/omz_models_model_mobilenet_ssd.html) |
|
||||
| Validated Layout | NCHW |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation (.xml + .bin), ONNX (.onnx) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C++](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_hello_reshape_ssd_README.html) |
|
||||
|
||||
The following Python API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| -----------------| ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------------------|
|
||||
| Model Operations | [openvino.runtime.Model.reshape](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Model.html#openvino.runtime.Model.reshape), | Managing of model |
|
||||
| | [openvino.runtime.Model.input](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Model.html#openvino.runtime.Model.input), | |
|
||||
| | [openvino.runtime.Output.get_any_name](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Output.html#openvino.runtime.Output.get_any_name), | |
|
||||
| | [openvino.runtime.PartialShape](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.PartialShape.html) | |
|
||||
|
||||
Basic OpenVINO™ Runtime API is covered by [Hello Classification Python* Sample](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_hello_classification_README.html).
|
||||
|
|
@ -0,0 +1,33 @@
|
|||
# Model Creation Python Sample
|
||||
|
||||
This sample demonstrates how to run inference using a [model](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_Model_Representation.html) built on the fly that uses weights from the LeNet classification model, which is known to work well on digit classification tasks. You do not need an XML file, the model is created from the source code on the fly.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_model_creation_sample_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| ------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | LeNet |
|
||||
| Model Format | Model weights file (\*.bin) |
|
||||
| Supported devices | [All](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C++](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_model_creation_sample_README.html) |
|
||||
|
||||
The following OpenVINO Python API is used in the application:
|
||||
|
||||
| Feature | API | Description |
|
||||
| ------------------| ----------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------------------------|
|
||||
| Model Operations | [openvino.runtime.Model](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Model.html) , | Managing of model |
|
||||
| | [openvino.runtime.set_batch](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.set_batch.html) , | |
|
||||
| | [openvino.runtime.Model.input](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Model.html#openvino.runtime.Model.input) | |
|
||||
| Opset operations | [openvino.runtime.op.Parameter](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.op.Parameter.html), | Description of a model topology using OpenVINO Python API |
|
||||
| | [openvino.runtime.op.Constant](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.op.Constant.html) , | |
|
||||
| | [openvino.runtime.opset8.convolution](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.opset8.convolution.html) , | |
|
||||
| | [openvino.runtime.opset8.add](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.opset8.add.html) , | |
|
||||
| | [openvino.runtime.opset1.max_pool](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.opset1.max_pool.html) , | |
|
||||
| | [openvino.runtime.opset8.reshape](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.opset8.reshape.html) , | |
|
||||
| | [openvino.runtime.opset8.matmul](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.opset8.matmul.html) , | |
|
||||
| | [openvino.runtime.opset8.relu](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.opset8.relu.html) , | |
|
||||
| | [openvino.runtime.opset8.softmax](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.opset8.softmax.html) | |
|
||||
|
||||
Basic OpenVINO™ Runtime API is covered by [Hello Classification Python* Sample](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_hello_classification_README.html).
|
||||
|
|
@ -0,0 +1,43 @@
|
|||
# Automatic Speech Recognition Python Sample
|
||||
|
||||
> **NOTE**: This sample is being deprecated and will no longer be maintained after OpenVINO 2023.2 (LTS). The main reason for it is the outdated state of the sample and its extensive usage of GNA, which is not going to be supported by OpenVINO beyond 2023.2.
|
||||
|
||||
This sample demonstrates how to do a Synchronous Inference of acoustic model based on Kaldi\* neural models and speech feature vectors.
|
||||
|
||||
The sample works with Kaldi ARK or Numpy* uncompressed NPZ files, so it does not cover an end-to-end speech recognition scenario (speech to text), requiring additional preprocessing (feature extraction) to get a feature vector from a speech signal, as well as postprocessing (decoding) to produce text from scores.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_speech_sample_README.html)
|
||||
|
||||
## Requirements
|
||||
|
||||
| Options | Values |
|
||||
| ----------------------------| --------------------------------------------------------------------------------------------------------------------------------------------------------------|
|
||||
| Validated Models | Acoustic model based on Kaldi* neural models (see |
|
||||
| | [Model Preparation](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_speech_sample_README.html#model-preparation) section) |
|
||||
| Model Format | OpenVINO™ toolkit Intermediate Representation (.xml + .bin) |
|
||||
| Supported devices | See [Execution Modes](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_speech_sample_README.html#execution-modes) |
|
||||
| | section below and [List Supported Devices](https://docs.openvino.ai/2023.2/openvino_docs_OV_UG_supported_plugins_Supported_Devices.html) |
|
||||
| Other language realization | [C++](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_speech_sample_README.html) |
|
||||
|
||||
Automatic Speech Recognition Python sample application demonstrates how to use the following Python API in applications:
|
||||
|
||||
| Feature | API | Description |
|
||||
| -------------------------| ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-----------------------------------------------------------------------|
|
||||
| Import/Export Model | [openvino.runtime.Core.import_model](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Core.html#openvino.runtime.Core.import_model), | |
|
||||
| | [openvino.runtime.CompiledModel.export_model](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.CompiledModel.html#openvino.runtime.CompiledModel.export_model) | The GNA plugin supports loading and saving of the GNA-optimized model |
|
||||
| Model Operations | [openvino.runtime.Model.add_outputs](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.Model.html#openvino.runtime.Model.add_outputs) , | |
|
||||
| | [openvino.runtime.set_batch](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.html#openvino.runtime.set_batch), | |
|
||||
| | [openvino.runtime.CompiledModel.inputs](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.CompiledModel.html#openvino.runtime.CompiledModel.inputs), | |
|
||||
| | [openvino.runtime.CompiledModel.outputs](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.CompiledModel.html#openvino.runtime.CompiledModel.outputs), | |
|
||||
| | [openvino.runtime.ConstOutput.any_name](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.ConstOutput.html#openvino.runtime.ConstOutput.any_name) | Managing of model: configure batch_size, input and output tensors |
|
||||
| Synchronous Infer | [openvino.runtime.CompiledModel.create_infer_request](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.CompiledModel.html#openvino.runtime.CompiledModel.create_infer_request), | |
|
||||
| | [openvino.runtime.InferRequest.infer](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.InferRequest.html#openvino.runtime.InferRequest.infer) | Do synchronous inference |
|
||||
| InferRequest Operations | [openvino.runtime.InferRequest.get_input_tensor](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.InferRequest.html#openvino.runtime.InferRequest.get_input_tensor), | |
|
||||
| | [openvino.runtime.InferRequest.model_outputs](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.InferRequest.html#openvino.runtime.InferRequest.model_outputs), | |
|
||||
| | [openvino.runtime.InferRequest.model_inputs](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.InferRequest.html#openvino.runtime.InferRequest.model_inputs), | Get info about model using infer request API |
|
||||
| InferRequest Operations | [openvino.runtime.InferRequest.query_state](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.InferRequest.html#openvino.runtime.InferRequest.query_state), | |
|
||||
| | [openvino.runtime.VariableState.reset](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.inference_engine.VariableState.html#openvino.inference_engine.VariableState.reset) | Gets and resets CompiledModel state control |
|
||||
| Profiling | [openvino.runtime.InferRequest.profiling_info](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.InferRequest.html#openvino.runtime.InferRequest.profiling_info), | |
|
||||
| | [openvino.runtime.ProfilingInfo.real_time](https://docs.openvino.ai/2023.2/api/ie_python_api/_autosummary/openvino.runtime.ProfilingInfo.html#openvino.runtime.ProfilingInfo.real_time) | Get infer request profiling info |
|
||||
|
||||
Basic OpenVINO™ Runtime API is covered by [Hello Classification Python* Sample](https://docs.openvino.ai/2023.2/openvino_inference_engine_ie_bridges_python_sample_hello_classification_README.html).
|
||||
|
|
@ -0,0 +1,14 @@
|
|||
# Benchmark Python Tool
|
||||
|
||||
This page demonstrates how to use the Benchmark Python Tool to estimate deep learning inference performance on supported devices.
|
||||
|
||||
> **NOTE**: This page describes usage of the Python implementation of the Benchmark Tool. For the C++ implementation, refer to the [Benchmark C++ Tool](https://docs.openvino.ai/2023.2/openvino_inference_engine_samples_benchmark_app_README.html) page. The Python version is recommended for benchmarking models that will be used in Python applications, and the C++ version is recommended for benchmarking models that will be used in C++ applications. Both tools have a similar command interface and backend.
|
||||
|
||||
For more detailed information on how this sample works, check the dedicated [article](https://docs.openvino.ai/2023.2/openvino_inference_engine_tools_benchmark_tool_README.html)
|
||||
|
||||
## Requriements
|
||||
|
||||
The Python benchmark_app is automatically installed when you install OpenVINO Developer Tools using [PyPI](https://docs.openvino.ai/2023.2/openvino_docs_install_guides_installing_openvino_pip.html) Before running ``benchmark_app``, make sure the ``openvino_env`` virtual environment is activated, and navigate to the directory where your model is located.
|
||||
|
||||
The benchmarking application works with models in the OpenVINO IR (``model.xml`` and ``model.bin``) and ONNX (``model.onnx``) formats.
|
||||
Make sure to [convert your models](https://docs.openvino.ai/2023.2/openvino_docs_MO_DG_Deep_Learning_Model_Optimizer_DevGuide.html) if necessary.
|
||||
Loading…
Reference in New Issue