History

Maciej Smyk 8d49595476 [DOCS] Update of hyperlinks to 2024 + new ov homepage diagram image for master (#23091 ) * Update of links in docs to 2024 in repo. * Replaced ov homepage diagram with a new version without Kalid, MXNet and Caffe		2024-02-28 07:54:04 +00:00
..
README.md	[DOCS] Update of hyperlinks to 2024 + new ov homepage diagram image for master (#23091 )	2024-02-28 07:54:04 +00:00
bert_benchmark.py	[PyOV][SAMPLES] Fix bugbear issue B038 (#22183 )	2024-01-16 15:08:05 +01:00
requirements.txt	[PyOV] Add lower bound to `datasets` (#20674 )	2023-10-30 11:24:37 +00:00

README.md

Bert Benchmark Python Sample

This sample demonstrates how to estimate performance of a Bert model using Asynchronous Inference Request API. Unlike demos this sample doesn't have configurable command line arguments. Feel free to modify sample's source code to try out different options.

For more detailed information on how this sample works, check the dedicated article

The sample downloads a model and a tokenizer, export the model to onnx, reads the exported model and reshapes it to enforce dynamic input shapes, compiles the resulting model, downloads a dataset and runs benchmarking on the dataset.

Requirements

The following Python API is used in the application:

Feature	API	Description
OpenVINO Runtime Version	[openvino.runtime.get_version]	Get Openvino API version.
Basic Infer Flow	[openvino.runtime.Core],	Common API to do inference: compile a model.
	[openvino.runtime.Core.compile_model]
Asynchronous Infer	[openvino.runtime.AsyncInferQueue],	Do asynchronous inference.
	[openvino.runtime.AsyncInferQueue.start_async],
	[openvino.runtime.AsyncInferQueue.wait_all]
Model Operations	[openvino.runtime.CompiledModel.inputs]	Get inputs of a model.