openvino/tools
Zlobin Vladimir 67d25d7099
Add benchmark samples (#13388)
* Add sync_bnehcmark

* Fix Unix comilation

* niter->time

* Explain main loop

* samples: factor out common

* Code style

* clang-format -i

* return 0; -> return EXIT_SUCCESS;, +x

* Update throughput_benchmark

* Add READMEs

* Fix READMEs refs

* Add sync_benchmark.py

* Add niter, infer_new_request, -pc

* from datetime import timedelta

* Fix niter and seconds_to_run

* Add disclaimer about benchmark_app performance

* Update samples/cpp/benchmark/sync_benchmark/README.md

* Add dynamic_shape_bert_benhcmark

* Add dynamic_shape_detection_benchmark

* Adopt for detr-resnet50

* Remove sync_benchmark2, throughput_benchmark2, perf counters

* clang-format -i

* Fix flake8

* Add README.md

* Add links to sample_dynamic_shape_bert_benchmark

* Add softmax

* nameless LatencyMetrics

* parent.parent -> parents[2]

* Add bert_benhcmark sample

* Code style

* Add bert_benhcmark/README.md

* rm -r samples/python/benchmark/dynamic_shape_bert_benhcmark/

* rm -r samples/cpp/benchmark/dynamic_shape_detection_benchmark/

* bert_benhcmark/README.md: remove dynamic shape

* Remove add_subdirectory(dynamic_shape_detection_benchmark)

* flake8

* samples: Add a note about CUMULATIVE_THROUGHPUT, don’t expect get_property() to throw, don’t introduce json dependency for samples/cpp/common

* / namespace

* Add article

* namespace -> static

* Update README, seconds_ro_run 10, niter 10, no inter alinment

* percentile->median

* benchmark samples: use generate(), align logs, update READMEs

* benchmakr samples: remove percentile()

* samples/python/benchmark/bert_benhcmark/bert_benhcmark.py: report average sequence length and processing time

* Python samples: move requirements.txt to every sample

* Remove numpy from requirements.txt

* Remove Building section from Python samples, install only required extras from openvino-dev, set up environment for bert_benhcmark, report duration for bert_benhcmark

* Install openvino-dev for Hello Reshape SSD C++ Sample
2022-12-05 15:12:53 +04:00
..
benchmark_tool Add benchmark samples (#13388) 2022-12-05 15:12:53 +04:00
compile_tool Fixing assert when handling iop, iol and ioml (#13526) 2022-10-19 12:14:00 +03:00
cross_check_tool [Install] Remove upper bound for NumPy for default installation and update upper bounds for extras (#13985) 2022-11-30 09:53:06 +04:00
deployment_manager [PyOV] Disallow Python 3.6 usage (#13240) 2022-11-06 10:45:42 +04:00
legacy/benchmark_app Improvements in rpm / debian build (#13750) 2022-11-01 18:02:07 +04:00
mo [FE] Support freezing Placeholder without specifying type (#13984) 2022-12-01 13:37:25 +03:00
openvino_dev Added Debian, Raspbian, Ubuntu 22.10 support to install dependencies (#14226) 2022-11-25 11:13:43 +04:00
pot [Install] Remove upper bound for NumPy for default installation and update upper bounds for extras (#13985) 2022-11-30 09:53:06 +04:00
.gitignore Align folder structure for Benchmark Tool (#6625) 2021-07-19 11:57:51 +03:00
CMakeLists.txt Added Debian, Raspbian, Ubuntu 22.10 support to install dependencies (#14226) 2022-11-25 11:13:43 +04:00
README.md fix errors in documentation (#9384) 2022-01-27 19:39:49 +03:00

README.md

OpenVINO™ Python* development tools

General

OpenVINO includes following tools:

  • openvino.tools.benchmark

Please, refer to https://docs.openvino.ai for details.

Installation

Prerequisites

Install prerequisites first:

1. Python

Install Python prerequisites:

Run following command to install these prerequisites on Ubuntu*:

sudo apt-get install python3 python3-dev python3-setuptools python3-pip

Python setuptools and python package manager (pip) install packages into system directory by default. There are several options:

  • work inside [virtual environment][virtualenv] (best solution).
  • use --user option for all pip commands.
  • install all dependencies with sudo permissions.

In order to use virtual environment you should install it:

python3 -m pip install virtualenv
python3 -m virtualenv -p `which python3` <directory_for_environment>

Before starting to work inside virtual environment, it should be activated:

source <directory_for_environment>/bin/activate

Virtual environment can be deactivated using command

deactivate

2. Install packages

You can install tools by specifying path to tool with setup.py in pip install command:

python3 -m pip install <tools_folder>/

For example, to install Benchmark Tool, use the following command:

python3 -m pip install benchmark_tool/

Configuration

Each subpackage has specific configuration. Please, refer to specific subpackage documentation for details.