openvino/docs/OV_Runtime_UG
Zlobin Vladimir 67d25d7099
Add benchmark samples (#13388)
* Add sync_bnehcmark

* Fix Unix comilation

* niter->time

* Explain main loop

* samples: factor out common

* Code style

* clang-format -i

* return 0; -> return EXIT_SUCCESS;, +x

* Update throughput_benchmark

* Add READMEs

* Fix READMEs refs

* Add sync_benchmark.py

* Add niter, infer_new_request, -pc

* from datetime import timedelta

* Fix niter and seconds_to_run

* Add disclaimer about benchmark_app performance

* Update samples/cpp/benchmark/sync_benchmark/README.md

* Add dynamic_shape_bert_benhcmark

* Add dynamic_shape_detection_benchmark

* Adopt for detr-resnet50

* Remove sync_benchmark2, throughput_benchmark2, perf counters

* clang-format -i

* Fix flake8

* Add README.md

* Add links to sample_dynamic_shape_bert_benchmark

* Add softmax

* nameless LatencyMetrics

* parent.parent -> parents[2]

* Add bert_benhcmark sample

* Code style

* Add bert_benhcmark/README.md

* rm -r samples/python/benchmark/dynamic_shape_bert_benhcmark/

* rm -r samples/cpp/benchmark/dynamic_shape_detection_benchmark/

* bert_benhcmark/README.md: remove dynamic shape

* Remove add_subdirectory(dynamic_shape_detection_benchmark)

* flake8

* samples: Add a note about CUMULATIVE_THROUGHPUT, don’t expect get_property() to throw, don’t introduce json dependency for samples/cpp/common

* / namespace

* Add article

* namespace -> static

* Update README, seconds_ro_run 10, niter 10, no inter alinment

* percentile->median

* benchmark samples: use generate(), align logs, update READMEs

* benchmakr samples: remove percentile()

* samples/python/benchmark/bert_benhcmark/bert_benhcmark.py: report average sequence length and processing time

* Python samples: move requirements.txt to every sample

* Remove numpy from requirements.txt

* Remove Building section from Python samples, install only required extras from openvino-dev, set up environment for bert_benhcmark, report duration for bert_benhcmark

* Install openvino-dev for Hello Reshape SSD C++ Sample
2022-12-05 15:12:53 +04:00
..
deployment Fixing indentation in Local Distribution - for master (#13376) 2022-11-02 11:15:41 +01:00
img DOCS: Language-agnostic version of 'Changing Input Shapes' - for master (#13814) 2022-11-09 15:29:10 +01:00
migration_ov_2_0 tf_openvino (#13786) 2022-11-15 08:02:54 +01:00
supported_plugins Update Model_caching_overview.md (#14312) 2022-12-02 08:40:08 +01:00
AutoPlugin_Debugging.md Cumulative throughput 2022.2 (#11831) 2022-06-16 16:23:10 +00:00
Int8Inference.md Fixed conflicts (#11332) 2022-03-30 16:10:03 +03:00
Model_caching_overview.md Update Model_caching_overview.md (#14312) 2022-12-02 08:40:08 +01:00
Operations_specifications.md Add IsFinite operator (#13441) 2022-10-26 13:24:01 +02:00
Python_API_exclusives.md Proofreading-OV-Runtime (#11658) 2022-07-08 13:34:45 +02:00
Samples_Overview.md Add benchmark samples (#13388) 2022-12-05 15:12:53 +04:00
ShapeInference.md DOCS: Language-agnostic version of 'Changing Input Shapes' - for master (#13814) 2022-11-09 15:29:10 +01:00
Troubleshooting_ReshapeMethod.md --input format update in MO docs (#14272) 2022-11-28 20:20:13 +04:00
auto_device_selection.md Correct the GPU number that triggers the CPU removal in CTPUT (#13225) 2022-10-12 15:00:04 +08:00
automatic_batching.md DOCS: Fix for Runtime Inference - master (#13551) 2022-10-25 12:41:33 +02:00
hetero_execution.md DOCS: Fix for Runtime Inference - master (#13551) 2022-10-25 12:41:33 +02:00
integrate_with_your_application.md DOCS: Fix for Runtime Inference - master (#13551) 2022-10-25 12:41:33 +02:00
layout_overview.md Added documentation for get_layout API (#13937) 2022-11-10 18:10:07 +03:00
model_representation.md No-break space->space, asssuming->assuming (#14276) 2022-11-30 11:25:16 +00:00
multi_device.md DOCS: Fixing formatting in Multi Device (#13292) 2022-11-09 17:02:33 +01:00
network_state_intro.md Proofreading-OV-Runtime (#11658) 2022-07-08 13:34:45 +02:00
openvino_intro.md DOCS: Fix for Runtime Inference - master (#13551) 2022-10-25 12:41:33 +02:00
ov_dynamic_shapes.md [DOC][C API][DYNAMIC SHAPE] Add doc for C API dynamic shape (#13397) 2022-10-20 07:04:14 +04:00
ov_infer_request.md DOCS: Fixing formatting issues and broken links - port to master (#13143) 2022-09-28 15:35:17 +04:00
ov_without_dynamic_shapes.md Proofreading-OV-Runtime (#11658) 2022-07-08 13:34:45 +02:00
performance_hints.md No-break space->space, asssuming->assuming (#14276) 2022-11-30 11:25:16 +00:00
preprocessing_details.md DOCS: Fix for Runtime Inference - master (#13551) 2022-10-25 12:41:33 +02:00
preprocessing_overview.md Proofreading-OV-Runtime (#11658) 2022-07-08 13:34:45 +02:00
preprocessing_usecase_save.md Proofreading-OV-Runtime (#11658) 2022-07-08 13:34:45 +02:00
protecting_model_guide.md DOCS: Replace image in Protecting Model Guide - for master (#13631) 2022-11-02 09:48:17 +01:00