Commit Graph

321 Commits

Author SHA1 Message Date
Zlobin Vladimir c7c7c4bb05
samples/cpp remove unused code (#16787) 2023-04-06 20:59:00 +04:00
Maciej Smyk 950b46ecad
DOCS shift to rst - Model Creation C++ Sample & Model Creation Python* Sample (#16637) 2023-04-03 08:24:35 +02:00
Maciej Smyk bb20151c9d
DOCS shift to rst - Hello Query Device C++ Sample & Hello Query Device Python* Sample (#16650) 2023-04-03 08:24:02 +02:00
Maciej Smyk f5dced8e69
DOCS shift to rst - Hello Classification Samples (#16681) 2023-04-03 08:23:44 +02:00
Maciej Smyk 73e75c58ba
DOCS shift to rst - Hello NV12 Input Classification C++ Sample & Hello NV12 Input Classification C Sample (#16664) 2023-03-31 09:07:59 +02:00
Maciej Smyk 385bbbd49b
DOCS shift to rst - Hello Reshape SSD C++ Sample & Hello Reshape SSD Python* Sample (#16662) 2023-03-31 09:07:30 +02:00
Ilya Lavrenov ccf9c19f61
Deprecated UNDEFINED values for execution / performance hints (#16563)
* Deprecated UNDEFINED values for execution / performance hints

* Update src/tests/functional/plugin/gpu/shared_tests_instances/behavior/ov_plugin/properties_tests.cpp

* Fixes

* Fixes
2023-03-30 13:48:19 +04:00
Ilya Lavrenov 0250f62d11
Revert inference precision to be a hint (#16634) 2023-03-29 18:59:33 +04:00
Maciej Smyk 7d8f4af78a
DOCS shift to rst - Automatic Speech Recognition C++ Sample & Automatic Speech Recognition Python* Sample (#16609) 2023-03-29 16:39:09 +02:00
Ilya Churaev f3dcf93f96
Remove suppression Wno-delete-non-abstract-non-virtual-dtor (#16560)
* Remove suppression Wno-delete-non-abstract-non-virtual-dtor

* Fixed Allocator warning

* Suppress warning for GPU plugin

* Skip warning for GNA

* Fixed preprocessing

* Added virtual constructor for base plugin class

* Some fix for CPU

* Suppress for CPU

* Fixed any

* Fixed meta

* Disable warning for paddle

* Fixed Allocator tests

* Move suppress to paddle

* Fixed benchmark_app
2023-03-29 14:19:30 +04:00
Sebastian Golebiewski 1ca94326cb
DOCS shift to rst - Benchmark Samples and Tools (#16566) 2023-03-27 18:29:05 +02:00
Sebastian Golebiewski 5c5a29d095
DOCS shift to rst -Sync Benchmark Samples (#16561) 2023-03-27 18:28:16 +02:00
Maciej Smyk 7ccf1c89cf
DOCS shift to rst - Image Classification Async C++ Sample & Image Classification Async Python* Sample (#16580) 2023-03-27 16:54:50 +02:00
Zlobin Vladimir 69cec4a5e2
py/benchmark_app: fix -hint (#16511)
* py/benchmark_app: fix -hint

Don't warn about values which are explicitly set in -hint.
That aligns C++ and Python implementations.

Ticket 106544

* Remove extra throw

* Fix code style
2023-03-24 10:24:08 +04:00
Jade Cho a20b3631fb
Support float64 data type as input of benchmark_app (#16435) 2023-03-23 13:55:55 +09:00
Daria Mityagina 1c7b6a7b2a
[VPUX] - Tensor data with element type f16, is not representable as pointer to i16 (#16379)
* [VPUX] - Tensor data with element type f16, is not representable as pointer to i16

* [VPUX] - Tensor data with element type f16, is not representable as pointer to i16
2023-03-20 14:54:27 +00:00
Ilya Lavrenov 0c99135d44
Improved properties handling between Core and plugins (#16296)
* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Multiple improvements

* [HETERO]: adopt setting device properties in benchmark_app/speech_sample for HETERO

Fix IEClassHeteroExecutableNetworkGetMetricTest_SUPPORTED_METRICS test

Fix NumStreamsAndDefaultPerfHintToHWTest/PerHintAndDefaultPerfHintToHWTest tests

[HETERO][MULTI][AUTO] Make ov::device::properties regular property

[PYTHON] Update python BA with device properties

Update after rebase

Update src/plugins/auto/auto_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Update src/plugins/auto/multi_executable_network.cpp

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Fix merge conflicts, apply some review comments

* Code style, bugfix after merging improvement

* More improvements

* Even more improvements

* Commit changes in core_impl.cpp

* Added parsing of any maps

* Fixed code-style

* Fixed AB mock tests build

* Fixed comparison

* Added new AB config key

* Improvements and fixes (#147)

* Fix BA, fix GetSupportedConfig call for virtual plugins (#148)

* Fix GPU tests (#149)

* Fix BA, fix GetSupportedConfig call for virtual plugins

* Fix GPU tests

* Code style

* Improvements 10

* Fixed incorrect tests

* Revert removal cache_dir

* Revert removal cache_dir

* Fixed clean

* Supported device ID in CPU

* More fixed tests

* clang-format

* Fix legacy GPU tests (#150)

* Removed clone_map

* clang-format

* Added clone_map back

---------

Co-authored-by: Nadezhda Ageeva <nadezhda.ageeva@intel.com>
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
2023-03-20 12:42:40 +00:00
Denis Orlov 6ffa8da922
Fix documentation (md and inline) for C++ and Python spech samples (#16185)
* Fix documentation (md and inline) for C++ and Python spech samples

* Fix clang-format

* Minor fix

* Fix clang-format

* Fix a typo

* Fix according to Mike's review

* Fix clang-format
2023-03-16 15:44:12 +00:00
Ilya Churaev 95faa573ed
Introduce ITensor instead of Blob (#16048)
* Introduce ITensor

* Added new allocator

* Hide ITensor from dev api

* Changed some python tests

* Remove deprecated API from sample

* Fixed warnings

* Skiped unsupported tests

* Fixed exception message

* Fixed template func tests

* Fixed incorrect tests

* Fixed comments and move ITensor to developer API

* Fixed CI issue

* Fixed allocated tensor

* Fixed docs and windows warning

* Fixed set shape for strided tensors

* Fixed build and some comments

* Introduce remote tensor

* Fixed code style

* Fixed build

* Remove static assert method

* Remove fail type

* Added device name API

* Try to fix GPU remote tests

* Added debug output

* Try to fix GPU tests

* Fixed comments

* Fixed build

* Added additional element type check

* Revert some comment changes
2023-03-14 19:12:27 +04:00
Ilya Lavrenov f080a0d9cf
Added NCC style for frontends sources (#16200)
* Ability to provide several source dirs for ncc-style checks

* Fixed include headers; added NCC to TF common

* Fixed NCC for frontends

* Fixed NCC for frontends

* Extra fixes

* Fixest push --f

* Clang-format

* Apply comments

* Add an option to specify required clang-format version

* Update src/frontends/tensorflow/src/decoder_proto.cpp

* Update src/frontends/tensorflow/src/decoder_proto.cpp
2023-03-13 14:54:00 +00:00
Zlobin Vladimir 0e91b07422
Prohibit FP16 FP32 values for cpp benchmark_app (#16217)
Ticket 100990

Python benchmark_app already prohibits FP16 and FP32.
2023-03-13 09:27:52 +04:00
Ilya Churaev 75314c2c53
Rename OPENVINO_UNREACHABLE to OPENVINO_THROW (#16201)
* Changed some exceptions to OPENVINO_THROW

* Changed samples throw exception

* Fixed some comments

* Remove OPENVINO_UNREACHABLE
2023-03-10 20:23:13 +04:00
Ilya Lavrenov fa9677a6ee
Removed visibility settings from samples (#16192) 2023-03-10 12:58:15 +04:00
Daria Mityagina 34bab897d6
[VPUX] - benchmark app issue fix - PERFORMANCE_HINT: UNDEFINED (#16065)
* [VPUX] - benchmark_app issue

* [VPUX] - benchmark_app issue - review
2023-03-10 12:46:51 +04:00
Szymon Irzabek e79636bfbb
[GNA] Add 3.6 and 4.0 targets (#15735) 2023-03-07 17:14:59 +01:00
Ilya Lavrenov e1fbb7d768
Fixes for multi-config generators (#16097) 2023-03-05 10:46:53 +04:00
Wang, Yang 99a1800901
Fix the AUTO loadnetwork failure triggered by AUTO:-xxx (#15747)
* Check if the device is supported when AUTO retrieves the device list based on the ov::device::priorities.

* Update the logic to handle the situation like -d AUTO:-CPU to benchmark APP.

* Remove MYRIAD and add NVIDIA for AUTO supported devices.

---------

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
2023-03-02 13:16:12 +08:00
Ilya Lavrenov 713b37cb25
Detection of WoA ARM64 in all places (#15960) 2023-02-27 10:29:14 +04:00
Ilya Lavrenov 57cb7015f0
Fixed samples build on Debian 10 with cmake 3.13 (#15940) 2023-02-24 22:28:45 +04:00
Wang, Yang 7f3ea9a59c
Conversion fail for ov::hint::performance_mode with UNDEFINED value (#15629)
* Update ov::hint::performance_hint UNDEFINED value from empty string to "UNDEFINED".

* Update benchmark Python version.

* Update.

* Update.

* Update.

* Update the description about hint setting within benchmark APP README and help message.
2023-02-22 13:01:18 +04:00
Ilya Lavrenov ed5fa69b41
Fixed compilation on CI (#15787) 2023-02-17 22:28:48 +04:00
Wang, Yang a088d1ab7d
Disable core::set_property() to support ov::device::properties setting (#15175)
* Disable set_property() to support ov::device::properties setting.

* Update benchmark APP to set device properties through compile_model() instead of through set_property().

* Update.

* Update.

* Update some test case including ov::device::properties setting via core.ser_property().

* Since core.set_property() didn't support ov::device::properties setting, just remove the test case to check compile_model() works well if setting ov::device::properties via core.set_property() first.

* Update CompileModel in test name to CompiledModel

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

* Add corresponding test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Remove the changes of this commit as this modification has nothing to do
with this PR.

This reverts commit 4f04b9f085.

---------

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-02-17 10:15:38 +04:00
Ilya Lavrenov 672522492e
Changed sample's format_reader libraries type from dynamic to static (#15756) 2023-02-17 09:30:19 +04:00
Zlobin Vladimir ee2e9d497c
benchmark_app: factor out advanced options (#15605)
* benchmark_app: factor out advanced options

* cpp/benchmark_app: add usage word

* move api to advanced, group b/shape/data_shape/layout into Input shapes, factor out Statistics dumping options

* Factor out Device-specific performance options

* Factor out Preprocessing options

* Minor regroup
2023-02-13 17:45:17 +04:00
Piotr Krzemiński d0a97af629
[BENCHMARK_APP] Introduce Numpy array loading for C++ benchmark app/Fix a bug that would cause Python Numpy array loading to fail (#14021)
* [C++/BENCHMARK_APP] Introduce Numpy array loading for C++ benchmark app

* [DOCS/BENCHMARK_APP] Update docs to reflect changes, update list of available extensions from OpenCV, align help messages

* Update inputs_filling.cpp

* Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update samples/cpp/benchmark_app/inputs_filling.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [C++/Python] Implement quality-of-life improvements from PR comments

* [C++] Fix compilation errors, fix linter output

* [C++/PYTHON] Apply requested changes

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update samples/cpp/benchmark_app/utils.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [PYTHON] Separate loading of numpy arrays similar to images

* [PYTHON] Remove unnecessary 'Prepare xxx file' print

* Update README again because IF OPENCV.. dissapeared for some reason

* Update second README with missing IF OPENCV..

* [C++] Remove unnecessary vector print function

* [C++ Add Numpy processing function - TODO link it to the tensor filling

* Reverse OneDnn plugin modification

* [C++] Numpy array loading for C++

* [C++] Add (almost) all missing types of data

* Reverse submodule modifications

* [C++/PYTHON] Fix compilation errors, clean code

* [C++] Modify supported extensions, add numpy checking to utils, add numpy to get_image_info method

* Update samples/cpp/benchmark_app/inputs_filling.cpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [C++] Fix utils header file to reflect unordered set change

* [PYTHON/C++] Fix compilation errors in C++ code, fix Python dynamic shapes numpy loading

* [C++] Fix explicit instantiation of NumpyArray reader

* [C++] Clang format, minor syntax fixes

* [PYTHON/C++] Remove unnecessary data types, introduce a new approach to cast data of different types from format_rt_reader, remove uppercase types from Python precision parameters

* [PYTHON] Update README to reflect new precision settings

* [PYTHON] Fix README, fix clang format

* [C++] Clean headers

* [C++] Fix uninitialized variable error

* [C++/PYTHON] Fixed choices in Python benchmark, fixed types in C++ benchmark

* [C++] Fixed ov::float16conversion, fixed Python types map - removed redundancies

* [C++] Add back boolean support

* [C++] Fix compilation errors

---------

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
2023-02-13 12:04:23 +04:00
Ilya Churaev b83ccdd432
Removed TREAT_WARNING_AS_ERROR option (#15608)
* Removed TREAT_WARNING_AS_ERROR option

* Removed warning as error for samples if cmake option is not defined
2023-02-10 21:43:08 +04:00
Ilya Lavrenov 4fa5137af4
DEB: use alternative package names for nlohmann json (#15607) 2023-02-10 02:34:16 +04:00
Ilya Lavrenov 1f3e469c5e
Added -Wall for Clang and GCC (#15513)
* Added -Wall for Clang and GCC

* Fixes

* Don't use /J

* Fixed warnings

* Fixed warnings

* More fixes

* Fixed for MSVC

* Fixed more warnings on Windows

* Suppressed some warnings in template plugin

* Update src/tests/functional/plugin/shared/include/behavior/plugin/caching_tests.hpp

* Added suppression for PT FE

* Suppressed warnings in TF FE

* Suppressed warnings on Core unit tests

* Suppress warnings in python

* Suppressed Windows warning for 3rd party modules

* Suppresed one more warning
2023-02-08 15:01:00 +04:00
Haiqi Pan 82286cc2af
fix dump/load_config using opencv (#15540)
* fix dump/load_config using opencv

* fix format

* remove empty line

* fix format
2023-02-08 10:33:51 +00:00
Ilya Lavrenov de1631d67d
Generalized OpenCL handling (#15253)
* Squashed commit of the following:

commit 62c992f6a0bc3a2f559faac6912be9c5632a359f
Author: Ilya Lavrenov <ilya.lavrenov@intel.com>
Date:   Sun Jan 22 11:38:18 2023 +0400

    Generalized OpenCL handling

* Updates

* Fixes

* Update thirdparty/CMakeLists.txt

test

* Fixed build with CL/cl2.hpp

* Fixes

* Fixes

* Fixed compilation flags

* Fixed build with target OpenCL 120

* Don't use cache
2023-02-03 15:36:47 +00:00
Piotr Krzemiński 7e3e0ff003
[C++] Fix coverity issues (#15348)
* [C++] Fix coverity issues

* Merge master with this branch

* [C++] Reapply changes that got eaten during merge

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>

* [C++] Add missing const keyword

---------

Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
2023-01-31 13:13:35 +04:00
Zlobin Vladimir a19d50d4d2
benchmark_app: fix FP16 image type (#15393) 2023-01-30 18:31:12 +04:00
Zlobin Vladimir dcb3b20d71
Speech sample report output ambiguity (#15135)
* speech_sample: report output ambiguity

Ticket 100574

* Add missing ;, ambogous->ambiguous

* clang-format

* Fix help message
2023-01-23 14:19:41 +04:00
Sebastian Golebiewski ffdf31fba8
DOCS: Update doxygen version (#15210)
* Update build_doc.yml

* fixing references

* fix refs

* fix branch.hpp
2023-01-20 13:22:30 +04:00
Vladimir Paramuzov 2201a5f83e
Added common ov::execution_mode hint (#15048)
* [GPU] Added common exec mode hint and gpu support

* Add ov::inference precision and update usages. Deprecate ov::hint::inference_precision property

* [GPU] Execution mode tests and fixes

* Fixed code style

* Moved execution_mode test to common. Fixes for python API

* Remove deprecations for hint::inference_precision and just keep both

* Fix test
2023-01-18 20:13:00 +04:00
Ilya Lavrenov c4eeecfec5
Remove myriad plugin (#15131)
* Removed Intel MYRIAD plugin

* Removed Intel MYIAD from CI files

* Removed Intel MYRIAD from cmake folder

* Removed MYRIAD, HDDL from samples

* Removed MYRIAD, HDDL from scripts folder

* Removed MYRIAD from bindings folder (C and Python API)

* Removed MYRIAD tests

* Removed MYRIAD from tests folder

* Removed MYRIAD from tools folder

* Removed HDDL (VAD), MYRIAD (NSC2) from documentation

* Fixed build for AUTO unit tests

* Fixed clang code style

* Fixed comments and issues

* removed MYRIAD from AUTO tests

* Disabled MULTI tests in CI

* Update docs/OV_Runtime_UG/auto_device_selection.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/get_started/get_started_demos.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

* Update docs/OV_Runtime_UG/deployment/local-distribution.md

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2023-01-18 15:19:44 +04:00
Ilya Lavrenov c29f111717
Enabled Windows ARM64 build using MSVC cl compiler (#15132)
* Fixed Windows Arm64 build

* Fixed linker warnings in docs

* Fixed Windowd ARM build

* Reverted changes in docs

* Added OpenVINO level macro to define CPU architecture

* Properly remove xbyak from reference kernels optimizations

* Added documentation for cmake functions

* Fixed samples build

* Added installation dir for host protoc

* Fixed installation stage for host_protoc

* Added build dir

* Fixed compilation on Apple

* cççç

* Fixed clang code-style

* Tely on CPU id from xbyak

* Fixed build

* Fixed compilation on mac

* Fixed compilation
2023-01-17 17:29:00 +04:00
Ilya Churaev 0c9abf43a9
Updated copyright headers (#15124)
* Updated copyright headers

* Revert "Fixed linker warnings in docs snippets on Windows (#15119)"

This reverts commit 372699ec49.
2023-01-16 11:02:17 +04:00
Anastasiya(Asya) Pronina e27c4b0b18
Fixed possible overflows to clean KW scan (#15034) 2023-01-12 11:33:43 +04:00
Anastasiya(Asya) Pronina 358d3a7740
Extended speech_sample to work on VPUX (#14509)
* Extended speech_sample to work on VPUX

* Fixed review comments

* Returned whitespace back
2023-01-11 12:46:08 +04:00
Piotr Krzemiński f4ff1cbdf3
[BENCHMARK_APP] Align pc reports, revert format print to previous, excel friendly (#14644)
* [Python] Align pc output in Python benchmark, update sorted output to new headers, print floats with 6-digit precision, fix date format printing to excel-friendly

* [PYTHON/C++] Change precision of raports and pc counters report, simplify code

* [C++] Align C++ benchamrk_app report to Python's by setting the precision value to 3

* [C++] Fix CsvDumper precision

* [C++/PYTHON] Align pcand pcsort outputs, merge C++ printSort methods into one

* Update samples/cpp/common/utils/include/samples/common.hpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update samples/cpp/common/utils/include/samples/common.hpp

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
2023-01-11 12:38:37 +04:00
Zlobin Vladimir 6c8f8df518
uint32->uint64 for RedHat gflags 2.1 failing at runtime (#14724) (#14978)
* uint32->uint64 for RedHat gflags 2.1 failing at runtime

* tools/legacy/benchmark_app: uint32->uint64 for RedHat gflags 2.1 failing at runtime

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-01-06 17:57:36 +00:00
Tomasz Dołbniak 13d01d969b
[BENCHMARK_APP] Help message cleanup (#14786) 2023-01-05 14:21:09 +01:00
Arseniy Obolenskiy b5ee9a8d3a
Fix samples build on ARM (32-bit) (#14832) 2022-12-28 12:35:25 +03:00
Zlobin Vladimir 055e34a77a
Allow running samples CMakeLists.txt as stand alone (#14826)
* Allow running samples CMakeLists.txt as stand alone

* Don't add cnpy twice

* Fix binary path
2022-12-27 13:44:46 +00:00
Zlobin Vladimir b8c92fce70
Parallelize build_samples_msvc.bat (#14828)
Close https://github.com/openvinotoolkit/openvino/issues/14825
2022-12-27 16:24:42 +04:00
Piotr Krzemiński f9796ee06a
[BENCHMARK_APP] Add warning if performance mode is not set to max on Windows (#14616)
* [C++] Display a warning if Power Mode is not 'Max Performance' - rebase from master

* [C++] Prevent std::max from colliding with windows.h max macro

* [PYTHON/C++] Update README docs to reflect possible inaccuracies from optimization settings

* [C++] Cleanup windows optimizations
2022-12-23 06:37:57 +01:00
Zlobin Vladimir 787ba3de4f
replace benchmark_app imean and iscale parameters (#14621)
* replace benchmark_app imean and iscale parameters

Tickets 80777 and 80900

* Warn about difference with imean and iscale, note that in help

* Clang format

* Clang format

* mean->scale

* Keep mean scale empty if not set

Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
2022-12-19 09:27:39 +04:00
Haiqi Pan befbae28ca
Add warning of benchmark_app about disabling auto batching (#13907)
* merge master

* reset original format

* remove AUTO

* Update tools/benchmark_tool/openvino/tools/benchmark/main.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* delete condition

* delete condition in py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
2022-12-15 10:51:57 +08:00
Zlobin Vladimir d96ea6273e
build_samples.sh: detect cmake3 for CentOS (#14560)
Close https://github.com/openvinotoolkit/openvino/issues/14553
2022-12-12 14:00:28 +04:00
Zlobin Vladimir 156905c381
samples/cpp/build_samples_msvc.bat: don't ignore cmake error (#14499)
Ticket 98429
2022-12-08 21:08:57 +04:00
Evan 72414851b8
Docs: Update Benchmark Tool example outputs (#13555)
* docs: revise example and update outputs

* docs: revise example and update outputs

* docs: typo fix

* docs: rectify changes

* docs: add <a> tag

* Update README.md

* docs: change example to use asl-recognition model

* docs: fix <a> tag

* docs: update sample outputs

* docs: change example to use asl-recognition model

* docs: revise example to use asl-recognition model

Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
2022-12-06 05:54:06 +03:00
Zlobin Vladimir 67d25d7099
Add benchmark samples (#13388)
* Add sync_bnehcmark

* Fix Unix comilation

* niter->time

* Explain main loop

* samples: factor out common

* Code style

* clang-format -i

* return 0; -> return EXIT_SUCCESS;, +x

* Update throughput_benchmark

* Add READMEs

* Fix READMEs refs

* Add sync_benchmark.py

* Add niter, infer_new_request, -pc

* from datetime import timedelta

* Fix niter and seconds_to_run

* Add disclaimer about benchmark_app performance

* Update samples/cpp/benchmark/sync_benchmark/README.md

* Add dynamic_shape_bert_benhcmark

* Add dynamic_shape_detection_benchmark

* Adopt for detr-resnet50

* Remove sync_benchmark2, throughput_benchmark2, perf counters

* clang-format -i

* Fix flake8

* Add README.md

* Add links to sample_dynamic_shape_bert_benchmark

* Add softmax

* nameless LatencyMetrics

* parent.parent -> parents[2]

* Add bert_benhcmark sample

* Code style

* Add bert_benhcmark/README.md

* rm -r samples/python/benchmark/dynamic_shape_bert_benhcmark/

* rm -r samples/cpp/benchmark/dynamic_shape_detection_benchmark/

* bert_benhcmark/README.md: remove dynamic shape

* Remove add_subdirectory(dynamic_shape_detection_benchmark)

* flake8

* samples: Add a note about CUMULATIVE_THROUGHPUT, don’t expect get_property() to throw, don’t introduce json dependency for samples/cpp/common

* / namespace

* Add article

* namespace -> static

* Update README, seconds_ro_run 10, niter 10, no inter alinment

* percentile->median

* benchmark samples: use generate(), align logs, update READMEs

* benchmakr samples: remove percentile()

* samples/python/benchmark/bert_benhcmark/bert_benhcmark.py: report average sequence length and processing time

* Python samples: move requirements.txt to every sample

* Remove numpy from requirements.txt

* Remove Building section from Python samples, install only required extras from openvino-dev, set up environment for bert_benhcmark, report duration for bert_benhcmark

* Install openvino-dev for Hello Reshape SSD C++ Sample
2022-12-05 15:12:53 +04:00
Ilya Lavrenov 1af95fb3f8
Fixed C samples build on Windows (#14386) 2022-12-05 01:33:42 +04:00
Ilya Lavrenov cf8c78483d
Reverted temporary WAs for gflags installation for CentOS 7 (#14370) 2022-12-02 22:10:02 +04:00
Ilya Lavrenov 3ec084074a
RPM packages improvements: part 2 (#14306)
* Updated install_dependencies.sh

* Added Fedora support

* Improvements for RPM generation

* Refactored work with gflags

* Apply suggestions from code review

* Improvements

* Several improvements for Ubuntu 18.04

* Improvements in gflags

* Update thirdparty/CMakeLists.txt

temporary install samples dependencies

* Fixed several mistakes

* Fixed issues with gflags

* Don't install dependencies on Linux

* Added nlohmann findinds on debian9 case

* Added FATAL_ERROR is gflags is not found in samples

* Fixes for samples on CentOS 7

* Cross-compiled debian packakges with proper libraries location

* Fixed include for old nlohman-json versions

* Fixed compilation with old json

* Applied review comments

* Added support of old nlohmann versions via submodule

* Temporary WA for CentOS 7

* Fixed compilation with old gflags

* Fixed compilation of C samples

* Fixed gflags on RHEL8.2 / Debian 9
2022-12-01 23:57:23 +04:00
Zlobin Vladimir c09af40b4c
No-break space->space, asssuming->assuming (#14276)
* No-break space->space, asssuming->assuming

* benchmark_app: don't print warning each iteration

* Russian с->English c

* Warn no batch only once

* Allow anonymus namespaces

* Keep only one report of model bach size, warn_if_no_batch for static model as well
2022-11-30 11:25:16 +00:00
Piotr Krzemiński 57082859ef
[BENCHMARK_APP/C++] Align performance counters and report output (#14140)
* [BENCHMARK_APP/C++] Align performance counters output, set all output time values to milliseconds

* [C++] Style fixes
2022-11-30 12:01:44 +04:00
Wang, Yang a37723e8cf
[AUTO] Enable Benchmark APP to parse the ov::device::properties through dump_config()/load_config() (#14057)
* [AUTO] update property setting logic.

* Update core::set_property() logic to only support primary property for AUTO and MULTI.
* Separate AUTO and MULTI supported properties.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* 1. revert the changes for ie core.
2. Enable AUTO/MULTI only accepting its own properties.
3. Enable AUTO/MULTI accepting device properties passed from loadnetwork().

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Revert "[AUTO]Update the incorrect config test for Myriad (#13271)"

This reverts commit 0552d98802.

* MULTI only accepts its own properties that is same as AUTO currently.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add test cases for AUTO/MULTI property test.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update to enable MULTI supporting hw primary property setting throw the compile_model().

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Remove the added test case for setting secondary property through set_property().

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* 1. For AUTO/MULTI, property setting will be passed via core::compile_model() instead of core::set_property().
2. update the logic to infer precision setting that will transform into secondary property setting to each hw device.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* set default value for nstreams when -d AUTO/MULTI and no nstreams setting from command line.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update code format.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Enable BA to support if -d AUTO:MULTI,xxx/MULTI:AUTO,xxx. while AUTO Plugin need to update the logic of generating supported config list to virtual device.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* move device configuration handling outside form function main.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Revert "move device configuration handling outside form function main."

This reverts commit ef77bfc602.

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Setting property performance hint to 'THROUGHPUT' and passing to executable network if no setting for of AUTO/MULTI.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* 1. Fix the issue that the dumped configuration file retrieves empty config list when using OpenCV to dump configuration.
2. Enable load_config() to load secondary property.
3.  ov:device:properties from command line will replace the ov::device::properties loaded from configuration file.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update the performance statistics showing format.

* Update format.

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update README to add some simple configuration files loaded into benchmark app.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* 1. Enable dump/load function for AUTO to support hw device property setting thorugh configuration JSON.
2. Update README.md to example a simple JSON file containing the hw device properties setting for AUTO/MULTI.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

* Update.

* Update.

* Drop the changes within dump/load of OpenCV config parsing.

* Update.

* Correct property name. Update ov::num_stream to ov::inference_precision.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
2022-11-28 17:09:51 +04:00
Vladimir Paramuzov fdf504738d
[GPU] Replace cl2.hpp with opencl.hpp in cmake search for docs and benchmark_app (#14158) 2022-11-25 11:37:51 +04:00
Ilya Lavrenov 8dd8262b77
Added Debian, Raspbian, Ubuntu 22.10 support to install dependencies (#14226)
* Added Debian, Raspbian, Ubuntu 22.10 support

* Updated dependencies.cmake

* Fixes in script

* Added RHEL 9.1 support

* Added proper comments

* Compilation of rpm packages for aarch64 is fixed

* Proper generation of requirements.txt files when ENABLE_WHEEL=OFF

* samples build improvements

* Proper name for json library

* Proper condtion in samples
2022-11-25 11:13:43 +04:00
Ilya Lavrenov 6954838582
Conda fixes for Windows (#14219) 2022-11-25 10:57:00 +04:00
Zlobin Vladimir e038902585
benchmark_app: remove -progress (#14127)
* benchmark_app: remove -progress

Tickets 80781 and 80903

* tools/benchmark_tool/requirements.txt: remove py-cpuinfo and progress
2022-11-24 10:50:07 +04:00
Zlobin Vladimir 8d5df45d9f
benchmark_app: reuse shapes string representation (#13783) 2022-11-23 13:19:26 +04:00
Nadezhda Ageeva 8588603506
Revert "[BENCHMARK_APP] Show input command in output (#13402)" (#14027)
This reverts commit f893a58816.
2022-11-18 14:43:41 +03:00
Wang, Yang 678b90a661
[AUTO] Update property setting rules (#13848)
* [AUTO] update property setting logic.

* Update core::set_property() logic to only support primary property for AUTO and MULTI.
* Separate AUTO and MULTI supported properties.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add test case.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* 1. revert the changes for ie core.
2. Enable AUTO/MULTI only accepting its own properties.
3. Enable AUTO/MULTI accepting device properties passed from loadnetwork().

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Revert "[AUTO]Update the incorrect config test for Myriad (#13271)"

This reverts commit 0552d98802.

* MULTI only accepts its own properties that is same as AUTO currently.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Add test cases for AUTO/MULTI property test.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update to enable MULTI supporting hw primary property setting throw the compile_model().

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Remove the added test case for setting secondary property through set_property().

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* 1. For AUTO/MULTI, property setting will be passed via core::compile_model() instead of core::set_property().
2. update the logic to infer precision setting that will transform into secondary property setting to each hw device.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* set default value for nstreams when -d AUTO/MULTI and no nstreams setting from command line.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update code format.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Enable BA to support if -d AUTO:MULTI,xxx/MULTI:AUTO,xxx. while AUTO Plugin need to update the logic of generating supported config list to virtual device.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* move device configuration handling outside form function main.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Revert "move device configuration handling outside form function main."

This reverts commit ef77bfc602.

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Setting property performance hint to 'THROUGHPUT' and passing to executable network if no setting for of AUTO/MULTI.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2022-11-17 16:38:47 +08:00
yanlan song 80a07375bf
Bell/hetero execution devices (#13924)
* initial commit

Signed-off-by: fishbell <bell.song@intel.com>

* add cases

Signed-off-by: fishbell <bell.song@intel.com>

* apply review comments

Signed-off-by: fishbell <bell.song@intel.com>

* enable app

Signed-off-by: fishbell <bell.song@intel.com>

* clang

Signed-off-by: fishbell <bell.song@intel.com>

* apply review comments

Signed-off-by: fishbell <bell.song@intel.com>

* enable cpu conditionally

Signed-off-by: fishbell <bell.song@intel.com>

* enable cpu tests

Signed-off-by: fishbell <bell.song@intel.com>

Signed-off-by: fishbell <bell.song@intel.com>
2022-11-15 09:53:18 +00:00
Xiake Sun 5ac06838cd
Fix pcsort message format to be consistent cross language (#13936) 2022-11-14 14:26:31 +01:00
Piotr Krzemiński d951623027
[BENCHMARK_APP/PYTHON/CPP] Align benchmark_app output across languages (#12814)
* [PYTHON] Pipeline transfer

* [PYTHON] Align python benchmark

* [PYTHON] Align last step

* [PYTHON] Fix innacuracies of the last step - median

* [PYTHON/CPP] Add Core::get_version method to python API, refactor Ben benchmark to print version with this func

* [PYTHON] Remove get_version_string from API

* [PYTHON/CPP] Align output for model input/output info

* [PYTHON/CPP] Step 4,6 alignment of outputs, step 8 dumps all info stored in config parameters

* [CPP] Fix a bug causing nstreams parameter to never be set to AUTO in CPP benchmark_app

* [CPP] Fix clang format errors

* [CPP] Modify print order and data output for 8th step

* [PYTHON] Add verification checks from C++, modify set_thoughtput_streams to match documentation

* [CPP] Revert changes to C++ benchmark_app

* [CPP] Remove additional spacebar

* Update submodules versions on remote

* Update module from master branch

* Redownload submodules from master and override changes from commit

* [PYTHON] Remove unneccesary parse_status from validation function

* [PYTHON] Check for HINT in map, fix circular import

* [PYTHON] Remove artifacts from commit, fix args.perf_hint set to '' instead to 'none'

* [PYTHON] Reverse changes to perf hint, add key in map check, fix validation function throwing error on set hint

* [PYTHON] Fix linter

* [PYTHON] Remove linter spacebar

* [CPP] Fix wait_all exception throw

* [CPP/PYTHON] Clean artifacts and unwanted changes from work process

* [PYTHON] Fix artifacts from merge, clean submodule update

* [C++ CPU] Fix device name string by removing padding NULL characters from the back

* [CPP] Fix ba infer_request_wrap in other throw-catch clauses

* [PYTHON/CPP] Fix missing latencies in final step for shape group, fix minor misaligned messages, add missing report parameter create infer requests time

* [CPP] Clang fix formatting

* [CPP] Reverse clang fix format on plugin.cpp

* [PYTHON/CPP] Fix C++ progressbar printing endl when disabled, fix rounding in python creating infer request message

* [CPP] Fix foramtiing error

* [PYTHON/C++] Refactor network to model based on naming conventions, provide fresh README output example

* [PYTHON/C++] Add example output to C++ README, remove unnecessary device loop

* [BENCHMARK_APP/C++] Fix artifact from refactoring, remove try-catch clause

* Update samples/cpp/benchmark_app/benchmark_app.hpp

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update tools/benchmark_tool/openvino/tools/benchmark/main.py

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update samples/cpp/benchmark_app/main.cpp

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* [CPP] Fix clang errors

* [CPP/PLUGIN Reverse modification to extract to separate task

* Update tools/benchmark_tool/openvino/tools/benchmark/main.py

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>

* Update tools/benchmark_tool/openvino/tools/benchmark/parameters.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update tools/benchmark_tool/openvino/tools/benchmark/utils/utils.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* Update tools/benchmark_tool/openvino/tools/benchmark/main.py

Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>

* [PYTHON/C++/BENCHMARK_APP] Fix language inconsistencies, remove unnecessary checks

* Update pyopenvino.cpp

* [CPP/BENCHMARK_APP] Remove unnecessary try-catch, fix linter errors

* [PYTHON/CPP/BENCHMARK_APP] Revert changes to Core, align version prints usin only provided methods

* [DOCS/BENCHMARK_APP] Update README with proper model examples

* Update README.md

Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
2022-11-14 14:10:36 +01:00
Ilya Lavrenov 55a45a4d1a
Adjusted dependencies (#13942)
* Adjusted dependencies

* Fixed paths on Windows

* Move dependencies close to usage

* Updates
2022-11-14 12:57:27 +04:00
yanlan song 394b6fe9ee
Bell/execution device (#13737)
* debug only

Signed-off-by: fishbell <bell.song@intel.com>

* add execution_device property for auto

Signed-off-by: fishbell <bell.song@intel.com>

* Revert "debug only"

This reverts commit 5ef6140b63.

* revert debug code

Signed-off-by: fishbell <bell.song@intel.com>

* polish tests to cover multiple gpu platform

Signed-off-by: fishbell <bell.song@intel.com>

clean up

Signed-off-by: fishbell <bell.song@intel.com>

* clang format

Signed-off-by: fishbell <bell.song@intel.com>

* only cpu in cpuFunctest

Signed-off-by: fishbell <bell.song@intel.com>

* thread-safe implementation

Signed-off-by: fishbell <bell.song@intel.com>

* remove not needed locl

Signed-off-by: fishbell <bell.song@intel.com>

* apply review comments

Signed-off-by: fishbell <bell.song@intel.com>

* remove blank line

Signed-off-by: fishbell <bell.song@intel.com>

Signed-off-by: fishbell <bell.song@intel.com>
2022-11-07 10:12:28 +08:00
Zlobin Vladimir 28a118be39
Apply improvements I found during https://github.com/openvinotoolkit/openvino/pull/13388 (#13743) 2022-11-04 14:41:15 +04:00
Tomasz Adamowicz 5f0b063455
[GNA] Support GNA 3.5 (MTL) target in OV (#13478)
* Enable TLV

* [GNA] Add smoke test for Conv with padding on MTL

* [GNA] Allow skipping tests based on gna lib version

Co-authored-by: Krzysztof Bruniecki <krzysztof.bruniecki@intel.com> 🥇
2022-11-04 10:26:22 +01:00
Vladimir Paramuzov ced0eebd13
[GPU] Silence ocl include pragma message (#13789) 2022-11-03 18:02:23 +04:00
Krzysztof Bruniecki f8b12b4f1a
[SAMPLES] [GNA] Remove port assertion in speech_sample when importing (#13687)
* [SAMPLES] [GNA] Remove port assertion in speech_sample when importing the GNA fromat model

* Fix code style
2022-11-02 15:53:04 +03:00
Ilya Lavrenov 7595fd4c4e
Improvements in rpm / debian build (#13750)
* Improvements in rpm / debian build

* Fixed several debian warnings

* Supported old gflags from CentOS 7

* Reverted back OpenCV version

* Fixed clang-format
2022-11-01 18:02:07 +04:00
Krzysztof Bruniecki 7196a0cfd2
[SAMPLES] Remove unneeded GNA clock multiplier in performance counters (#13657) 2022-10-28 13:43:25 +02:00
Artyom Anokhov 65293b1492
Added frontends RPMs generation (#13618)
* cmake/packaging/rpm.cmake: Added Frontends

* rpm_post_build: Added link to Fedoraproject wiki with rpmlint errors info

* RPM: Throw warning for rpmlint findings instead of FATAL ERROR till there is no filtering/suppression of errors

debian.cmake: Added one more error to suppress
thirdparty/CMakeLists.txt: added CentOS(RHEL) for gflags shared libs case
install_openvino_dependencies: Added gflags installation

* Fixed gflags issues for RHEL/CentOS

Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2022-10-27 10:08:54 +04:00
Piotr Krzemiński f893a58816
[BENCHMARK_APP] Show input command in output (#13402) 2022-10-26 10:58:09 +02:00
Wang, Yang 82942a12b2
[AUTO] Benchmark failed to pass nthreads and pin to AUTO/MULTI (#13396)
* Create device property for passing nthreads or pin to AUTO or MULTI in benchmark app.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update the logic of the multi device properties setting for the same target device.

* refactor the logic to pass nthreads and pin to AUTO and MULTI.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2022-10-26 14:43:02 +08:00
Xuejun Zhai dd3a37657c
[MAC BUILD]fix benchmark build error caused by string compare (#13566)
* fix benchmark build error caused by string compare

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [Onlt Test] only for test mac build, will revert after validation

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* fix benchmark build error caused by string compare

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* [benchmark] change string compare func from strcmp() to std::string::compare

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>

* Revert "[Onlt Test] only for test mac build, will revert after validation"

This reverts commit 313e8428d4.

Signed-off-by: xuejun <Xuejun.Zhai@intel.com>
2022-10-25 18:03:28 +04:00
Zlobin Vladimir 0d4b331f84
guard exception in classification_sample_async (#13530) 2022-10-20 12:23:34 +03:00
Piotr Krzemiński d715ecaa32
[CPP/SAMPLES] Samples location independant on script execution directory (#13251) 2022-10-20 10:01:55 +02:00
18582088138 152511daa8
Benchmark sort opt (#12350)
* Benchmark_app python and c/c++ script add op profiling feature

* Fix compile bug about benchmark c/c++ op profiling

* Fix Compile Bug

* Fix issue in PR#12350 : 1. report_type info update; 2. priority of -pc and -pcsort; 3.align format between c++ and python; 4.check 'proportion' for 0 and print N/A; 5.detect the confusing print info

* Fix 8/17 review suggestion

* Fix 8/23 suggestion

* Fix the clang-format issue

* Fix the win-cc issue

* Fix win-cc issue about conversion from 'double' to 'float', possible loss of data

* Push PR by ODT group account

Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Fiona Zhao <fiona.zhao@intel.com>
2022-10-19 22:59:12 +08:00
Sebastian Golebiewski 60099a19bd
DOCS: Fixing formatting in Samples - port to master (#13128)
* DOCS: Fixing formatting in Samples - porting to master

Porting
https://github.com/openvinotoolkit/openvino/pull/13085

Fixing incorrectly numbered lists and indentation of code blocks.

* Update get_started_demos.md

Co-authored-by: Maciej Smyk <maciejx.smyk@intel.com>
2022-10-12 14:16:02 +02:00
Ilya Lavrenov c2911adf94
Conda-forge fixes (#13392) 2022-10-12 12:16:13 +04:00
Wang, Yang 6bd099917a
[AUTO plugin] Enable benchmark setting performance hint with none value to hardware device through AUTO/MULTI plugin (#13063)
* Set 'UNDEFINED' as the performancehint default value. Update benchmark app to pass performance hint with none value to MULTI/AUTO plugin.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Using 'UNDEFINED' as the default value of hint in AUTO/MULTI plugin.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Adding a flag instead of adding a default value of hint to check if user configures the performance hint to AUTO/MULTI plugin.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update benchmark python version.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
2022-10-12 10:03:17 +08:00
Wang, Yang 457f606812
[AUTO] fix Performance inefficiencies issue (#13273)
* fix Performance inefficiencies issue caused by previous PR.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

* Update.

Signed-off-by: Wang, Yang <yang4.wang@intel.com>

Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: River Li <river.li@intel.com>
2022-10-10 08:42:43 +00:00
Ilya Churaev 8a9c19e3eb
Warning as error for Windows (#13291)
* parent 6e7016ccda
author Ilya Churaev <ilya.churaev@intel.com> 1664281499 +0400
committer Ilya Churaev <ilya.churaev@intel.com> 1664510018 +0400

Fixed warnings on local machine

* Added CMAKE_COMPILE_WARNING_AS_ERROR usage

* Fixed style

* Fixed merge conflicts

* Fixed typo

* Fixed myriad build for macOS

* Fixed warning

* Fixed tests

* Disabled incorrect test

* Try to fix linux tests

* Revert "Try to fix linux tests"

This reverts commit 29224c93ff.

* Fixed tests

* Revert logic with incorrect cast

* Fixed log softmax

* Disable warning as error for cuda

* Try to fix inference_engine_s

* Fixed cmake

* Revert "Fixed cmake"

This reverts commit 87e9e4e674.

* Revert "Try to fix inference_engine_s"

This reverts commit a1adca8b05.

* WA for static symbols in inference_engine_s test library

* Fixed code style

* Fixed static definition for master

* Revert "Fixed static definition for master"

This reverts commit 20d00d215a.

* Revert "Fixed code style"

This reverts commit 0eb2362543.

* Revert "WA for static symbols in inference_engine_s test library"

This reverts commit 75ef86a79d.

* Fixed linker issue for Windows

* Disable WaE by default

* Disable warning as error in the developer package

* Try to fix dev package

* Try to fix Windows Jenkins

* Revert old behavior for tread_warn_as_err variable
2022-10-06 13:44:21 +04:00
Ilya Lavrenov 1bb15b1d18
Compilation with conda build (#13083)
* Compilation with conda forge

* Fixed compilation with gcc 12

* Fixed tests compilation

* use macro instead of function

* Fixed uninitialized variable in tests

* Conda

* Conda
2022-10-05 08:38:38 +04:00