* link update
* link update
* link update
* Update dev_api_references.rst
* Update dev_api_references.rst
* Update apidoc.py
* notebooks links
* notebook link update
* filename update
* link update
* link update api
* Improved warning message for BA + OpenCL case
* Update samples/cpp/benchmark_app/CMakeLists.txt
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
---------
Co-authored-by: Helena Kloosterman <helena.kloosterman@intel.com>
The Python version uses `app_inputs_info` to represent different input configurations, but the C++ version extends that use case and uses `app_inputs_info` to represent different input images as well. That means that the assumption that if `app_input_info.size() > 1`, then input shape is dynamic, doesn’t always hold for C++
Ticket 117673
* Change `VPUX`/`VPU` occurrences to `NPU`
* Switch `HARDWARE_AWARE_IGNORED_PATTERNS` VPU to NPU
* Rename `MYRIAD plugin`
* Rename vpu_patterns to npu_patterns in tools/pot
* Rename vpu.json to npu.json in tools/pot
* Rename restrict_for_vpu to restrict_for_npu in tools/pot
* Change keembayOptimalBatchNum to npuOptimalBatchNum
---------
Co-authored-by: Dan <mircea-aurelian.dan@intel.com>
* Fix -api sync for single -data_shape
Tickets 111187 and 111185
I wasn’t able to find C++ equivalent of Python’s `info.original_shape.is_static`. Later I realized that it shouldn’t be considered because -shape cmd arg should have higher priority for shape inference than model’s shape. So I removed it from Python.
Replace
`if benchmark.inference_only and batch_size.is_dynamic:`
with
`if allow_inference_only_or_sync and batch_size.is_dynamic:`
to reset batch_size to static in case of dynamic shape with single -data_shape
* Check only app_input_info.size() == 1 because if it's gretaer than 1, input shape is dynamic and there are more that one static shapes. Apply TODO
* Deprecate ExecutableNetwork and InferRequest API
* Fixed some warnings
* Fixed some warnings
* Try to fix documentation
* Try to skip documentation warnings
* Remove constructors for ov Exceptions
* Fixed linux build
* Fixed ONNX Frontend
* Fixed paddle
* Fixed exceptions in tests
* Deprecate constructors for ov::Exception
* Suppress some warnings
* Merge several exceptions
* Some small changes
* Suppress more warnings
* More warnings
* mode warnings
* Suppress more warnings
* More warnings
* 1. refine the logic to ov::device::properties setting.
2. the config overrides will be performed if same config setting is came from CMD line.-a
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update configuration sample file within README.md.
* Update.
* Update.
* 1. Update configuration example file within REAMDME.md for Python version.
2. implement the config DEVICE_PROPERTIES value convertation between the string type and dictionary of Python type.
3. Update the configuration file loading and dumping logic.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
* Update.
* Update.
* Update.
* Update.
* 1. Enable configs to be interchangeable between C++ and Python.
2. Update perf_count showing logic.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Revert the logic of showing show performance counters.
* Update help msg for loading config option.
---------
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Benchmark_app set ov::hint::allow_auto_batching through compile_model
* Remove the process about allow_auto_batching in set_property of core
* Remove allow_auto_batching and auto_batch_timeout property from AUTO plugin
* Reserve the info logs and add API to check auto_batching
* Update test case, rm AB property test from core config tests
* Update some API in AUTO plugin config
* Remove suppression Wno-delete-non-abstract-non-virtual-dtor
* Fixed Allocator warning
* Suppress warning for GPU plugin
* Skip warning for GNA
* Fixed preprocessing
* Added virtual constructor for base plugin class
* Some fix for CPU
* Suppress for CPU
* Fixed any
* Fixed meta
* Disable warning for paddle
* Fixed Allocator tests
* Move suppress to paddle
* Fixed benchmark_app
* py/benchmark_app: fix -hint
Don't warn about values which are explicitly set in -hint.
That aligns C++ and Python implementations.
Ticket 106544
* Remove extra throw
* Fix code style
* [VPUX] - Tensor data with element type f16, is not representable as pointer to i16
* [VPUX] - Tensor data with element type f16, is not representable as pointer to i16
* Check if the device is supported when AUTO retrieves the device list based on the ov::device::priorities.
* Update the logic to handle the situation like -d AUTO:-CPU to benchmark APP.
* Remove MYRIAD and add NVIDIA for AUTO supported devices.
---------
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Shen, Wanglei <wanglei.shen@intel.com>
* Update ov::hint::performance_hint UNDEFINED value from empty string to "UNDEFINED".
* Update benchmark Python version.
* Update.
* Update.
* Update.
* Update the description about hint setting within benchmark APP README and help message.
* Disable set_property() to support ov::device::properties setting.
* Update benchmark APP to set device properties through compile_model() instead of through set_property().
* Update.
* Update.
* Update some test case including ov::device::properties setting via core.ser_property().
* Since core.set_property() didn't support ov::device::properties setting, just remove the test case to check compile_model() works well if setting ov::device::properties via core.set_property() first.
* Update CompileModel in test name to CompiledModel
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Add corresponding test case.
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
* Update.
* Update.
* Remove the changes of this commit as this modification has nothing to do
with this PR.
This reverts commit 4f04b9f085.
---------
Signed-off-by: Wang, Yang <yang4.wang@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* benchmark_app: factor out advanced options
* cpp/benchmark_app: add usage word
* move api to advanced, group b/shape/data_shape/layout into Input shapes, factor out Statistics dumping options
* Factor out Device-specific performance options
* Factor out Preprocessing options
* Minor regroup
* [C++/BENCHMARK_APP] Introduce Numpy array loading for C++ benchmark app
* [DOCS/BENCHMARK_APP] Update docs to reflect changes, update list of available extensions from OpenCV, align help messages
* Update inputs_filling.cpp
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/inputs_filling.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update samples/cpp/benchmark_app/inputs_filling.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [C++/Python] Implement quality-of-life improvements from PR comments
* [C++] Fix compilation errors, fix linter output
* [C++/PYTHON] Apply requested changes
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update samples/cpp/benchmark_app/utils.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON] Separate loading of numpy arrays similar to images
* [PYTHON] Remove unnecessary 'Prepare xxx file' print
* Update README again because IF OPENCV.. dissapeared for some reason
* Update second README with missing IF OPENCV..
* [C++] Remove unnecessary vector print function
* [C++ Add Numpy processing function - TODO link it to the tensor filling
* Reverse OneDnn plugin modification
* [C++] Numpy array loading for C++
* [C++] Add (almost) all missing types of data
* Reverse submodule modifications
* [C++/PYTHON] Fix compilation errors, clean code
* [C++] Modify supported extensions, add numpy checking to utils, add numpy to get_image_info method
* Update samples/cpp/benchmark_app/inputs_filling.cpp
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [C++] Fix utils header file to reflect unordered set change
* [PYTHON/C++] Fix compilation errors in C++ code, fix Python dynamic shapes numpy loading
* [C++] Fix explicit instantiation of NumpyArray reader
* [C++] Clang format, minor syntax fixes
* [PYTHON/C++] Remove unnecessary data types, introduce a new approach to cast data of different types from format_rt_reader, remove uppercase types from Python precision parameters
* [PYTHON] Update README to reflect new precision settings
* [PYTHON] Fix README, fix clang format
* [C++] Clean headers
* [C++] Fix uninitialized variable error
* [C++/PYTHON] Fixed choices in Python benchmark, fixed types in C++ benchmark
* [C++] Fixed ov::float16conversion, fixed Python types map - removed redundancies
* [C++] Add back boolean support
* [C++] Fix compilation errors
---------
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
Sebastian Golebiewski