* Try to improve gflags
* Try to improve gflags: part 2
* Tried to use dependencies on system
* Use nlohmann_jsonConfig from system
* Enabled nlohmann_json from system
* Improvements
* handle system gflags in developer package
* Simplifications
* Simplify dependency management
* Corrected package names
* Fixed subgraphsDumper configure stage
* Try to fix rhel8
* Try to fix macosx
* Fixed VPUX build
* Fixed aliasing issues
* Suppress some wanrings
* export gflags when build it
* Fixed some LTO
* Try to fix Mac
* revert
* use gflags as private dependency
* Aligned targets in developer package
* Fixed frontends tests build on U20 with LTO
* PAssed
* Don't use pkg_search_module(zlib ..) during cross-compilation
* Removed unused variables
* Fixed finding of zlib during cross-compilation
* Removed a redundant image
* Fixed ops specifications and other issues
* converted html links to anchor links
* converted html links to anchor links
* Fixed a link
* Fixed a link
* Changed anchor links according to dev review
# Conflicts:
# docs/OV_Runtime_UG/Operations_specifications.md
PR for 22.1 made, now porting to release...
some discrepancy between this version and the 22.1 branch seems to exist, so I adjusted the conflicting link to avoid build check errors...
the overview has been merged, the remaining articles are reviewed here
* Added specification for EyeLike-9
* Update docs/ops/generation/EyeLike_9.md
* removed batch from TF
* minor fix
* Applied comment by Anton
* Added new example with dynamic output, added corner case
* Fixed corner case description
* Rename matrix
* applied comments by Yuan
* Added diag_idx as input, minor fixes, renaming
* added support of batch_shape from TF
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
* Written nGraph reference for the operation RDFT.
* Used std::reverse() algorithm to simplify the function reverse_shape() from fft_common.cpp.
* Added assert into the function offset_from_coords_and_strides().
* Deleted redundant variable.
* Deleted redundant functions from the reference implementation of (I)DFT.
* Renamed the method reverse_shape() in fft_common.hpp.
* Code style fix.
* update Auto docs
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update python snippets
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* remove vpu, fix a mistaken in python code
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update MYRIAD device full name
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update API name
old API use name Inference Engine API
NEW API usen name OpenVINO Runtime API 2.0
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update tab name, and code format
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix AUTO4 format issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update set_property code
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* auto draft
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* mv code into .cpp and .py
modify the devicelist part accoding to the review
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* remove priority list in code and document
modify the begning of the document
remove perfomance data
remove old API
use compile_model instead of set_property
add a image about cpu accelerate
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix mis print and code is not match document
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* try to fix doc build issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix snippets code compile issue
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* Added migration for deployment (#10800)
* Added migration for deployment
* Addressed comments
* more info after the What's new Sessions' questions (#10803)
* more info after the What's new Sessions' questions
* generalizing the optimal_batch_size vs explicit value message
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update docs/OV_Runtime_UG/automatic_batching.md
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Perf Hints docs and General Opt Guide refactoring (#10815)
* Brushed the general optimization page
* Opt GUIDE, WIP
* perf hints doc placeholder
* WIP
* WIP2
* WIP 3
* added streams and few other details
* fixed titles, misprints etc
* Perf hints
* movin the runtime optimizations intro
* fixed link
* Apply suggestions from code review
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* some details on the FIL and other means when pure inference time is not the only factor
* shuffled according to general->use-case->device-specifics flow, minor brushing
* next iter
* section on optimizing for tput and latency
* couple of links to the features support matrix
* Links, brushing, dedicated subsections for Latency/FIL/Tput
* had to make the link less specific (otherwise docs compilations fails)
* removing the Temp/Should be moved to the Opt Guide
* shuffled the tput/latency/etc info into separated documents. also the following docs moved from the temp into specific feature, general product desc or corresponding plugins
- openvino_docs_IE_DG_Model_caching_overview
- openvino_docs_IE_DG_Int8Inference
- openvino_docs_IE_DG_Bfloat16Inference
- openvino_docs_OV_UG_NoDynamicShapes
* fixed toc for ov_dynamic_shapes.md
* referring the openvino_docs_IE_DG_Bfloat16Inference to avoid docs compilation errors
* fixed main product TOC, removed ref from the second-level items
* reviewers remarks
* reverted the openvino_docs_OV_UG_NoDynamicShapes
* reverting openvino_docs_IE_DG_Bfloat16Inference and openvino_docs_IE_DG_Int8Inference
* "No dynamic shapes" to the "Dynamic shapes" as TOC
* removed duplication
* minor brushing
* Caching to the next level in TOC
* brushing
* more on the perf counters ( for latency and dynamic cases)
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Updated common IE pipeline infer-request section (#10844)
* Updated common IE pipeline infer-reqest section
* Update ov_infer_request.md
* Apply suggestions from code review
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
* DOCS: Removed useless 4 spaces in snippets (#10870)
* Updated snippets
* Added link to encryption
* [DOCS] ARM CPU plugin docs (#10885)
* initial commit
ARM_CPU.md added
ARM CPU is added to the list of supported devices
* Update the list of supported properties
* Update Device_Plugins.md
* Update CODEOWNERS
* Removed quotes in limitations section
* NVIDIA and Android are added to the list of supported devices
* Added See Also section and reg sign to arm
* Added Preprocessing acceleration section
* Update the list of supported layers
* updated list of supported layers
* fix typos
* Added support disclaimer
* update trade and reg symbols
* fixed typos
* fix typos
* reg fix
* add reg symbol back
Co-authored-by: Vitaly Tuzov <vitaly.tuzov@intel.com>
* Try to fix visualization (#10896)
* Try to fix visualization
* New try
* Update Install&Deployment for migration guide to 22/1 (#10933)
* updates
* update
* Getting started improvements (#10948)
* Onnx updates (#10962)
* onnx changes
* onnx updates
* onnx updates
* fix broken anchors api reference (#10976)
* add ote repo (#10979)
* DOCS: Increase content width (#10995)
* fixes
* fix
* Fixed compilation
Co-authored-by: Maxim Shevtsov <maxim.y.shevtsov@intel.com>
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
Co-authored-by: Karol Blaszczak <karol.blaszczak@intel.com>
Co-authored-by: Aleksandr Voron <aleksandr.voron@intel.com>
Co-authored-by: Vitaly Tuzov <vitaly.tuzov@intel.com>
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
Co-authored-by: Victoria Yashina <victoria.yashina@intel.com>
Co-authored-by: Nikolay Tyukaev <nikolay.tyukaev@intel.com>
* CPU device documentation refresh
* Bfloat16 inference page aligned with the new API
* Bfloat16 inference section moved to CPU main
* First review comments applied
* Second review step comments applied
* OneDNN reference changed to the GitHub page
* AvgPool added to the oneDNN ops list
* Add readvalue, assign to templte plugin test
* Fix clang error
* Fix clang error
* Remove unnecessary comment
* Fix type-casting error
* Fix ci issue regarding const value
* Change Function to Model
* Fix op scope
* Change way to get variable
* Fix type-casting error
* Set variable id to const
* Fix side-effect in ieFuncTests
* Implement Assign-3, ReadValue-3 in evaluates_map
* Correct setting attribute
* Correct setting attribute
* Remove unnecessarily added method
* Roll back v6
* Use member variable for variable_id in assign-3, read_value-3
* Get data pointer from host tensor
* Remove visitor API test for ReadValue-6, Assign-6
* Implement visitor api test for read_value-6, assign-6
* Fix clang error
* Split read_value and assign into each file for visitor test
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
* Update Binder URL on the tutorials landing page
Binder URL was linking to a file. It should go to an actual Binder tutorial.
(Replaces https://github.com/openvinotoolkit/openvino/pull/10747)
* binder logo
* fixes
Co-authored-by: CCR\ntyukaev <nikolay.tyukaev@intel.com>
* add placeholder for python version of first snippet
* fix problem with placeholder
* fix wrong file name
* fix fragment name
* update python snippets
* move imports to the top of the code fragments
* Modified the workflow diagram
* Moved supported topology lists to separate topics
* Additional changes
* Removed Supported Topologies list and Deprecated pages
* Created the Model Conversion Tutorials section for instructions for specific models
* Topic names alignment, removed Default_Model_Optimizer_Optimizations.md
* Additional structural changes
* Fixed links
* heading fixes
* Written the draft of the specification of the operation RFFT.
* Started to write the specification of the operation IRFFT.
* Small fix.
* Renamed RFFT operation as RDFT.
* Fix in Operations_specifications.md.
* Written the specification of the operation IRDFT.
* Fixes in examples.
* Fixes in opset9.md and Operations_specifications.md.
* Small fix.
* Replaced opset8 by opset9 in opset9.md.
* Deleted redundant sentences.
* Small fix.
* Replaced input_shape by data_shape.
* Fixed mistypes.
* Fixes of mistypes.
* Fixed typo.
* Fixed RDFT specification, in order to perform signal_size input as in TF and PyTorch.
* Fixes in examples for RDFT.
* Fixes in the output shape calculation of IRDFT. Now this calculation is as in TF and PyTorch.
* auto-batching- bare min of the info
* renaming BATCH.MD to the automatic_batching.md, also aligned the link to the new naming convention
* more info and brushed
* added openvino_docs_OV_UG_Automatic_Batching to the main TOC
* Apply suggestions from code review
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* close on the comments, added the code examples
* Apply suggestions from code review
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* Update example
* Update format
* Update docs format
* added couple of more perf considerations
* more code examples
* Apply suggestions from code review
* Apply the rest from code review
* Update header
Co-authored-by: Tatiana Savina <tatiana.savina@intel.com>
* [DOCS] hddl update
include info on hddl and myriad working at the same time
* Update docs/OV_Runtime_UG/supported_plugins/MYRIAD.md
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
* Update HDDL.md
* Update MYRIAD.md
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Andrey Zaytsev <andrey.zaytsev@intel.com>
* Added inputs argument to all compare() function overloads
* Rewritten compare() function for NMS
* Implemented sorting by name of expected outputs
* Implemented sorting by name of actual outputs
* Added accounting for simultaneous dynamism and the need to convert outputs in Template plugin
* Added a separate case to the GetBlob function for correct dimensions
* Rewritten Expected outputs sorting to work correctly on cpuFuncTests
* Fixing code style problems
* Implemented sorting by name of actual outputs for functional tests
* Debug prints removed
* Replacing a raw pointer with a vector
* Fixing code style problems
* Shifting the sorting place Expected outputs
* Added sorting of Expected exits in one more place
* Quality transition to SLT2.0
* Removing unnecessary code after SLT2.0
* Fix soft_nms_sigma argument
* Removing unnecessary parts after SLT2.0
* Remove unnecessary outputs sorting
* Removing parts from the code for debugging
* Fix for NMS
* Trying to make CI green
* Checking test passage without adding convert precision
* Checking CI
* There is an algorithm that adds Convert only if there is f16, fp16 in inputs
* Add Convert Op in cases where inputs are not already installed f32
* Check that the CI will go away if you put everything back
* Revert changes, validate f32 change on ci
* Adding Convert f16-f32 only if there is a function parameter of type f16
* The presence of f16/bf16 as a parameter type is now mandatory to add Convert
* Added prints for params, inputs, outputs
* Logic checking the absence of Convert
* Cosmetic fixes
* Setting the correct value for selected_scores_type NMS-5
* Fix bf
* Increased readability
* Missing parts added
* Removed the static for the vector
* [MO] Clean-up MO cmd-line options
Remove the following Model Optimizer deprecated options that are no longer used for several releases: disable_fusing, disable_gfusing, generate_deprecated_IR_V7,
legacy_ir_generation, keep_shape_ops, move_to_preprocess
Deprecate through CLI the following options for which functionality triggered from POT or automatically: disable_weights_compression, disable_nhwc_to_nchw,
disable_resnet_optimization, finegrain_fusing.
Correct and extend description of each MO option to be printed during model conversion.
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Correct documentation about input shapes
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Perform final corrections in documentation
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove legacy_ir_generation overall
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Clean-up tests from deprecated options
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Recover disable_fusing option as deprecated
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix keys for static_shape and extensions
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove extension key that does not work
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply feedback: remove disable_gfusing, correct docs
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Recover disable_fusing option for unit-tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply feedback for documentation
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply feedback about parameters use_legacy_frontend and use_new_frontend
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* DO minor fixes for indentation of MO logs
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Revert log.error for fallback message
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Revert disable_weights_compression parameter for tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fixed some comments about transformations
* Changed transformation guide
* Fixed typo
* Moved transformation doc to extensibility
* Moved images to Extensibility_UG
* Added separate document for each pass
* Added see also section
* Fixed comments
* Used new config for streams and threads
* Fixed review coments in ba
* format fix
* fixed hello_query_device
* Added STL string io
* fixed tests
* Fixed test
* Fixed build
* fixed format
* Fixed build
* try fix win
* other any io specialization
* Fixed after merge
* renamed streams
* build fixed
* fixed build
* fixed format
* fix for old mac build
* Fixed type of exception
* test fix
* Added ov configuration test
* Added common OV properties tests
* fix mklnn
* fixed foramat
* merge conflicts
* Remoed compile_model tests
* removed duplicated test
* installing-openvino-yocto: fix documentation links
Point to the new Yocto docs website.
Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
* Update installing-openvino-yocto.md
* installing-openvino-yocto: add step to checkout specific branch
Request users to checkout specific branch of meta-intel where this
version of OpenVINO is available.
Signed-off-by: Anuj Mittal <anuj.mittal@intel.com>
Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
Co-authored-by: Anuj Mittal <anuj.mittal@intel.com>
Co-authored-by: Yuan Xu <yuan1.xu@intel.com>
* Added info on DockerHub CI Framework
* Feature/azaytsev/change layout (#3295)
* Changes according to feedback comments
* Replaced @ref's with html links
* Fixed links, added a title page for installing from repos and images, fixed formatting issues
* Added links
* minor fix
* Added DL Streamer to the list of components installed by default
* Link fixes
* Link fixes
* ovms doc fix (#2988)
* added OpenVINO Model Server
* ovms doc fixes
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
* Updated openvino_docs.xml
* Updated the link to software license agreements
* Revert "Updated the link to software license agreements"
This reverts commit 706dac500e.
* Removed the Intel logo
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now
* update repo
* add initial op reference code of TensorIterator with LSTM body function
* add GRU/RNN case in setup
* add all other test cases
* add visitor api test
* remove unnecessary header files
* fix clang-format issue
* fix copyright year and remove ngraph_helper namespace
* rename ti.cpp to tensor_iterator.cpp in core unit test
* apply suggestions
* [DOCS] add minor changes to install guides
[DOCS] add minor changes to install guides
[DOCS] add minor changes to install guides
[DOCS] add minor changes to install guides
[DOCS] add minor changes to install guides
[DOCS] add minor changes to install guides
* [DOCS] add minor changes to install guides
* Added info on DockerHub CI Framework
* Feature/azaytsev/change layout (#3295)
* Changes according to feedback comments
* Replaced @ref's with html links
* Fixed links, added a title page for installing from repos and images, fixed formatting issues
* Added links
* minor fix
* Added DL Streamer to the list of components installed by default
* Link fixes
* Link fixes
* ovms doc fix (#2988)
* added OpenVINO Model Server
* ovms doc fixes
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
* Updated openvino_docs.xml
* Updated the link to software license agreements
* Revert "Updated the link to software license agreements"
This reverts commit 706dac500e.
* Revised dlstreamer documentation
* Minor edits
* Fixed link
* Fix
* Edits after review
* Shorten DL Streamer name in the TOC
* Update documentation.md
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
fix canConvolutionBeTransformed arguments
fix isAsymmetricOnWeights in GPU plugin
added defaultPrecisions in TestTransformationParams
set new default attribute precisions
try to set const default precisions in network_helper.cpp
apply precision_set
[LPT] Default precisions
rebase
remove extra const
used defaultPrecision in tests
fixed SimpleLowPrecisionTransformer default argument
fixed AttributeParameters default argument
added defaultPrecisions in functions
fix assign_and_read_value_transformation tests
fixed wrong defaultPrecisions definition
fixed ConcatWithNeighborsWithConvolutionTransformation tests
remove getDefaultPrecisions
rebase
remove getDefaultPrecisions from gpu plugin
remove getDefaultPrecisions from lpt_mkldnn_plugin.cpp
use predefined member
update mkldnn_plugin.cpp & lpt_mkldnn_plugin.cpp
resolved conversations
make all lambda captures by ref
* Used new config for streams and threads
* Fixed review coments in ba
* format fix
* fixed hello_query_device
* Added STL string io
* fixed tests
* Fixed test
* Fixed build
* fixed format
* Fixed build
* try fix win
* other any io specialization
* Fixed after merge
* renamed streams
* build fixed
* fixed build
* fixed format
* fix for old mac build
* Fixed type of exception
* test fix
* fix bug in Serialize (#74447)
add simple serialization test to check pads changes
clang fix
add check and change pads in conv
refactor ov::clone_model
fix
check in test
* fix FrameworkNode and add test
* fix assert in identiry.cpp
* fix clone_nodes
* remove for node and constructor for node_input.cpp
add spaces
add space
* Added info on DockerHub CI Framework
* Feature/azaytsev/change layout (#3295)
* Changes according to feedback comments
* Replaced @ref's with html links
* Fixed links, added a title page for installing from repos and images, fixed formatting issues
* Added links
* minor fix
* Added DL Streamer to the list of components installed by default
* Link fixes
* Link fixes
* ovms doc fix (#2988)
* added OpenVINO Model Server
* ovms doc fixes
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
* Updated openvino_docs.xml
* Updated the link to software license agreements
* Revert "Updated the link to software license agreements"
This reverts commit 706dac500e.
* Added a link to the omz repo
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
* Check the selected frontend to correspond use_new/legacy_frontend options
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix a default case when no frontend is found
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now
* update repo
* fix demension dynamic support bug in mish op reference test
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now
* update repo
* add initial op reference test of rnn_sequence
* add op reference test of GRUSequence
* replace input and refOut data to hard coded value
* update copyright year and namespace of Tensor
* rename S_t to sequence_lengths
* ROI tensor support for Template plugin + tests for Template and CPU plugins
GPU doesn'tsupport ROI tensors, so tests were not added for GPU
* Added asserts for unsupported mixed axis order (like 0,3,1,2), and unsupported types like int4/int2 for ROI tensors
* Avoid duplicated outputs with the same name
* Revert onnx graph changes
* Allow output duplicates in ie_plugin_internal check
* Add test with onnx model
* Check get_tensor_ptr instead of any_name
* More outputs test
* Refactor to use std::transform
* test manifest update
* Remove redundant header
* INTERPRETER segfaults fix for duplicated output names
* Simplify duplication assert
* Update test names
* Test update
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now
* update repo
* initial code commit
* add runtime reference
* apply ov::Model
* initial lstmcell-1 definition
* initial change
* apply Peepholes
* apply input_forget option
* apply initial test case of lstmsequence-1
* fix clang-format error
* fix clang-format error 2
* add lstms_sequence test cases by runtime reference and onnx test cases
* fix clang-format error
* fix clang-format error
* fix onnx test failure of LSTM IE_CPU
* fix clang-format issue
* fix clang-format issue 2
* add type_prop and visitor api test of lstm_sequence_v1
* fix clang-format error
* replace input/refOut data to hard coded and remove unnecessary enum definition
* update namespace of Tensor()
* remove supported test cases in disabling list
* Implement interpolate-1 and interpolate-4 in template plugin test
* Fix clang error
* Fix clang error
* Fix clang error
* Fix linux build
* Fix cpplint error
* Fix clang error
* Fix linux build
* Change way to pass attribute into struct for linux build
* Correct supported type
* Fix clang error
* Add visitor api test for interpolate-1 and interpoate-4
* Fix typo and cpplint
* Update copyright
* Avoid using a class that will be deprecated
* Rollback to CoordinateTransform
* Remove interpolate.in.cpp
* Preserving of input/output indices for ONNX.
* Fixed checks.
* Fixed for case of multiple outputs of node before Result.
* Added test for multiple tensor names before Result.
* Multiple tensor names before Result fix.
* Added order alignment for user input/output.
* Extended for case of input names in Parameter tensor list.
* Fixed unit tests.
* Corrected help.
* Small correction.
* Code refactoring.
* Temporarily reverted refactor.
* Fixed wrong changes.
* Fixed wrong changes.
* Returned reverted refactoring.
* Removed inputs_list from serializing.
* Loop/If/TensorIterator - fix dynamic input cases
Reference evaluate for body uses Model::evaluate instead of custom evaluation
Loop/TensorIterator additional fix - set result shape according to body execution result
Only op_eval test verifies issues, template tests were added just in case (these passed even without fix)
* Fix clang-format
* rename ti.cpp
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now
* update repo
* add op reference test of region_tolo
* add type_prop test and remove backend test of region_yolo
* apply type conversion for loading file test and add bf16 test case in skip_test_config
* change location of compile definition under target and use path_join from file_util
* add dependency of test_model_zoo
* apply ov::Model
* remove unnecessary
* changed compile definition of TEST_FILES
* skip test cases of external test file
* remove test cases of importing data file
* add warning about order if both mean and scale set
* Update tools/mo/openvino/tools/mo/main.py
Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>
* removed warning, added phrase in documentation
* fixed merge
* added phrase about order of ,mean and scale in MO help
* duplicate MO help phrase in doc
* Update docs/MO_DG/prepare_model/convert_model/Converting_Model.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update docs/MO_DG/prepare_model/convert_model/Converting_Model.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update docs/MO_DG/prepare_model/convert_model/Converting_Model.md
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update tools/mo/openvino/tools/mo/utils/cli_parser.py
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Update tools/mo/openvino/tools/mo/utils/cli_parser.py
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* remove tabs
* fix in order of reverse, mean, scale
Co-authored-by: Anastasia Popova <anastasia.popova@intel.com>
Co-authored-by: Anastasiya Ageeva <anastasiya.ageeva@intel.com>
* Move 'NV12toRGB/BGR' reference evaluates to template plugin
CPU doesn't need this fallback, so implementation can be moved to reduce core binary size
* Moved evaluate_nv12 to 'runtime::reference'
* Fix arm build
* Calculate model layout based on 'tensor' layout and convert steps
Previously, 'model layout' is set to '...' by default,
thus no shape conversion happened when tensor layout is set to 'NHWC', then there was explicit convert_layout "NCHW"
Now "model layout" is calculated based on tensor layout and conversion steps:
Examples:
1) Tensor: NHWC, Convert: NCHW. Result: NCHW
2) Tensor: NHWC, Convert: 0312. Result: NCHW
* Fix for set_shape + resize case
* [LPT] Documentation
* 1) ToC was removed 2) SVG => PNG temporary conversion
* [LPT] Refactoring + developer guide
* [LPT] attribute doxygen documentation was added
* [LPT] Developer Guide to Reference API links were added
* [LPT] comments fixes
* [LPT] Reference API to Developer Guide links were added
* [LPT] titles were changed
* [LPT] comments fixes#2
* [LPT] root document was moved to Plugin DG
* [LPT] Documentation: image link quick fix
* [LPT] Docummentation: PrecisionsAttribute description quick fix
* fix comments from Karol
* fixes
* movement
* directive was added
* movement #2
* LPT reference in Executable Network rollback
* snippets were updated ini accordance with new API
* cli_parser.py fix to accept scalar value for freezing
* update cli help
* fixed unit-tests, clarified help for specifying data type
* typos correction
* auto-batching POC squashed (all commits from auto-batch-2021.3 branch)
(cherry picked from commit d7742f2c747bc514a126cc9a4d5b99f0ff5cbbc7)
* applying/accomodating the API changes after rebase to the master
* replaying modified version of actual batch selection
* eearly experiments with model mem footprint
* changes from rebasing to the latest master
* experimenting with DG1 on the batch size selection, also collecting the mem footprint
* WIP:moving the auto-batching to the icore to let the MULT/AUTO support that, ALLOW_AUTO_BATCHING as a conventional config key. still fials hot device swap
* quick-n-dirty batch footpint vs device total mem
* code style
* testing which models perform badly due to kernels and NOT (batched) footprint
* stub pipeline task to comunicate the readiness rather than promise/future
* quick-n-dirty timeout impl
* explicit _completionTasks,reverting BA to use the timeout
* inputs outputs copies, works with AUTO and demo now
* accomodate the config per device-id, after rebase to the latest master
* allowing the auto-batching only with tput hint to let more conventional tests pass
* fix the pre-mature timeout restaring via waiting for batch1 requests completion
* moved the bacthed request statring ( along with input copies) to the dedicated thread
* [IE CLDNN] Disable bs_fs_yx_bsv16_fsv16 format for int8 convolution
* code style
* increasing the timeout to test the ssd_* models perf (timeout?) issues
* reducing number of output stuff in BA to avoid bloating the logs in experiments
* more aggressive batching for experiments, not limited to 32 and also 4 as a min
* more accurate timeout debugging info
* getting the reqs limitation from the plugin SetConfig as well
* refactor the reshape logic a bit to accomodate CPU for bathcing, also added remeote context
* let the benchamrk_app to consume specific batch values for the auto-batching such as BATCH:GPU(4)
* auto-batching functional test (with results check vs ref) and GPU instance for that
* fixed arithemtic on blobs ptrs
* clang
* handling possible batched network failure
* BATCH as the constants device name in test
* ENABLE_BATCH
* func tests for CPU, also DetectionOutput hetero tests (CPU and GPU)
* DetectionOutput hetero test for the CPU
* reenabling the Auto-Batching in the AUTO
* auto-batching device enabled in the test
* fixed the DO test
* improve the loading loop logic
* brushed the config keys
* allow hetero code-path for explicit device name like BATCH:GPU(4), used in the hetero code-path tests
* fix the test after refactoring
* clang
* moving ThreadSafeQueue to the ie_parallel, as it is re-used in the AUTO/MULTI and BATCH now
* auto-batching hetero test (subgraph with DetectionOutput)
* fixed minor changes that were result of experiments with impl
* code-style
* brushing, disabling CPU's HETERO tests until planned activity for 22.2
* removing home-baked MAX_BATCH_SZIE and swicthing to the official impl by GPU team
* remote blobs tests for the auto-batching (old API)
* brushed names a bit
* CreateContext and LoadNEtwork with context for the Auto-Batching plus remote-blobs tests
* fixed the ieUnitTests with adding CreateContext stub to the MockICore
* clang
* improved remote-blobs tests
* revert the back BA from exeprimenents with AB + device_use_mem
* conformance tests for BATCH, alos batch size 1 is default for BATCH:DEVICE
* remote blobs 2.0 tests, issue with context having the orig device name
* debugging DG1 perf drop (presumably due to non-fitting the device-mem)
* disbaling WA with batch/=2 for excesive mem footptint, leaving only streams 2
* remote blobs 2.0 tests for different tensor sharing types
* converting assert to throw to accomodate legacy API where the lock() was possible to be called
* revert the timeout back to avoid mixing the studies, fixed the footprint calc
* reverting to estimating the max batch by extrapolating from bacth1 size
* more conservative footptint etimation (with bacth1), graceful bacth 1 handling without duplication
* even graceful batch 1 handling without duplication
* WA for MAX_BATCH_SIZE failure, removing batch4 as a min for the auto-batching
* AutoBatchPlugin -> ov_auto_batch_plugin
* WA for gcc 4.8
* clang
* fix misprint
* fixed errors resulted from recent OV's Variant to Any transition
* skip auto-batching for already-batched networks
* AUTO_BATCH_TIMEOUT and tests
* GPU-specific L3
* switched to pure config, also improved ALLOW_AUTO_BATCHING config key handling logic
* debugging device info
* enabling the config tests for the GPU and fixing the Auto-batching tests to pass
* making the default (when not recognized the driver) cache size more aggressive, to accomodate recent HW with old drivers
* skip auto-batching for RNNs and alikes (e.g. single CHW input)
* fixed fallback to the bacth1 and moved HETERO path under condition to avoid bloating
* brushing
* Auto plugin GetMetric support gpu auto-batch
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* add test case
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* add comments on test
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* brushing the vars names, alos adding the excpetion handling
* disabling the auto-batching for the networks with non-batched outputs and faster-rcnn and alikes (CVS-74085) to minimize the of #failures
* add try catch
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* brushing the code changed in the GPU plugin
* Auto-Batch requests tests
* brushed varibles a bit (ref)
* cleaned debug output from the ie_core
* cleaned cmake for the Auto-Batch
* removed batchN estimation from batch1
* cleaned from debug printf
* comments, cleanup
* WA the mock test errors introduced with merging the https://github.com/myshevts/openvino/pull/13
* Adding back removed batchN estimation from batch1 to debug degradations on DG1 (resulted from too optimistic MAX_BATCH_SIZE?). This partially reverts commit e8f1738ac1.
* brushing ie_core.cpp
* fix 32bit compilation
* Code review: ENABLE_AUTO_BATCH
* consolidate the auot-batching logic in ie_core.cpp into single ApplyAutoBAtching
* renamed brushed the OPTIMAL_BATCH (now with_SIZE) and mimicks the MAX_BATCH_SZIE wrt MODEL_PTR
* default value for the OPTIMAL_BATCH_SIZE
* clang
* accomodate new func tests location
* fix shuffle of headers after clang + copyrights
* fixed misprint made during code refactoring
* moving the common therad-safe containers (like ThreadSafeQueue) to the dedicated dev_api header
* switch from the device name to the OPTIMAL_BATCH_SIZE metric presence as a conditin to consider Auto-Batching
* switching from the unsafe size() and minimizing time under lock
* code style
* brushed the ApplyAutoBatching
* brushed the netric/config names and descriptions
* completed the core intergration tests for the auto-batching
* ExecGraphInfo and check for incorrect cfg
* removed explicit dependencies from cmake file of the plugin
* disabling Auto-Batching thru the tput hint (to preserve current product default), only excplicit like BATCH:GPU used in the tests
Co-authored-by: Roman Lyamin <roman.lyamin@intel.com>
Co-authored-by: Hu, Yuan2 <yuan2.hu@intel.com>
* Remove some legacy targets
* Replace some targets
* Removed inference_engine_plugin_api dependency
* Minor comment for developer config
* Fixed include paths
* Small fixes for static build
* Try to fix build pyopenvino
* Fixed comments
* Try to fix build
* Include OpenVINODeveloperPackage inside InferenceEngineDeveloperPackageConfig
* Try to fix GAPI tests
* Fix incomprehensible error message during layout conversion when layout rank doesn't match with shape rank
* Stash
* stash
* Memcpy implementation
Added tests
* Revert "Fix incomprehensible error message during layout conversion when layout rank doesn't match with shape rank"
This reverts commit 37064741b2.
* Fix clang-format and remove redundant headers
* Covered "cached" case (+ tested on Myriad)
* Apply review comments
Introduced 'applyBatchedBlob' function which allows override 'memcpy' on inferefnce time
* clang-format fix
* Added dynamic shape case
* - Review comments
- Deep copy of parameters/results for caching from cnnNetwork. Deep copy logic is moved to Utils
- Caching Tests: return correct inputs/outputs map after ImportNetwork mock call
* Reworked according to discussion
Also introduced 'SetBlobsImpl' which throws 'Not implemented' exception by default.
Template plugin updates internal '_batched_inputs' map
* Updated according to moved tests
* don't support 'memcpy' for ROI tensors
* Fix caching tests
* Just to retrigger CI
* Correct offset padding (however there is no test update as current implementation will not hit here due to other checks)
* Fix clang-format
* Applied review comments
* Added check that 'get_tensor' throws if set_tensors/set_input_tensors is used
* Fix review comments - part 1
* Fix caching tests - mock implementation becomes more complicated
Cached mock model shall identify its inputs/outputs, otherwise core will assert on SetExeNetworkInfo stage
* More comments fix
* More comments fixes
* More cleanup
* And more style comment
* typo fix
* Try fix caching windows tests
* Blind attempt to fix Ubuntu20 CI
* Renamed ov::Function to ov::Model
* Fixed all for macos
* Fixed build
* Fixed build
* Revert changes in GPU plugin
* Fixed ngraphFunctions
* Fixed all for mac
* Fixed new test
* Fixed if for Windows
* Fixed unit tests and renamed Function in python API
* Fixed code style
* Fixed import
* Fixed conflict
* Fixed merge issues
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now
* update repo
* add op reference test of ExperimentalDetectronPriorGridGenerator
* implement actual_comparision_size for compare
* update slt for actual comparison size and add visitor api test
* fixed clang error
* Moved and merged mo/ and extensions/ into openvino/tools/mo
* edited imports
* edited docs to use mo script from entry_point
* edited MO transformations list loading and setup.py
* changed full path -> 'mo' entry point in docs (leftovers)
* corrected package_BOM
* updated resolving --transformation_config in cli_parser.py
* pkgutil-style __init__.py, added summarize_graph into entry points
* updated DOCs for the new --transformations_config
* fix select
* updated install instructions, fixed setup.py for windows and python_version < 3.8
* fixed typo in requirements.txt
* resolved conflicts
* removed creating custom __init__.py from setup.py
* corrected folder with caffe proto
* corrected loading user defined extensions
* fix openvino.tools.mo import in serialize.py
* corrected layer tests for new namespace
* fix in get_testdata.py
* moved model-optimizer into tools/
* renamed import in POT
* corrected mo.yml
* correct CMakeLists.txt for the newest tools/mo
* corrected find_ie_version.py
* docs and openvino-dev setup.py update for the newest tools/mo
* miscellaneous leftovers and fixes
* corrected CI files, pybind11_add_module in CMakeLists.txt and use of tools/mo path instead of tools/model_optimizer
* add_subdirectory pybind11 for tools/mo
* POT path fix
* updated setupvars.sh setupvars.bat
* Revert "updated setupvars.sh setupvars.bat"
This reverts commit c011142340.
* removed model-optimizer env variables from setupvars
* updated CMakeLists.txt to pack MO properly with tests component
* corrected left imports, corrected loading requirements for layer tests
* mo doc typo correction
* minor corrections in docs; removed summarize_graph from entry_points
* get_started_windows.md, MonoDepth_how_to.md corrections, mo path corrections
In case of partially-dynamic shape, e.g. {?,3,?,?} shape inference
for gathering channels and reverse operations can't infer final shape to {?,3,?,?} and it becomes {?,?,?,?}
Added 'static' version of reverse-channels to preserve output shape for such cases
It can be changed in future if operations will be able to calculate shape on 'validate' phase
* Implement MO part for DetectionOutput-8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement nGraph part for DetectionOutput-8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement deduction of a number of classes method
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix build
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement nGraph tests to check shape inference for DetectionOutput-8 with deduction of num_classes
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement attributes tests for DetectionOutput-8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove DetectionOutput-1 from opset8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add python bindings for DetectionOutput-8 and tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement downgrading and upgrading transformations for DetectionOutput
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Implement tests for downgrading and upgrading transformations for DetectionOutput
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Adopt existing reference for DetectionOutput-8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix DetectionOutput-8 reference
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add tests for DetectionOutput-8 reference
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Finish resolving merge conflict
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix python bindings after re-structuring
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix BOM package list
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix multibox_detection_test
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix python bindings for DetectionOutput-8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Insert blank line between summary and description for python binding
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply review comments: identation, for loop
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix formatting in python bindings
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix supported_attrs for DetectionOutput from opset1
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add missed imports for python if_op
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply feedback and fix Win build
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Use the same test suite name for test mixture
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix transformation tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Recover BWDCMP_RTTI for legacy use and remove unused variables in tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove unused variables in type_prop tests
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Recover legacy referenceDetectionOutput constructor
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix python binding for DetectionOutput
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Renamed plugin
* Changed plugin source dir
* Fixed tests
* Renamed ENABLE_GNA to ENABLE_INTEL_GNA
* Fixed centos compile error
* One more renaming place
* HF for centos 7
* renamed the name in version api
* Fixed CI configurations
* Disabled GNA plugin for old gcc (<=5.4)
* Fixed Azure Win job
* Specify DetectionOutput-8 operation
The delta is small where we just remove num_classes attribute to support OD models out of the box
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Remove a link to DetectionOutput-1 from opset-8
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Update a list in ie_docs.xml
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Removed 'inline' Preprocessing API
Even though this API provided a way to specify all pre/post-processing in one line - it was considered inconvinient
With 'getters' API preprocessing code looks more clear for user, so old' inline' API is removed
* Fix pyopenvino build issues
* Update after merged PR#8717
* ngraph and inference-engine parts
* add priorbox_8 python api
* remove 'PriorBoxAttrs' and 'PriorBox' from outside of opset namespace
* add common nGraph transformation 'ConvertPriorBox8To0'
* remove redundant alias of PriorBox::Attributes
* use new Tensor api for evaluate method
* change v0operation back to the former api, pass Attribute structure to the reference implement
* use new Tensor api for constant_fold
* add support for dynamic shapes of constant_fold new Tensor api
* fix Node 'create temp tensors' issue when shape==0'
* revert to 'HostTensor' api for PriorBox8
* Apply suggestions from code review and 'template_plugin reference' testcase replaced 'backend INTERPRETER' testcase
* transformation part Apply suggestions from code review
* python init file updated for opset8
* keep backward compatibility to fix CI issue
* rebase to new structure of OpenVINO repo
* revert 'thirdparty/onednn_gpu' mistake changes
* Moved openvino to src
* Moved ngraph and frontends to src
* Fixed cmake generation
* Moved inference_engine libs to src
* Moved C API to src
* Fixed CMake generation
* Moved readers to tests, snippets and preprocessing to common
* Fixed CMake
* Moved transformations and lp_transformations
* Fixed transformations cmake
* Fixed build
* Fixed unit-tests and ci paths
* Fixed docs
* Fixed C API build
* Try to fix static build
* More clear order
* Renamed inference_engine_legacy_api to legacy
* Fixed some cmake scripts
* Fixed path to legacy
* Fixed Myriad plugin
* Fixed v7 reader
* Fixed plugin.hpp
* Fixed developer config
* Fixed ie_parallel
* add 2nd batch paddle models in Convert_Model_From_Paddle.md
* narrow down supported paddle model from MobileNet-SSDLite to MobileNetv3-SSD in Convert_Model_From_Paddle.md
* Increase image size to avoid test failures on some platforms
There is an assert 'length >= nlanes' and 'nlanes' value depends on machine architecture
Set 320x320 test image to guarantee that image size >= nlanes
Also increased image size for 'plugin shared tests' to ensure the same (even though tests do not work with legacy preprocessing)
* Descreased to 160x160
* Migrate Sort (TopK-1)
* Add topk_mode_sort_order
* Skip topk_min_sort_none in Windows
* Add types to tests
* Skip topk_max_sort_none and topk_min_sort_none
* Modify names from 1d to 1dMaxMin and SetUp1 to SetUpSecond
* Add outIdx to run tests one by one
* Set default value 0 to outIdx
* Remove copy_data
* Support pads_begin & pads_end as dynamic ops in Pad
* Extend Pad template test w/ NonConst PB & PE cases
* Remove xfails for 69443 after issue was fixed
* Added info on DockerHub CI Framework
* Feature/azaytsev/change layout (#3295)
* Changes according to feedback comments
* Replaced @ref's with html links
* Fixed links, added a title page for installing from repos and images, fixed formatting issues
* Added links
* minor fix
* Added DL Streamer to the list of components installed by default
* Link fixes
* Link fixes
* ovms doc fix (#2988)
* added OpenVINO Model Server
* ovms doc fixes
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
* Updated openvino_docs.xml
* Updated the link to software license agreements
* Revert "Updated the link to software license agreements"
This reverts commit 706dac500e.
* Fixed diagram
Co-authored-by: Trawinski, Dariusz <dariusz.trawinski@intel.com>
* Renaming all frontends from "*_ngraph_frontend*" to "_ov_frontend*"
Also Debug builds on Windows release frontends without "d" suffix will not be loaded
* Fix review comments and add wheels test debug prints
* More debug prints
* Load by absolute path and remove debug prints
* [MO, TF] Support Custom Wide and Deep CTR model by MO
It implements implicit support of EmbeddingSegmentsMean operation through decomposition.
Also, this extends the current transformation to fuse TensorFlow sub-graph (for Wide and Deep model family)
containing SparseSegmentSum and SparseSegmentMean operations into EmbeddingSegmentsSum or EmbeddingSegmentsMean.
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix unit-tests after modifications of SparseToDense and EmbeddingSegmentsOperationFusing
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Document SparseSegmentMean support
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Add computation scheme for normalization coeffs and correct documentation
Signed-off-by: Roman Kazantsev <roman.kazantsev@intel.com>
- PrePostProcessor takes 'function' argument in constructor
- PrePostProcessor::build() doesn't take any function anymore
- PrePostProcessor::input() method to get reference to input
- PrePostProcessor::output() method to get reference to output
- InputInfo - add getters of tensor, preprocess, network
- OutputInfo - add getters of tensor, preprocess, network
Samples:
ClassificationSampleAsync - use new getters
Inference engine:
- Use new getters in ie_network_reader.cpp
TODO: Consider removal of builder-like API in PrePostProcessor, InputInfo, OutputInfo
* Add GatherND_8 operation
* Update shape infer function and tests
* Initial commit for nGraph GatherND_8 operation
* Add GatherNDBase class implementation
* Fix base class errors
* Add missrd header
* Update base class
* Update GatherND_8 implementation
* Fix codestyle
* Fix wrong rank
* Implement tests for gatherND_8 shape inference function
* fix codestyle
* Add limitation to doc
* Siplyfy check in shape inference
* Add more test cases
* Update shape inference function
* Add more test cases to cover all case with dynamic input shapes
* Update shape inference function
* Refactor tests
* Initial commit for gatherND_8 reference implementation
* Add visitor tests for gatherND_8 operation
* Add visitor tests for gatherND_8 operation
* Correct comment
* Add additional check is shape inference function
* Update shape inference implementation for gathernd operartion
* Fix codestyle
* Remove restriction for data is fully defined
* Update shape inference functon
* Add gatherND_8 reference to evaluate map
* Add tests for gathernd_8 reference in batch_dims > 1
* Fix codestyle
* Fix codestyle
* Fix missed check for nonetype
* Remove redundant checks for batch_dims
* Use get_shape method instead of get_input_shape in GatherND reference implementation call
* update reference implementation call
* Properly add GatherND_8 to test opset table
* Update GatherND reference implementation for support opset8 version
* Add unit tests for gatherND_8 reference implementation
* Update gatherND reference implementation call in evaluate map
* Mark failed tests for missed plugin gatherND_8 implementations
* Fix codestyle
* Fix codestyle
* Fix codestyle
* Update tests
* Move common methods to base class
* Fix codestyle
* Revert clone_with_new_input function moving
* Add more test for reference
* partially revert API changes
* revise LSTM spec
Signed-off-by: fishbell <bell.song@intel.com>
* add param check and related test case
Signed-off-by: fishbell <bell.song@intel.com>
* fix clang-format
Signed-off-by: fishbell <bell.song@intel.com>
* use static_cast to replace c style force conversion
Signed-off-by: fishbell <bell.song@intel.com>
* Migrate Movement2 (BatchToSpace-2, DepthToSpace-1, Roll-7, ShuffleChannels-1, SpaceToBatch-2, SpaceToDepth-1)
* Fix typos while copying
* Update to opset namespace and add i4, u4, bf16 tests when available
* Remove i4, u4 tests from BatchToSpace and Roll
* Proper cmake install for static libraries case
* Added an ability to skip template plugin
* Added install rules for VPU / GPU
* Install more libraries
* Fixed absolute TBB include paths
* Disable GNA
* Fixed issue with linker
* Some fixes
* Fixed linkage issues in tests
* Disabled some tests
* Updated CI pipelines
* Fixed Windows linkage
* Fixed custom_opset test for static casr
* Fixed CVS-70313
* Continue on error
* Fixed clanf-format
* Try to fix Windows linker
* Fixed compilation
* Disable samples
* Fixed samples build with THREADING=SEQ
* Fixed link error on Windows
* Fixed ieFuncTests
* Added static Azure CI
* Revert "Fixed link error on Windows"
This reverts commit 78cca36fd2.
* Merge static and dynamic linux pipelines
* Fixed Azure
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now
* update repo
* add op reference test of prior_box/prior_box_clustered/reorg_yolo and remove ngraph backend test
* remove related backend test file
* Add GatherND_8 operation
* Update shape infer function and tests
* Initial commit for nGraph GatherND_8 operation
* Add GatherNDBase class implementation
* Fix base class errors
* Add missrd header
* Update base class
* Update GatherND_8 implementation
* Fix codestyle
* Fix wrong rank
* Implement tests for gatherND_8 shape inference function
* fix codestyle
* Add limitation to doc
* Siplyfy check in shape inference
* Add more test cases
* Update shape inference function
* Add more test cases to cover all case with dynamic input shapes
* Update shape inference function
* Refactor tests
* Add visitor tests for gatherND_8 operation
* Correct comment
* Add additional check is shape inference function
* Update shape inference implementation for gathernd operartion
* Fix codestyle
* Remove restriction for data is fully defined
* Update shape inference functon
* Fix missed check for nonetype
* Remove redundant checks for batch_dims
* Fix codestyle
Karol Blaszczak