* Merge master, use new token
* Minor changes
* Relax Python version
* Apply new python to rest of jobs
* Revert changes to custom images
* Minor changes
* Revert win changes
* Upgrade cython
* Test with lower cython
* Remove venv
* Cleanup
* Relax version spec
* Fix lin
* Revert changes to linux.yml
* Minor changes
* keep Shape subgraph in FP32 for GPU
* replaced ngraph:: -> ov:: namespace
* renamed ConvertModelToFP16ElementType -> ConvertCompressedToMixedPrecision and other passes; removed unnecessary argument for the pass
Signed-off-by: Pavel Esir <pavel.esir@intel.com>
* Update src/common/transformations/src/transformations/common_optimizations/convert_compressed_to_mixed_precision.cpp
* Update src/common/transformations/src/transformations/common_optimizations/convert_compressed_to_mixed_precision.cpp
* rephrase calling of ConvertPrecision to avoid error of an unused variable
* Update convert_compressed_to_mixed_precision.cpp
* placed calling of ConvertCompressedToMixedPrecision into the beginning of CommonOptimizations
* Update transformations_pipeline.cpp
* refactored unit-tests
* cleared obsolete commented line
* code style fix
* Update src/common/transformations/src/transformations/common_optimizations/common_optimizations.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
Signed-off-by: Pavel Esir <pavel.esir@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* [Tools] Avoid use of NumPy deprecated types
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Revert "[Tools] Avoid use of NumPy deprecated types"
This reverts commit 21ffc167d1.
* Move to 1.24 Numpy
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* [ONNX FE] Support value freezing without specifying type
Implement gete_element_type method for ONNX InputModel.
Implement tests with freezing integer input and float models
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update src/frontends/onnx/frontend/src/input_model.cpp
Co-authored-by: Tomasz Dołbniak <tomasz.dolbniak@intel.com>
* Update src/frontends/onnx/frontend/src/input_model.cpp
Co-authored-by: Tomasz Dołbniak <tomasz.dolbniak@intel.com>
* Update src/frontends/onnx/frontend/src/input_model.cpp
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
* Return only element type for model inputs and add ONNX FE tests
* Rename variable in the test
* Add syntax mark
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
Co-authored-by: Tomasz Dołbniak <tomasz.dolbniak@intel.com>
Co-authored-by: Katarzyna Mitrus <katarzyna.mitrus@intel.com>
* Added support for ONNX OpExtension with custom domain
* review remarks
* move domain ctor to onnx OpExtension
* code refactor + new test
* styles applied
* [Python API] Support extensions with custom domains
* try to fix windows build error
* removed unnecessary stores
* Use prebuilt cmake in install-dependencies steps
* Removed building of custom python to save Azure CI time
* Adjusted conditions in cmake
* Download VPU custom kernels compiler only for x86
* Removed -pyver argument
* Improvements
* Detect glibc version
* Usage of new glic variable
* Fixed typo
* Increased glibc version for MYRIAD case
* Made OpenVINO cmake Linux flavors agnostic
* Detect glibc version on RedHat
* Use clcompiler only since ubuntu 18.04
* Universal way to detect glibc version
* Revert some changes
* Apply suggestions from code review
fixes issue with GNA
* Apply suggestions from code review
fixed typo
* Use openvino pass graph_rewrite
* Use openvino pass pattern matcher
* Remove ngraph opsets
* Remove ngraph.hpp
* Remove ngraph includes
* Remove ngraph includes
* Use transformations API
* Remove ngraph includes
* Remove ngraph rt_info
* Remove unused ngraph includes
* Replace ngraph:: scope with ov:: here and there
* Remove serialize proxy header
* Remove proxy include
* Bring back a file for vpu-plugin
* Fix after upstream merge
* Remove nested namespace conflict
Co-authored-by: Andrei Kochin <andrei.kochin@intel.com>
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
Co-authored-by: Mateusz Tabaka <mateusz.tabaka@intel.com>
* [FE] Fix freezing placeholder via freeze_placeholder_with_value option
Currently, freezing placeholder via freeze_placeholder_with_value option does not work for any frontends. It happens due to absence of a node in _input_shapes dictionary.
* Add get_element_type method for InputModel
* Revert not needed changes
* Revert not needed changes
* Update freeze_placeholder_test
* Add tests for TF FE with freezing values of different types
* Fix Python API return value
* Correct returned type for get_numpy_ctype
* Apply code-review feedback
* Update src/frontends/tensorflow/src/input_model.hpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Apply code-review feedback: no tf legacy specific routine and parameter names
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* [Python API][Tools] Top up upper bound version for dependencies: NumPy, TensorFlow, NetworkX
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Remove upper-bound for TensorFlow and NumPy
* Revert "Remove upper-bound for TensorFlow and NumPy"
This reverts commit 662085df2e.
* Remove upper-bound for NumPy for default installation
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add attribute for last output element type
* Add convert precision transformation and tests
* Update Unique python API with new attribute
* Update Unique-10 op specification
* Update docstrings
* Update visitor tests
* Add type prop tests for the new attribute
* Check axis constant before shape, compare with partial shape
* convert() method added.
* Moved conversion to convert() method.
* Fixed commits.
* Output dir fix.
* Added objects support for extesions param.
* Added support for transformations_config extension objects.
* Input to str unit tests.
* Added tests, added comments.
* Updated BOM.
* Removed commented code.
* Fixed extension passing.
* Small corrections.
* Fixed for python 3.6.
* Small fix.
* Moved dir creating to ov.serialize(), removed mo.serialize(), small fixes.
* Small fix.
* Small correction.
* Removed coping of params, moved convert implemetation to separate module.
* Import fixes.
* Moved hiding of exceptions to main().
* Updated comment.
* Fixed unit tests.
* Comment changed.
* Fixed dir creating.
* Tests fixed.
* Small fixes.
* Test fix.
* Added meta data generation, removed printing of execution time for silent mode.
* Import fix.
* Conflict fix.
* Fixed error.
* Fix for custom config.
* Added version, data_type params to help.
* Added mo.convert() full-functional tests.
* Small corrections.
* Comment correction.
* Moved convert to openvino package, moved LayotMap and InputCutInfo to openvino.convert.
* Added help param.
* Wrong change removed.
* Small fix.
* Removed unnecessary comments.
* Removed .xml extension check from append_ir_info.
* Added missed file.
* Fixed error.
* Fix for bool value in InputCutInfo.
* Moved InputCutInfo, LayoutMap to openvino.tools.mo.
* Moved InputCutInfo, LayoutMap to openvino.tools.mo.
* Moved check and read_model to emit_ir.
* Small correction.
* Added comment.
* Added unit_tests with convert().
* Small corrections.
* Removed convert alias from openvino.
* Fixed conflicting unit tests.
* Removed unnecessary warnings.
* Params check fix.
* Small correction.
* Added paths checks.
* Added negative tests for to_str methods, fixed errors.
* Added tuples support in input parameter.
* Added direct support of BytesIO and TF1 graph def.
* Moved reminders to update OV and use API 2.0 to main().
* Fixed keras loading.
* Returned .mapping file generating.
* Added positional input_model param.
* Added test for unnamed input_model.
* Optimize imports.
* Added more informative error for brackets syntax in --input.
* Keras direct model support.
* Keras direct model support.
* Small fix.
* Conflict fix.
* Conflict fix.
* Added direct support of BytesIO and TF1 graph def.
* Fixed keras loading.
* Keras direct model support.
* Keras direct model support.
* Small fix.
* Tests for importing from memory.
* Support of other tf/pytorch formats.
* Updated mo_convert extensions tests to use ov models.
* Removed debug output.
* Implemented PyTorch converting logic.
* Small corrections.
* Small corrections.
* Added comments.
* Fixed for single input case.
* Added switching between save to file and BytesIO.
* Small fixes.
* Rename convert() to convert_model().
* Added env variable to disable converting to onnx.
* Tests refactoring.
* Add MO Python API tests to precommit.
* Add MO Python API tests to precommit.
* Added PyTorch to layer tests requirements.
* Added supported formats description.
* Fixed errors, added tests.
* Fixed bugs, added support of numpy and ov.Tensor sample_input.
* Added more torch.Size tests.
* Small correction.
* Renamed sample_input->example_inputs.
* Tests refactoring.
* Code style.
* Added support of dict in example_inputs.
* Small correction.
* Added removing of tmp onnx model in case of conversion error.
* Fix for lists of tensors in example_inputs.
* Support of dynamic axes for Keras layer, Keras module.
* Removed disabling of eager execution.
* Tests fixed.
* Added pytest requirement for layer tests.
* Added convert_model to openvino.runtime, fixed test runs.
* Small fix.
* Tests fix.
* Better help message.
* Error fixed.
* Renamed example_inputs->example_input.
* Small fix.
* Added support of list of layouts.
* Removed wrong change.
* Added tuple support for --layout.
* Removed convert_model from openvino.runtime.
* Use of default onnx opset version.
* Added support of dynamic input shapes without example_input.
* Made better error message.
* Removed stack trace from exceptions.
* Fixed tests.
* Small fix.
* Removed wrong change.
* Added import model from memory tests in unit tests.
* Replaced compare_functions() with MO IR reader compare.
* Removed test.
* Removed not needed change.
* Fixed conflicts.
* Remove test for unqiue op
Signed-off-by: andrei.kochin <andrei.kochin@intel.com>
* Remove test empty line
Signed-off-by: andrei.kochin <andrei.kochin@intel.com>
* Added PartialShape from str constructor, added to_string() method.
* Small corrections.
* Moved shape parsing to PartialShape and Dimension classes.
* Fixed errors.
* Added tests for shapes with comma separator.
* Fixed tests.
* Test fixed.
* Fixed test.
* Fixed tests.
* Small fix.
* Removed usage of depricated method.
* Fix in MO IR reader.
* Tests fixed.
* Fix in MO IR reader.
* Test fixed.
* Shape class alignment.
* Code fixes.
* Code fixes.
* Used unnamed namespace.
* Undo change of Shape attribute adapter.
* Undo change of Shape attribute adapter.
* Removed unnecessary includes.
* Removed unnecessary code.
* Test fixed.
* Fix in MO IR reader.
* Moved check_all_digits() to ov::util.
* Moved check_all_digits() to src/core/src/.
* Clang format.
* Apply suggestions from code review
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
* Removed dimension_util file.
* Removed wrong change.
* Removed extra spaces from string representation of Shape.
* Test fixed.
* Added support of comma separator for value. Updated help.
* Returned old format shape serializing.
Co-authored-by: Ilya Churaev <ilyachur@gmail.com>
DisableConvertConstantFoldingOnConstPath was renamed to MarkDequantizationSubgraph
and modified such that it also marks Subtract and Multiply from dequantization subgraph
with 'DequantizationNode' attribute.
Ticket: 65489
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
* Added doxygen comment for opset10
* Added get_available_opsets method to API
* Fixed build
* Fixed build and typo
* Use constant map
* Removed defines from global opset
* Added const to map
* [PYTHON] Pipeline transfer
* [PYTHON] Align python benchmark
* [PYTHON] Align last step
* [PYTHON] Fix innacuracies of the last step - median
* [PYTHON/CPP] Add Core::get_version method to python API, refactor Ben benchmark to print version with this func
* [PYTHON] Remove get_version_string from API
* [PYTHON/CPP] Align output for model input/output info
* [PYTHON/CPP] Step 4,6 alignment of outputs, step 8 dumps all info stored in config parameters
* [CPP] Fix a bug causing nstreams parameter to never be set to AUTO in CPP benchmark_app
* [CPP] Fix clang format errors
* [CPP] Modify print order and data output for 8th step
* [PYTHON] Add verification checks from C++, modify set_thoughtput_streams to match documentation
* [CPP] Revert changes to C++ benchmark_app
* [CPP] Remove additional spacebar
* Update submodules versions on remote
* Update module from master branch
* Redownload submodules from master and override changes from commit
* [PYTHON] Remove unneccesary parse_status from validation function
* [PYTHON] Check for HINT in map, fix circular import
* [PYTHON] Remove artifacts from commit, fix args.perf_hint set to '' instead to 'none'
* [PYTHON] Reverse changes to perf hint, add key in map check, fix validation function throwing error on set hint
* [PYTHON] Fix linter
* [PYTHON] Remove linter spacebar
* [CPP] Fix wait_all exception throw
* [CPP/PYTHON] Clean artifacts and unwanted changes from work process
* [PYTHON] Fix artifacts from merge, clean submodule update
* [C++ CPU] Fix device name string by removing padding NULL characters from the back
* [CPP] Fix ba infer_request_wrap in other throw-catch clauses
* [PYTHON/CPP] Fix missing latencies in final step for shape group, fix minor misaligned messages, add missing report parameter create infer requests time
* [CPP] Clang fix formatting
* [CPP] Reverse clang fix format on plugin.cpp
* [PYTHON/CPP] Fix C++ progressbar printing endl when disabled, fix rounding in python creating infer request message
* [CPP] Fix foramtiing error
* [PYTHON/C++] Refactor network to model based on naming conventions, provide fresh README output example
* [PYTHON/C++] Add example output to C++ README, remove unnecessary device loop
* [BENCHMARK_APP/C++] Fix artifact from refactoring, remove try-catch clause
* Update samples/cpp/benchmark_app/benchmark_app.hpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update samples/cpp/benchmark_app/main.cpp
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* [CPP] Fix clang errors
* [CPP/PLUGIN Reverse modification to extract to separate task
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/parameters.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/utils/utils.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Update tools/benchmark_tool/openvino/tools/benchmark/main.py
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* [PYTHON/C++/BENCHMARK_APP] Fix language inconsistencies, remove unnecessary checks
* Update pyopenvino.cpp
* [CPP/BENCHMARK_APP] Remove unnecessary try-catch, fix linter errors
* [PYTHON/CPP/BENCHMARK_APP] Revert changes to Core, align version prints usin only provided methods
* [DOCS/BENCHMARK_APP] Update README with proper model examples
* Update README.md
Co-authored-by: Nadezhda Ageeva <nkogteva@gmail.com>
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Co-authored-by: Zlobin Vladimir <vladimir.zlobin@intel.com>
* Add reference implementation for Is ops
* FIx test
* Fix typo
* Remove deprecated
* Fix issues with API switch
* Force cast to float for float16/bfloat16 in ref
* Fix style
* Remove BWDCMP_RTTI
* Remove TensorVector helper check
* Remove evaluate functions
* Disable faling tests due to missing eval
* Fix gather type_prop test build issue on windows
* Add pytest-forked to test requirements
* Update src/bindings/python/requirements_test.txt
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* Remove warning suppression for core tests
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* Update to the latest cmake for Windows
* Skip new warnings
* Added compiler flags for old cmake
* Disabled some warnings
* Suppress new warnings
* Fixed some errors
* Disable some warning for lpt
* Fix some warnings
* Disable new warnings
* Fix some warnings
* Disabled Was error for arm
* Fixed some errors
* Fixed some new warnings
* Fixed auto plugin
* Fixed Windows warning
* Fixed Windows
* Disable some warnings
* Some changes
* Small test fixes
* Fixed python build
* Added skip warnings for legacy python API
* Added reading of meta information from IR
* Fixed code style
* Added tests to cover multi-threading and removed file
* Fixed asserts
* Changed parsing of meta information
* Added meta information serialization
* Fixed unit tests
* Support unset_cli_parameters
* Changed get meta API
* Fixed threading tests
* Fixed mutex
* Removed serialization
* Fixed tests
* Fixed build
* Add quantization_parameters
* Use rt_info instead of meta section
* Disable old rt_info serialization
* Try to fix MO Reader for new rt info
* Fixed property name
* Added test to new meta format
* Added tests for new PoT config
* Added tests for new rt_info attributes
* Remove redundant code
* Revert old rt_info style for nodes
* Add get API for python
* Added python tests
* Fixed python code style
* Fixed tests code style
* Fix flake8
* Fixed python tests
* Add has_rt_info to test
* Added more comments
* Extended tests and API
* Changed error message
* Use new API to get model version
* Fixed comments on python API
* Fixed comments
* Fixed comments
* Update src/bindings/python/src/pyopenvino/graph/model.cpp
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* Update src/bindings/python/src/pyopenvino/graph/model.cpp
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* Fixed comments
* Fixed python check
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* Fixes for brew support on OSX
* Added new policy
* added quotes
* Used OpenVINODeveloperPackage
* Extra fixes
* Use standard verbose variable
* Fixed pkg-config generation
* parent 6e7016ccda
author Ilya Churaev <ilya.churaev@intel.com> 1664281499 +0400
committer Ilya Churaev <ilya.churaev@intel.com> 1664510018 +0400
Fixed warnings on local machine
* Added CMAKE_COMPILE_WARNING_AS_ERROR usage
* Fixed style
* Fixed merge conflicts
* Fixed typo
* Fixed myriad build for macOS
* Fixed warning
* Fixed tests
* Disabled incorrect test
* Try to fix linux tests
* Revert "Try to fix linux tests"
This reverts commit 29224c93ff.
* Fixed tests
* Revert logic with incorrect cast
* Fixed log softmax
* Disable warning as error for cuda
* Try to fix inference_engine_s
* Fixed cmake
* Revert "Fixed cmake"
This reverts commit 87e9e4e674.
* Revert "Try to fix inference_engine_s"
This reverts commit a1adca8b05.
* WA for static symbols in inference_engine_s test library
* Fixed code style
* Fixed static definition for master
* Revert "Fixed static definition for master"
This reverts commit 20d00d215a.
* Revert "Fixed code style"
This reverts commit 0eb2362543.
* Revert "WA for static symbols in inference_engine_s test library"
This reverts commit 75ef86a79d.
* Fixed linker issue for Windows
* Disable WaE by default
* Disable warning as error in the developer package
* Try to fix dev package
* Try to fix Windows Jenkins
* Revert old behavior for tread_warn_as_err variable
Add test
Update src/common/transformations/include/transformations/common_optimizations/fused_names_cleanup.hpp
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
Review comments
Cleanup test includes
* Update LD_LIBRARY_PATH for python API tests
* Update LD_LIBRARY_PATH for python API tests
* Remove PYTHONPATH, OV_FRONTEND_PATH
echo PYTHONPATH and LD_LIBRARY_PATH
* Update get environ variables when are not set
* Set OV_FRONTEND_PATH variable
* Add openvino installation path to OV_FRONTEND_PATH
* Add PYTHONPATH to point install tests dir
* Add debug message for PYTHONPATH
* Update LD_LIBRARY_PATH to point openvino wheel
install directory
* Add comments for environ vars for python API tests
* Remove not required paths from linux CI
* Minor comments update
* Allow to compile wheel package based on OpenVINO developer package
* Added wheel specific runtime dir to avoid issues with generator expressions
* Added backward compatibility
* Trying to fix RHEL, U20
* Fixed cmake options in setup.py
* Added auto-detect for SHUTDOWN_PROTOBUF option
* Hide some helper variables as internal ones
* Update frontends cmake files not to include tests folders
* Added an ability to test private API for TF FE
* Added an ability to test private API for TF FE
* Improved mock frontends in python tests
* Fixed compilation error
* Fixed link on WIndows
When runtime exception was thrown during infer call, the infer
request handle was never relinquished nor condition variable notified.
That caused the get_idle_request_id function wait forever.
* When set batch_size, disable auto batching
* auto-batch only supprt auto plugin
* Set property allow_auto_batching for devices
* cancel static
* Clean Code
* Add test case for testing allow_auto_batching
* Fix the issue after merging latest master branch code
* Add allow_auto_batching in python benchmark_app
* Fix the quotes issue
* When load_network is set to allow-auto-batching, there is no need to read the value of global
* Fix the clang-format
* Change the location
Co-authored-by: River Li <river.li@intel.com>
Co-authored-by: Chen Peter <peter.chen@intel.com>
* Building python frontend tests
* Enable mock tests in new python API:
- Fix mock_py frontend library name
- Set same destination for mock_py frontend as others frontends
- Fix importing mock_py frontend
- Minor changes in mock_py tests
* Fix flake8 issue
* Fix linking issue on windows
* Remove DISABLE_PYBIND11 option
* Build mock_py always as shared library
- put mock_py into ov::frontend namespace
- minor re-factor of mock_py
* Add mock c API fix warning on windows
* Fix installation of mock_py frontend
* Install mock_py frontend library in tests
* More detailed error message in python test
when cannot import frontend
* Restore IMPLEMENT_OPENVINO_API for windows build
of pybind_mock_frontend
* Set env paths for python API test on Azure CI
- skip tensorflow conversion ext test when not installed
* Correct skip tensorflow test decorator
* Add C API macro for mock1 frontend
* Ignore E999 error reported by flake8
* Fix conversion extension name for tf imports
* Fix flake8 issues
* Remove python3.8 path from LD_LIBRARY_PATH
on debian CI
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* Fixed dependencies in case of debian package building
* Removed duplication of cython-based libraries in wheel
* Fixed that TBB is not part of the wheel
* Fixes for yocto
* Add NVIDIA device name along to CUDA device name (temporary solution)
* Disable nvidia_plugin along to cuda_plugin in .ci/azure/ (temporary solution)
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
* Add eye decomposition transformation
* Fix EyeLike generation when diagonal shift
outside dimensions
* Add batch shape to eye decomposition
* Eye decomposition clean-up
* Remove reference part if no eye decompose in
decomposition tests
* Eye-Like use eye operator
* Disable eye decomposition for CPU plugin
* Use opset9 instead of ops in eye decomposition
* Apply transformations header style
to eye_decomposition.hpp
* Add model reference in eye decomposition tests
- use opset9 instead of ov::op:vX namespace
* Refactor eye decomposition:
- match style of other transformations
- add NodeRegister class to make and collect created nodes
- use `NodeRegister` in transformation for copy runtime info
- use `NodeRegister` in `MatcherPass` to replace new `register_new_node`
* Fix CI LTO optimization issue for Ubuntu 20
* Move NodeRegister to dev API
To fix LTO issue for eye decomposition
* Change NodeRegister to NodeRegistry
* Add eye decomposition transformation
* Fix EyeLike generation when diagonal shift
outside dimensions
* Add batch shape to eye decomposition
* Eye decomposition clean-up
* Remove reference part if no eye decompose in
decomposition tests
* Eye-Like use eye operator
* Disable eye decomposition for CPU plugin
* Use opset9 instead of ops in eye decomposition
* Apply transformations header style
to eye_decomposition.hpp
* Add model reference in eye decomposition tests
- use opset9 instead of ov::op:vX namespace
* Refactor eye decomposition:
- match style of other transformations
- add NodeRegister class to make and collect created nodes
- use `NodeRegister` in transformation for copy runtime info
- use `NodeRegister` in `MatcherPass` to replace new `register_new_node`
* Fix CI LTO optimization issue for Ubuntu 20
* Disable python for configuration with libraries suffix
* Fixed python detection on arm
* More fixes
* Used find host package
* Don't use PYTHON_VERSION which is used by pybind
* Add eye decomposition transformation
* Fix EyeLike generation when diagonal shift
outside dimensions
* Add batch shape to eye decomposition
* Eye decomposition clean-up
* Remove reference part if no eye decompose in
decomposition tests
* Eye-Like use eye operator
* Disable eye decomposition for CPU plugin
* Use opset9 instead of ops in eye decomposition
* Apply transformations header style
to eye_decomposition.hpp
* Add model reference in eye decomposition tests
- use opset9 instead of ov::op:vX namespace
* Refactor eye decomposition:
- match style of other transformations
- add NodeRegister class to make and collect created nodes
- use `NodeRegister` in transformation for copy runtime info
- use `NodeRegister` in `MatcherPass` to replace new `register_new_node`
* Created dedicated debian packages for frontends
* Fixed Azure CI
* Install TF FE with both names
* Disabled 2 QN tests
* Install python samples differently
* Update linux and mac part of BUILDING.md
* Fix variable names and minor other fixes
* Remove unused macos deps
* Follow up on comments including cmake instructions
* Update wheel instructions
* OpenCV build switched off by default
* Removal of OCV copy from the "install tests" stage
* Switch off OCV dependent tests
* cmake code repositioning
* More OCV-dependent tests disabled
* OCV removed entirely from the C-API tests
* Final cleanup
* Fixes for cases when TBB_DIR env var is set
* Don't use make in build_samples.sh script
* First version of Windows installer
* WIndows NSIS installer
* Improved version of debian packages
* Improvements
* Improvements
* Debian packages now look good
* Library versioning
* Fixed tests to run against debian packages
* Fixed frontend tests
* Fixed code style
* FIxed Windows
* Fixed python tests
* Fixed paths in tests
* fdvfdv
* Fixes
* USe versioning only for debian packages
* Relocatable tests
* Fixed
* Fixed all tests
* Fixed clang-format
* Fixed more tests
* Fixed some tests
* Absolute paths in .ci
* Fixes
* Added support of OpenCV 3.4
* Trying to fix gnaUnitTests
* [MO] Relax MO upper-bound requirements for TensorFlow and NumPy
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Just debug numpy version
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Pin upper-bounds for NumPy and TensorFlow modules in all reqs files
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update submodule dependency for open_model_zoo
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Install numpy module first
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update NumPy version in POT setup.py
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Extend telemetry tests with a set of possible solutions for events
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Fix build issue
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Update NumPy module version for layer tests
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
* Add static shared_objects map in FEM
- add unit tests for frontend lib close
- not use static FEM in ie network reader
- add main for gtest which can use manifest file to filter tests
* Move library pointers map to manger impl
- add to manger impl method to make frontend from loaded plugin
* Add shutdown function to ov namespace
it cleans the static resources
* Revert changes related to linking mian for tests
* Add python binding to ov::openvino_shutdown
* Renamed shutdown method and added to legacy C++ API
(cherry picked from commit a8395bd207)
* Added C bindings
(cherry picked from commit d2c9ddc263)
* Move frontend lib close test to ieFunctTest
- moved to not introduced new test binary and modification on CI
the frontend tests use dynamic linked frontend lib which is load
on test application start and mask lib close tests
- remove gtest_main_manifest as not required now
- add ov::shutdown test to expect application crash
* Fix lib_close test
- remove not get_disabled_tests from utils
- revert CMake file formating
* Fix get model path in lib close tests
* Skip frontend lib close tests if static lib build
Co-authored-by: Ilya Churaev <ilya.churaev@intel.com>
* add type caster for ov::Layout, enable load method to take pathlibs.Path as arugment
* fix typo
* fix style
* add missing blank line
* add common function to check if py::object is either Path or string
* fix style
* Update src/bindings/python/src/pyopenvino/graph/preprocess/pre_post_process.hpp
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* add tests, fix style, remove pointer argument overload
* fix style
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* Fixes for cases when TBB_DIR env var is set
* Don't use make in build_samples.sh script
* First version of Windows installer
* WIndows NSIS installer
* FTZ_and_DAZ_set_for_cpu
* remove DAZ
* fix
* extract to utils
* ie core part changes to add do as property and benchmark_app enable do
* enable brgcov from Luocheng patch
* add debug info
* enable_brgemm_on_avx512
* add python binding
* dlb test
* FTZ_and_DAZ_set_for_cpu
* remove DAZ
* fix
* extract to utils
* ie core part changes to add do as property and benchmark_app enable do
* enable brgcov from Luocheng patch
* add debug info
* enable_brgemm_on_avx512
* add python binding
* dlb test
* revert test code
* revert test code
* enable brgconv f32
* use config to enable brgconv f32
* when brg disabled not init bin-postops
* change prop name for extensive
* use more general field
* fix review comments.
* Property to force terminate tbb threads
During inference done, tbb threads cannot be closed by itself, which cause memory leak and unload/lingering threads.
Sometimes the tbb threads need to be terminate for resource(memory, thread) consumption
This PR contains:
1. Add a new property to control whether force to terminate tbb threads.
2. Property key is "FORCE_TBB_TERMINATE", default value is false.
3. Explicitly to terminate tbb task scheduler during unload openvino dll if this property is set true.
e.g: core.set_property(device, ov::force_tbb_terminate(true));
4. If not set FORCE_TBB_TERMINATE, there will be no any additional tbb operations.
Change-Id: I32dc0ba122bb19a9dbf3ba12fdd596aad9ac54b4
* Fix executorManager test case
Change executorManager from static to be dynamic, the test case should fit this change.
* Change frontendManger to be non-static instance
Make frontendManger to be non-static instance.
We should guard it is not released before Model, due to Model will use the mem allocated by frontendManger.
So put frontendManager reference in ov::Model to make it work.
* Fix race condition between executor and executorManger
* Add test case for tbb property
1. Add basic test case for ov::force_tbb_terminate property
2. set ov::force_tbb_terminate to be false
* Avoid terminate tbb in case of no tbb thread created
* Fix Constant ops segmentfault issue
There is segmentfault issue during Constant destruction, which is caused by some shared memory is double free
Test case is:
ie = IECore()
net = ie.read_network(model=test_net_xml, weights=test_net_bin)
query_res = ie.query_network(net, device)
func_net = ng.function_from_cnn(net)
ops_net = func_net.get_ordered_ops()
ie and net will be released before ops_net destruction, so Constant will free the shared memory that has been freed
* Make constant::m_data is released before frontendmanager
* tiny format change
* change tbb blocking_terminate to terminate
Tbb blocking_terminate calling will cause some segmentfault during run some special models,
the reason may comes from block_terminate cause current thread block here to wait for tbb exit,
but cannot handle some resource dependencies.
After adopt terminate(), the dependencies can be resolved and no segmentfault any more.
Change-Id: I0b920630a25cd3fd2747c57ec71ca749ba35573b
* Remove unnecessary dependencies
* Disable dynamic lib test case in static library compilation version
As CVS-68982 description, we should disable the test case which will load
dynamic library in openvino static library compilation.
* Fix nested-namespace-definition issue
* Address reviewer's comments
* Change read_image() into generate_image()
* Move test utils from testdata repo to local files
* Minor changes
* Remove unnecessary code
* Minor changes
* Fix compatibility tests
* Fix imports for Azure pipeline
* Move model generation into test_utils
* Minor changes
* Minor changes
* Update linux.yml CI
* Remove testdata repo from .ci/linux.yml
* Remove testdata repo from pipelines
* Fix Azure compatibility tests
* Reset linux.yml
* Remove testdata repo from linux CI
* Try eliminating one of configs
* Attempt at fixing Azure tests
* Add separate utils for compatibility
* xfail comp if op tests
* Minor changes
* Revert changes to .ci files
* minor changes
* Remove xfails
* Remove unecessary import
* Skip if op tests
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
* multiclass_nms opset9 spec, api, reference, paddle fe mapper, paddle fe unittest.
* multiclass_nms opset9 cpu node impl.
* multiclass_nms opset9 shape infer fix.
* multiclass_nms opset9: add transform ConvertMulticlassNms8ToMulticlassNms9.
* ConvertMulticlassNmsToMulticlassNmsIE: to MulticlassNmsIEInternal
* add test dependency package paddledet==2.1.0
* 1. fix for roisnum overflow. 2. common shape_infer private function.
Signed-off-by: jialipen <cecilia.peng@intel.com>
* 1. use common infer_shape helper. 2. fix roisnum overflow issue. 3. fix for nmsWithEta.
* test suite for opset9 multiclass_nms smoke tests pass, with both static and dynamic shapes.
code clean for unit test.
* decouple specification from this PR.
* op fuzzy: dynamic input/output
* reference impl refactor
* multiclass_nms_base no need clone_inputs.
* code clean
* restrict ppdet import
* fix clang format error
* change ppdet import to resolve CI fail issue related to its dependency.
* fix CI
* refactor: multiclass_nms_shape_inference for opset9 and reference impl.
TODO: could be applied to opset8 and even matrix_nms.
* fix CI build failure.
* CI fix for ambiguous namespace reference issue when
building static libs.
* update nms save_model python scripts.
* dynamic inputs for NMS with CPU plugin.
* copyright header for test scripts.
* op comformance test for multiclass_nms_9.
* minor update: is_type
* python opset9 and multiclass_nms
* flake8 CI fix
flake8 CI fix
flake8 CI fix
* remove NmsBase. stage1.
flake8 CI fix
remove NmsBase. stage 1 fix.
* rm NmsBase. stage2.
* more multiclass_nms prop tests and fix.
* remove unchanged ops from binding opset9.
* dependcy of paddle_tests.
* fix: add MulticlassNms to op mapper.
* clang format fix
* fix merge error.
* Try to improve gflags
* Try to improve gflags: part 2
* Tried to use dependencies on system
* Use nlohmann_jsonConfig from system
* Enabled nlohmann_json from system
* Improvements
* handle system gflags in developer package
* Simplifications
* Simplify dependency management
* Corrected package names
* Fixed subgraphsDumper configure stage
* Try to fix rhel8
* Try to fix macosx
* Fixed VPUX build
* Fixed aliasing issues
* Suppress some wanrings
* export gflags when build it
* Fixed some LTO
* Try to fix Mac
* revert
* use gflags as private dependency
* Aligned targets in developer package
* Fixed frontends tests build on U20 with LTO
* PAssed
* Don't use pkg_search_module(zlib ..) during cross-compilation
* Removed unused variables
* Fixed finding of zlib during cross-compilation
* CVS-83529
* Use nothreads_static
* Fixed python
* Try to improve gflags
* Try to improve gflags: part 2
* Tried to use dependencies on system
* Use nlohmann_jsonConfig from system
* Enabled nlohmann_json from system
* Improvements
* handle system gflags in developer package
* Simplifications
* Simplify dependency management
* Corrected package names
* Fixed subgraphsDumper configure stage
* Try to fix rhel8
* Try to fix macosx
* Fixed VPUX build
* Fixed aliasing issues
* Suppress some wanrings
* export gflags when build it
* Fixed some LTO
* Try to fix Mac
* revert
* use gflags as private dependency
* Aligned targets in developer package
* Fixed frontends tests build on U20 with LTO
* PAssed
* Don't use pkg_search_module(zlib ..) during cross-compilation
* Removed unused variables
* Fixed finding of zlib during cross-compilation
* [Python API] Remove old api class from the new api
* start working on refactoring of OVAny
* fix tests
* fix code-style
* remove tuple test
* fix test
* fix omz hash
* one more overload
* fix pyfloat
* move from_ov_any to utils
* code-style
* move function from common to utils
* Improve performance for 'ov::Model::add_output'
On first call of `add_output(tensor_name)` all available tensor names are cached.
Next calls take nodes from cache which significantly reduces complexity.
Cache is invalidated if topological cache is not valid or cache points to incorrect output (no tensor name of this node anymore)
The same caching is done for 'add_output(op_name, output_index)'
Tests:
- Verifies that adding outputs to all nodes has linear complexity O(N), not O(N^2)
- Verifies cache invalidation scenarios
* Fix python tests
* Update topological cache after add_output(Output<Node>) by adding result to the end of cached ops
* Add 'm_shared_rt_info' to 'result node just for consistency (there is actually no scenario which may fail due to absence of this info for Result
* Added test cases to verify that names cache should be cleared on refresh of 'get_ordered_ops'
Anastasia Kuporosova