With this change, users don't have to add "import openvino.torch" in
their applications. Providing torch.compile(model, backend="openvino")
automatically imports the necessary modules. This simplifies the user
experience and enables PT2 based benchmarking OOB without any changes. .
More information can be found here:
https://github.com/pytorch/pytorch/pull/124536
JIRA: CVS-139370
---------
Co-authored-by: Surya Siddharth Pemmaraju <surya.siddharth.pemmaraju@intel.com>
### Details:
- *The PR adds RISCV64 arch for python wheel setup to fix the following
error during build on the target machine:*
```
[100%] Building Python wheel
openvino-2024.2.0-14978-cp310-cp310-manylinux_2_36_riscv64.whl
Processing /home/sipeed/openvino/openvino/src/bindings/python/wheel
Preparing metadata (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py egg_info did not run successfully.
│ exit code: 1
╰─> [6 lines of output]
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File
"/home/sipeed/openvino/openvino/src/bindings/python/wheel/setup.py",
line 50, in <module>
OV_RUNTIME_LIBS_DIR = os.getenv("OV_RUNTIME_LIBS_DIR",
f"runtime/{LIBS_DIR}/{ARCH}/{CONFIG}")
NameError: name 'ARCH' is not defined
[end of output]
note: This error originates from a subprocess, and is likely not a
problem with pip.
error: metadata-generation-failed
× Encountered error while generating package metadata.
╰─> See above for output.
note: This is an issue with the package mentioned above, not pip.
hint: See above for details.
make[2]: ***
[src/bindings/python/wheel/CMakeFiles/ie_wheel.dir/build.make:177:
wheels/openvino-2024.2.0-14978-cp310-cp310-manylinux_2_36_riscv64.whl]
Error 1
make[1]: *** [CMakeFiles/Makefile2:2841:
src/bindings/python/wheel/CMakeFiles/ie_wheel.dir/all] Error 2
make: *** [Makefile:156: all] Error 2
```
### Tickets:
- *N/A*
* Get rid of distutils
* get rid of LooseVersion
* try to get rid of clean and copy_file
* fix mo tests
* fix warning in mo
* Update src/bindings/python/wheel/setup.py
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* add packaging to requirements
---------
Co-authored-by: Jan Iwaszkiewicz <jan.iwaszkiewicz@intel.com>
* Use FindPython3.cmake
* Fixed compilation on macOS 14 with new core development tools
* Try to use Python3_SOABI instead of PYTHON_MODULE_EXTENSION
* Use Development.Module
* Keep specifying only Python3_EXECUTABLE
* Print PYTHON_MODULE_EXTENSION
* Added check for minimal cmake version for python API
* Returned Python3_INCLUDE_DIR for cross-compilation case
* Try to allow cmake older than 3.18
* Use build python interpreter to check cython dependency
* revert changes in .ci/openvino-onnx/Dockerfile
* removed unused code
* Fixed issue with variables scope
* Experiment: remove include dirs
* Corrected docs
* Use pybind11 function to set extension
* Revert "Experiment: remove include dirs"
This reverts commit 6f7f90211c.
* Refactor ConvolutionBackpropDataLayerTest, ConvolutionLayerTest, DeformableConvolutionLayerTest (#19810)
* Refactor ConvolutionBackpropDataLayerTest
* Refactor ConvolutionLayerTest
* Refactor DeformableConvolutionLayerTest
* Apply comments
* Apply comments
* Fix
* Updated minimum cmake version for Windows
* Simplified check
* Removed useless message status
* Use puiblic option
---------
Co-authored-by: Oleg Pipikin <oleg.pipikin@intel.com>
* Used pip wheel to build OpenVINO wheel
* Added convert_model() to openvino.runtime.
* Removed duplication of InputCutInfo, LayoutMap
* Switched Model Conversion API tests to convert_model from openvino.runtime.
* Small correction.
* Format correction.
* Small correction.
* Removed duplication of moc frontend files.
* Small correction.
* Removed duplication of cli_parser, offline_transformations.
* Code corrections.
* Removed code duplications.
* Removed code duplications.
* Updated codeowners.
* Switched layer tests to convert_model().
* Improvements
* Small correction.
* Caffe parser path fix.
* Added python api properly into deb / rpm packages
* Moved implementation to ovc tool.
* Moved implementation to ovc tool.
* Small correction.
* Use cmake -E variant from cmake 3.13
* Namespace fixes.
* Minor fixes.
* Pylint fixes.
* Fixed BOM file.
* Small corrections.
* Minor corrections.
* Minor fix.
* Error fixes.
* Added telemetry requirement.
* Improvements to fix CI
* Some refactoring
* Don't use developer package for scripts projects
* Added exception in case when MO is not imported.
* Removed exception from init.
* Removed changes from cmake.
* Added unit ovc tests, fixed minor errors.
* Added ovc unit tests to azure.
* Corrected imports.
* Fixed path to tests.
* Added missed files.
* Corrected github labels.
* Removed benchmark app from dev package.
* Small fix.
* Small corrections.
* Comment fixed.
* Removed changes from setup.py
* Removed not needed change.
* Removed duplicating unit tests.
* Removed wrong change.
* Removed not needed change.
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Added ovc tool test, corrected imports.
* Added legacy TF config test.
* Removed not needed files.
---------
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Used pip wheel to build OpenVINO wheel
* Improvements
* Added python api properly into deb / rpm packages
* Use cmake -E variant from cmake 3.13
* Improvements to fix CI
* Some refactoring
* Don't use developer package for scripts projects
* Final fixes
* Small fixes for openvino::pugixml creation for Dev packages
* Flexiable components installation
* Fixed compilation for x86
* Added extra checks for ENABLE_NCC_STYLE
* Fixed typo in RPM
* use oneTBB for arm64
* force THREADING=TBB
* test: remove TBB_DIR for linux arm64
* update linux and mac arm64 packages
* update SHA256
* add comment
* disable add_rpath for tbb libraries on mac arm64
---------
Co-authored-by: Chen Peter <peter.chen@intel.com>
* Added -Wall for Clang and GCC
* Fixes
* Don't use /J
* Fixed warnings
* Fixed warnings
* More fixes
* Fixed for MSVC
* Fixed more warnings on Windows
* Suppressed some warnings in template plugin
* Update src/tests/functional/plugin/shared/include/behavior/plugin/caching_tests.hpp
* Added suppression for PT FE
* Suppressed warnings in TF FE
* Suppressed warnings on Core unit tests
* Suppress warnings in python
* Suppressed Windows warning for 3rd party modules
* Suppresed one more warning
* Infrastructure for tflite
* Removed submodule flatbuffers
* Added flatbuffers submodule. Fixed version to v22.12.06 aka acf39ff
* Move headers back
* Flatbuffers integration
* Small fixes
* Started parsing the Model
* flatbuffer changes
* decoder_flatbuffer changes
* Lite Input Model -- not needed as of now but looks cool
* Rolled back inherritance from ov::frontend::tensorflow::InputModel
* Results are not treated as outputs, but its ok
* Fix missplaced input vs output
* Refactor
* Load model op-by-op. Frontend API finalized
* Debugging still, there are prints here and there. Decoder is not sane
* Convolution with all attributes is translated and quantization is applied for inputs and constatants. TODO: quantize intermediate tensors, separate decoder specific logic?
* Float ssd and posenet models are showing good accuracy
* Need to refactor but work flawlessly
* Telemetry and lightweight model cutting
* Code style and test changes. Extensions supported
* Quantization and style
* Style refinements
* Move onednn back
* New portion of operations enabled
* TFLite FE doesn't inherrit TF FE
* Moved files to another directory
* Rename header op_table.hpp to common_op_table.hpp for all files in src/frontends/tensorflow_common/src/op/
* Removed visability macroses
* CMake changes
* Unit-test execution in .ci
* Update labeler.yml
* Codeowners
* Style check and fix
* Static Build arrangement
* Addressing the comments
* install common headers to previous place
* New approach with public decoder and graph_iterator
* New approach with public decoder and graph_iterator
* Move GraphIterator back
* Comments addressed
* Comments adressed
* Preliminary TF FE README.md changes
* Added target_compile_definitions OPENVINO_STATIC_LIBRARY for static build
* Fixed conflicts and added TF to common places
* Frontends use only openvino::core::dev API
* Merged common tensorflow changes and made code build and work on selective number of models
* Style
* Rollback unnecessary changes from Tensorflow FE
* Rollback unnecessary changes from Tensorflow Common
* Minor refactor
* cmake minor refactoring
* Mixed commit
* Style and merge fix
* Low hanging fruit operations
* Fix windows build
* Refactor quantization parameters representation
* license compliance. approved by OS PDT
* copyrights in generic file
* dependabot
* labeler
* Unit Test to be triggered in CI
* cmake variables naming. corrected copyright years in copyrights/generic file
* library renamed in .ci/ calls
* Copyright year update
* Set openvino-tf-frontend-maintainers as owner of /src/frontends/tensorflow_lite/
* Fixed flatc corss-compilation
* Cleaned flatbuffers header usage
* Nitpicks solved
* Update cmake/templates/OpenVINOConfig.cmake.in
* Compile with flatbuffers headers
* Fixed "which is prefixed in the source directory"
* Fixed typo in flatbuffers cmake
* Removed flatbuffers submodule
* Added fork submodule
* Fixed static build
* Fixed cross-compilatio
* Fixed -Wshadow warning
* Fixed warning on Windows
* Use only headers from flatbuffers library
* Added LTO and fixed compilation errors on Windows
* Fixed warnings in tensorflow_common
* Move ctors implementation to cpp file
* Added information about new frontends to common FEm part
* Temporaryily disable warnings
* Fixed code style using clang-format
* Fixed Windows
* reverted changes in onnx
* Revert changes in onnx_common
* Removed pragma once frm cpp
Co-authored-by: missjane <estepyreva@gmail.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
* WIP
* update input validation
* upsample_nearest2d and upsample_bilinear2d support
* support leaky_relu add test for inplace relu
* update tests, add handler for ListConstruct
* Do not create extra outputs in main body
* add positive case with non-default value
* update testing
* update test, handle non constant size and scale
* remove ie_device
* add aten::group_norm support
* refactoring
* Enable aten::reshape_as operator and add layer test
* more tests
* Fix typo in test
* Resolve conflicts
* fix code style
* expand init version
* expand_as and tests
* add transposed convolutions support
* add tests
* initial support pad
* add circular
* update for differenced in rang
* cleanup
* refactor
* more tests
* apply review comments
* Add split+listunpack transformation
* Add split+getitem transformation
* Add test cases
* fix typo
* Minor fixes
* Apply suggestions from code review
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Apply suggestions from code review
* Small fix
* Support converting models without freezing
* support BoolTensor and masked_fill
* add support aten::rsqrt and test for sqrt
* add cumsum and type_as
* support clamp
* support more matrix operations
* add tests
* Add aten::adaptive_avg_pool3d and layer test
* Change to rank
* fix code style in utils.hpp
* Update src/frontends/pytorch/src/op_table.cpp
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
* fix code style
* add tests
* add xfail
* remove unnecessary broadcast
* Changes required by style formater
* aten::_convolution_mode
* Changes requested by a reviewer
* remove code duplication
* add aten::unbind transformation
* full, zeros and ones
* Support getattr list and unrolling nested ifs
* Remove line change
* Enable back freezing in layer tests
* Add aten::norm operator and layer test
* Small fix in layer test
* add aten::roll
* add empty line
* Typo fix
* fix style
* fix style v2
* add pytorch frontend to wheel
* Support all types of numeric norms
* add check for dynamic shapes
* remove random change
* merge statements
* add min and max ops support
* aten::max and aten::min
* move axes range creation to utils
* add transformation for tuple results, update tests
* fix copyright
* aten::var
* add test and translation for numel
* ignore aten::clone
* Add layer test for aten::add operator
* Fix typo
* Remove redundant import
* Add parameter name in forward method
* fix code style
* apply review comments
* Add size+slice+listunpack transform
* Add append listunpack transformation
* Register transformation
* aten::where
* update realization
* Fix issue with getitem
* Fix getitem
* Add layer test for aten::view operator
* Add tests for listunpack
* add test for aten::div
* fix style
* update aten::adaptive_max_pool2d
* fix style
* add aten::floor_divide
* aten::addmm support alpha and beta with different dtype
* nonzero
* Change test name
* update test cases to include other dtypes
* aten::arange
* prim::max transformation for ListConstruct
* rename op
* generalize conv2d implementation for conv1d and conv3d
* aten::unsqueeze_ and tests for aten::unsqueeze (#70)
* add aten::le, aten::ge and tests for other tensor comparision ops (#74)
* add support trigonometry ops (#73)
* support aten::upsample_bicubic2d, aten::ceil, aten::floor (#72)
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* extend and add tests for avg_pool and max_pool
* extend tests and constant filling ops
* fix as_tensor and full ops
* aten::repeat
* fix code style
* aten::im2col (#61)
* aten::im2col
* remove debug prints, add number of elements check
* fix failed tests
* move helper function
* use split
* Update src/frontends/pytorch/src/op/im2col.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* fix code style
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* Update src/frontends/pytorch/src/utils.cpp
Co-authored-by: Maxim Vafin <maxim.vafin@intel.com>
* fix code style
* revert removeinf floordiv, add floor_divide file
* Fix merge issue
* reduce code duplication
* refactor
* Add len operator with layer test
* update clamp to support mixed precision and add support torch.long for constants
* aten::selu
* add trunc mode to div
* add else statement
* Add test case to layer test
* Fix submodules (#88)
* update test file
* fix namings
* execute in fp64 and convert back to initial precision
* Revert set_output_size to master. Small fix in If validate
* Fix build and code style
* fix failed tests
* Add torchvision::nms operator and layer test
* Change requested by a reviewer
* Remove div test
* convert constants to input type
* Mark some cases in div tests as xfail (#93)
* Small refactoring (#94)
* Small refactoring
* Fix type
* Fix python codestyle
* Incremental fix code style (#95)
* Fix style (#96)
* Fix copyright
* Fix code style
* Branch clean up (#97)
* Optimize includes and force opset10 (#98)
* Optimize includes
* Force opset10 in pt fe
* Fix codestyle (#99)
* Fix style
* Fix clang codestyle
* Fix cerr with debug log
* Update src/bindings/python/src/pyopenvino/frontend/pytorch/decoder.cpp
* Add pytorch dependency only if pytorch frontend is enabled
* Update src/bindings/python/src/pyopenvino/CMakeLists.txt
* Add layer tests to precommit (#100)
* Add layer tests to precommit
* Remove accidentally added files
* Apply code style on layer tests
* batch norm tests and fixes
* move default weight and bias to else block
* reduce code duplication
* Changes requested by a reviewer
* Changes requested by a reviewer
* Remove dependency from pytorch in pyopenvino (#102)
* Remove dependency from pytorch when fe is disabled
* Change docstring
* Remove pytorch FE dependency from pyopenvino
* Apply codestyle (#107)
* Apply codestyle
* Remove commented line
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix mock FE test (#108)
* Fix mock PE test (#111)
* Revert changes in StridedSlice (#114)
* Small refactoring (#116)
* Small refactoring
* Fix codestyle
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Apply suggestions from code review
* Update src/frontends/pytorch/src/op/group_norm.cpp
* Fix cmake copyright define (#117)
* Update src/frontends/pytorch/src/op/arange.cpp
* Apply suggestions from code review
* Update build configs (#120)
* FIx build configs
* Update type cast in full.cpp
* Apply review feedback (#121)
* Apply suggestions from code review
* Apply suggestions from code review
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Fix issue after master merge (#122)
* Fix issue after master merge
* Fix build
Co-authored-by: eaidova <ekaterina.aidova@intel.com>
Co-authored-by: bszmelcz <bartosz.szmelczynski@intel.com>
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
Co-authored-by: sikorsl1 <leonard.sikorski@intel.com>
Co-authored-by: Leonard Sikorski <l.sikorski123@gmail.com>
Co-authored-by: Mateusz <mateusz.mikolajczyk@intel.com>
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Yamini Nimmagadda