* Remove ngraph headers from some core source files
* Suppress some warnings
* Suppress more warnings
* Try to fix some compilation issues
* Suppress more warnings
* Supress clone_model
* Suppress warnings for Windows
* Suppress more warnings for Windows
* Suppress more warnings for Windows
* Additional suppress
* More Windows warnings
* Additional warning
* Suppress more warnings
* Suppress warning from python API
* [WIP] Added load_extension on Python side
* Added load_extension to NodeFactory as an alternative way to expose them to user (openvino path only, no changes in ngraph legacy path
* Reverted adding load_extensions in openvino.runtime
* Renamed load_extension to add_extension to be aligned with other part of extension API
* Applied code style rules
* Shorter description of NodeFactory.add_extension
* Fixed accidentally deleted indent
* Explicit error when custom op without intpus is attempted to be created, better help for NodeFactory.add_extension (op version clarification)
* Style fixes
* Test to cover NodeFactory.add_extension
* Minor wording changes
* Code style
* Fix code style
* Limit NodeFactory.add_extension test to specific test configurations
* Remove inits, update main one
* Fix stacklevel
* Testing wrong solution
* Testing test test
* Fix test test test test
* mo modules mo problems
* Xfail test that check stdout/err?
* not so correct solution to circular imports
* Fix or not to fix
* CMake magic, co-authors: my best team
* Fix package imports
* Fix tools inits
* Fix ovc tf
* Fix Q000
* Fix F401
* Fix linters
* Add save_model
* Remove LayoutMap
* Move test_utils to 'internal modules'
* First testing
* Missing Type
* Expand main namespace
* Change some more tests
* Add OVAny to namespace
* Add Constant and Parameter to namespace
* More tests changes
* Fix inits
* Add layout_helpers to main namespace
* Revert CMake and linux.yml with ovc
* Update main inits
* Remove MO from tools inits
* changes to init files
* Fix tests
---------
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
* Added Torchscript Backend
* First commit for backend with Torch FX Decoder
* Merging changes from Torch FX branch
* Torch FX initial fixes (Temporary)
* Fixed type/shape issues in Torch FX decoder
* Added translation for built-in getitem
* MaxPool update & Output shape fix (Torch FX)
* Torch FX graph outputs fix
* Torch FX support for sigmoid and slu_
* Torch FX graph module caching
* Torch Fx partitioner cache removed
* Torch FX initial getitem replacer added
* Index check for torch fx getitem replacer
* Debug print removed from partitioner
* Added environment variables for pytorch tracing mode and openvino device
* FX translation fix for getitem & getitem replacer removed
* Added checks for PyTorch tracing mode environment variable
* Adding compile mode for fallback
* Added more ops for resnet18
* Added a check for environment variable
* Generalized addmm to work with torchscript and torchfx
* Added the missing batch_norm.default translation
* fx_backend: include get_attr ops to the partitions
* AddeTODO note t to improvget_attr algorithm
* created function for adding get_attr nodes
* fx_backend: added aten.mul.Tensor, re-enabled aten.empty.memory_format
* fx_backend: Additional op support/improvement for Inception V3
* Added comment for fix 64-bit to 32-bit max int conversion
* fx_backend: Update for avg_poolnd to support 3 inputs
* Fixed erorr in decoder.py
* TorchFX caching fix
* Torch backend, op support for Stable Diff. & BERT
* Arranged ops in order and added torch tensor mapping
* Added support for more ops for super glue
* TorchFX: Initial permanent fallback
* TorchFX: New ops for improved TorchVision support
* TorchFX backend optimizations for partitioning and tmp fallback
* working operator updates for superglue
* Updates to operators for superglue
* Removed max.dim and stack
* Cleanup
* Cleanup
* Fixed a couple of syntax issues
* Fixed a couple of syntax issues
* Added missing method to TorchFX Decoder
* Added missing method to TorchFX Decoder
* Removed redundant code for transpose
* TorchFX: Initial StableDiffusion support
* PyTorch decoder ovtype to ctype fix for int64
* Added ops for distilbert
* Fixed few unnecessary include statements
* Seperated TorchFX and TorchScript decoders
* Modified import statements to reflect two decoders
* f64 fix for TorchFX
* Import fix for PyTorch backend modules
* TorchFX serialize graph for debugging (Temporary)
* Serialize and load back feature enabled for TorchFX
* Temporary optimization to remove Broadcast
* Temporary SoftmaxRehapeElimination pass is added
* TorchFX custom model cache directory
* PyTorch bitwise translation, conversion checks enabled
* Naming fix in make_list_construct
* TorchFX: Added comments to Softmax and Slice translations
* translate_chunk temporarily removed for TS backend
* Fixed linter issues
* Addressed clang formatting issues
* Fixed few more clang and linter issues
* Fixed tests to use ts_decoder
* Fixed naming convention issues
* Added missing import
* Added inlined_inputs to TorchScriptDecoder
* Added tests for torch fx backend
* Removed magic numbers in PyTorch decoder utils
* TorchFX decoder data type fix
* Added cast from size_t to int
* TorchFX output handling code cleanup
* TorchFX: Use detached input tensor
* Added missing cast from size_t to int
* Added static cast in group_norm
* Fixed casting issue in split
---------
Co-authored-by: ynimmaga <yamini.nimmagadda@intel.com>
Co-authored-by: Cavus Mustafa <mustafa.cavus@intel.com>
* Draft version of save_model function (C++, Python)
* Fixed code style.
* Fixed incorrect test model construction for Python save_model tests
* Minor improvements in code readability
* Minor adjustment based on PR review
* WIP: parameters cleanup
* Removed debug output, fixed CLI
* Fixed python objects conversion
* Finally renamed mmap to share_weights
* Fixed TF conversion from a file or a directory
* Fixed obvious errors in unit tests
* Deleted layouts from OVC. Fixed most of the fails in ovc unit tests (there are still failures)
* Clenaup other references to layouts and fixed --version
* Fixed case when two model files are passed in TF case
* Fixed multiple model parts passing in ovc command line
* Tests fixed, support of unnamed input in cli parser.
* Remove convert_model from runtime.
* Changed silent to verbose.
* Removed transform param.
* Removed example_input, share_weights from ovc cli tool.
* Remove wrong change.
* Test fix.
* Code corrections.
* Returned comment.
* WA to fix process hanging after extension loading.
* Removed not needed code.
* Added comment.
---------
Co-authored-by: Sergey Lyalin <sergey.lyalin@intel.com>
* Handle sequence ops with non constant W, R, B inputs
Ticket: CVS-49207
* fix tests
* tests
* fix gna tests
* add include
* change type for seqLenIdx
* rename is_constfoldable to is_on_constant_path
---------
Co-authored-by: Ivan Tikhonov <ivan.tikhonov@intel.com>
* [PT FE]: support nested inputs in example_inputs and arg dicts with different argtypes
* accept hande lists as inputs
* Update tools/ovc/openvino/tools/ovc/moc_frontend/pytorch_frontend_utils.py
* update tests and add comments in code
* fix for custom types in annotations and duplicate in mo
* Update tools/mo/openvino/tools/mo/moc_frontend/pytorch_frontend_utils.py
* Removed copy of consts in translator, added test.
* Fixed memory loss for tf.Const.
* Added test, minor corrections.
* Update src/bindings/python/src/openvino/frontend/tensorflow/node_decoder.py
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* Test corrections.
* Added comment.
---------
Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
* [PyOV] Extend Tensor API
* one more ctor
* apply comments
* support constoutput
* add checks for shape
* checks for type and shape
* apply comments
* is_continuos
* codestyle
* Implementation of MMAP for ONNX FE
* fix win offsets
* added virtual dtor to MappedMemory
* review remarks. part.1
* added disable mmap flag to MO
* added additional checks to mmap
* remove unnecessary const
* fix pybind default value
* Added args.disable_mmap = False to MO tests
* fixed MO test
* avoid global headers
* fix casting for win
* disable mmap for legacy frontends flow
* review remarks
* Fixed passing parameters
* added doc to MappedMemory and load_mmap_object
* Update ONNX FE scatter_elements to use ScatterElementsUpdate-12
* ONNX tests update
* Set reduction update
* Enable xfailed tests
* Add more onnx tests
* Fix reference implementation to support negative indices
* Style alignment
* Initial commit for proxy plugin
* Include proxy to openvino library
* Fixed some tests
* Added plugin properties
* Added readme
* Support Compile model for the proxy plugin
* Fixed python
* Remove gmock
* Fixed some tests
* Fixed load plugin tests
* Removed internal PROXY_FALLBACK_PRIORITIES initialization property
* Fixed code style
* Added new tests
* Create architecture.md
* Fixed some proxy tests
* Implement not implemented functions
* Fixed ICore mock
* Remove redundant code
* Added import/export tests
* Fixed hetero import/export tests
* Fixed ICore mock
* Fixed import tests
* Fixed build
* Remove redundant parse config
* Fixed some comments
* Try to fix Windows build
* Fixed incorrect logic
* Small fix in tests
* Fixed python API
* Fixed typo
* Try to fix python
* Switch GPU under proxy
* Fixed GPU name
* Revert GPU plugin under proxy
* Small changes in CMake files
* Temp commit
* Build without proxy
* Revert "Temp commit"
This reverts commit 1ac9824bdf.
* Fixed test linking
* Removed tests from ncc check
* Add option to disable proxy plugin
* Fixed minor comments
* Disable some proxy tests if IR frontend is disabled
* Enable Intel GPU under the proxy
* Fixed typo
* Fixed segfault in tests
* Small fix for case if only GPU is registered
* Fixed code style
* Added remote context tests
* Added proxy tests to CI
* Fixed mock engine
* Test change
* Revert "Test change"
This reverts commit 2d1d67766f.
* Add new tests
* Removed some tests
* Revert "Removed some tests"
This reverts commit 090398652f.
* Revert incorrect logic
* Removed unused variables
* Use original name for the GPU plugin
* Fixed CMake
* Do not show hidden devices
* Try to fix GPU remote context
* Fixed GPU plugin build
* Added interface for proxy remote context
* Remove local properties
* Remove redundant API
* Fixed typo
* Added remote tensors
* Fixed code style
* Fixed some comments
* Unwrap remote tensors before conversion to Blob
* Added cast for legacy API
* Fixed some cldnn tests
* Do not add preprocessing for proxy plugin
* Enabled more tests and wrap tensors in infer request
* Use hardware request inside conversion wrapper
* Fixed hand on cache calculation
* Try to fix some tests
* Support set tensor for remote tensors in proxy plugin
* Revert "Support set tensor for remote tensors in proxy plugin"
This reverts commit 5a927de590.
* Remove redundant friend from compiled model and fix life time for infer
request
* Fixed code style
* Add additional so pointers to the tensor
* Rewrite approach for compile model and tensor
* Removed API from proxy
* Fixed is/as Blob for wrapped Blobs
* Wrap tensor when set tensor to plugin
* Fixed recursive call
* Don't unwrap tensors for AUTO plugin
* Fixed Some Multi tests with remote blob for proxy
* Align context name with tests
* Fixed code style
* Try to fix more tests
* Some minor changes
* Try to fix OVHoldersTests
* Try to save low level SO in high level wrappers
* Revert "Try to save low level SO in high level wrappers"
This reverts commit 430ff8a526.
* Revert "Try to fix OVHoldersTests"
This reverts commit 32604f0d3e.
* Disable some tests
* Fixed DynamicBatchShapeTests
* Fixed caching tests and skip OVHoldersTest
* Small refactoring
* Fixed import model
* Small fix
* Fix typo which causes fails of caching tests
* Disabled AUTO BATCH for proxy device
* Support Export in Auto batch
* Small changes
* Fixed initialization fallback to plugin with proxy name
* Added more values for tests
* Ask all devices and create context if no device id
* Support export in auto batch
* Fixed some comments
* Fixed some comments and removed auto batch
* Fixed some comments
* Fixed auto batch test and some comments
* Fixed build
* Removed proxy plugin class from dev api
* Fixed code style
* Fixed disabled tests
* [PyOV] Expose api to Model class
* assign op
* Update src/bindings/python/src/pyopenvino/graph/ops/assign.cpp
* add remove_ methids
* improve test
* codestyle
* assign operation
* codestyle
* test size
---------
Co-authored-by: Michal Lukaszewski <michal.lukaszewski@intel.com>
Przemyslaw Wysocki