* ConvertLike: Develop reference implementation
* ConvertLike: Enable single layer tests for GPU plugin
* ConvertLike: Enable bf16 precision for evaluate method
* ConvertLike: Add unit tests
* ConvertLike: Add dynamic shape test case
* ConvertLike: Remove unnecessary ngraph namespace and using declaration for v1::ConvertLike
* ConvertLike: Simplified reference::convert by using std::enable_if
Before this patch constant with weights could be not detected if
it wasn't directly connected to Conv/Deconv layer.
Now weights always uses common data format (bfzyx) in the plugin which is
converted into weights format later (goiyx, oiyx, etc), so weights sub-graph
can now contain anything
* Partially removed cmake duplication with IE cmake
* Deprecated API usage: fixed or suppressed
* Fix for TypeRelaxed
* Canonical form for ngraph includes
* Removed extra visibilit settings; removed graphviz find_package
* Removed var_functions module; canonical includes for ngraph::reference
* Fixed deprecated API in ngraph tests
* Re-use standard cmake macro for shared libs
* Trying to fix ONNX importer tests
* Enable CoreThreadingTestsWithIterations tests for GNA
Sync rest of GNA Lib API,
Sync Config for MT tests
Change models in CoreThreadingTestsWithIterations to be compat with GNA
* Use parameter for model set selection
* Fix style
* Disable HETERO CoreThreadingTestsWithIterations tests and create issue 45658
* Fixed tests compilation for Android ARM
* Small fixes
* Fixed issues CVS-44775, CVS-34206, CVS-34349
* Disabled KSO tests for Template
* Eliminated invalid subgraphs
* Enabled KSO QueryNetwork tests for Template
* Fixed other plugins as well
* Used NodeTypeInfo instead of std::string
Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
* zero-copy (assuming determenistic app-level scheduling) for the multi-device, via "borrowing" the corresponding device-specific blobs and letting the app to implicitly use these
* Optimized Infer Request Scheduling
* remoteblob checks in the conventional SetBlob
* correctly (with status) reporting NOT_IMPLEMENTED
* SetBlob to accomodate for the RemoteBobs
* Tests for remote blobs support via MULTI: creating the shared_test in case the other (closed source) plugins would want to use that (in the private shared_tests instantiations).
Also instantiating the remote blobs tests for the some basic combinations to test the MULTI supports them
* macos compilation (and general plugin platform support) fix
* shuffled files, so that the MULTI tests are now part of the ieFuncTests (and need no separate target). Also brushed the macro that handales the NOT_IMPLEMENTED as bit
* further shuffled files, so that the initial MULTI tests are now part of the IE tests, yet specific instances do need separate targets
* Fixed misprint
* Brushing the code and comments a bit
* further brushing of the ScheduleToWorkerRequest: moving the task execution directly into the loop over devices (avoids pointers and 'else' clause)
* 1) zero-copy (assuming determenistic app-level scheduling) for the multi-device, via "borrowing" the corresponding device-specific blobs and letting the app to implicitly use these
2) Initial MULTI section in the opt guide (primarily to document a tip on helping the MULTI to keep the zero-copy path)
* [MULTI] remote context support and associated scheduling (respecting the remote data affinity)
* fix CentOS (old) gcc issue: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=81880
since the intriduced therad_local string is template the bug manifests itself (and the string is not allocated/initialized).
the QA is to wrap the std::string into the function
* further fix for the old gcc versions issue, now with non-trivial thread_local destruction sefault: switching from the std::string to the plain const char*
* additional tests for the MULTI and remote blobs (no remote context and multi GPUs cases)
* fix for the tests (that now can check for more specific NotImplemented exeption).
Alos couple of line endings
* [CPU BF16] Greedy mode was added
* [IE TESTS][BF16] Added support for operations with bf16 precision in the single layer tests.
* Added cpu specific bfloat16 single layer tests for the jit_eltwise primitive.
* [CPU TESTS] Activation and logical single layer tests fixes.
* [IE TESTS] Fix activation single layer tests run.
* [IE TESTS][CPU] CPUTestBase further refactoring.
* [CPU BF16] Support for Bfloat16 type was added to the MVN layer. (#3)
* [CPU BF16] MVN layer bfloat16 compatibility.
* [CPU BF16] MVN bfloat16 minor fixes.
* [CPU BF16] MVN node exception about BF16 support replaced with precision redefinition.
* [CPU BF16] MVN layer bloat16 support fixed for quantization operations and blocking layout.
* [CPU] Input and output precision checks were added to MVN layer.
* [IE TESTS][CPU BF16] Most of the bloat16 tests have been fixed.
* Bf16 crop layer (#4)
* [IE TESTS][CPU] Cpu specific test for the Crop layer has been created.
* [IE TESTS][CPU] Deprecated Crop single layer test removed.
* [CPU BF16] Bfloat16 precision was added to the Crop layer.
* [CPU BF16] Crop layer minor code improvements.
* [IE TESTS][CPU] Crop layer test added 2D tensor tests.
* [IE TESTS][CPU] Crop layer test, obsolete comment removed.
* [IE TESTS][CPU] Fixed CropIE include path.
* Crop test fix for older gcc compiler.
* [CPU BF16] Reduce layer extended with bfloat16 support.
* [IE TESTS][CPU] CPU specific single layer test for Reduce operation.
* BF16 optimized layers
* [CPU BF16] Bfloat16 custom type added to the MKLDNN plugin.
* [CPU BF16] Mem alignment to 16 bytes added to bfloat16 class union.
* [IE TESTS][CPU] Permute cpu specific single layer test and minor cpu tests fixes
* MVN cpu single layer tests extended with nhwc ndhwc layouts.
* Mod mode removed from Eltwise cpu single layer test.
* Permute cpu specific single layer test.
* Smoke keyword was added to the CPU single layer tests.
* Normalize node was modified for BF16 support
* [CPU BF16] The RegionYolo layer has been extended with the bfloat16 type support.
* Resample node was extended with BF16
* Select layer was enabled with BF16
* psroi supports bf16 (#7)
* reorders replaces converts (#9)
* BF16 planar pooling was enabled
* [CPU BF16] Cpu_convert added to the RegionYOLO node.
* [IE TESTS][CPU] Crop single layer test has been rewritten using the StridedSlice operation.
* [IE TESTS][CPU] Covert layer test extended with bf16 precision.
* [CPU BF16] The bfloat16 class was renamed bfloat16_t and some refactoring has been done.
* [CPU BF16] RegionYOLO and Softmax were aligned with the review.
* [IE TESTS CPU] CPU single layer tests refactored according to the review suggestions.
* [IE TESTS CPU] The Reduce CPU single layer test was extended with different mem orders.
* [IE TESTS CPU] Minor fixes after the review.
* [IE TESTS CPU] Common plugin configuration has been moved to PreparePluginConfiguration function.
* Minor changes after review
* StridedSlice, Select, ScaleShift notes were resolved
* Fixes to the Reduce operation cpu test and minor fixes related to the review.
* GPU eltwise tests fix.
* psroi unrolled to the primary state; code clean (#12)
* PSROIPooling layer with C++ optimizations
* Minor fix for compatibility with CPUTestsBase for fuse_permute_reorder test.
* Code clean & psroi rollbacked
Co-authored-by: Maksim Kutakov <maksim.kutakov@intel.com>
Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
Co-authored-by: Yury Gaydaychuk <yury.gaydaychuk@intel.com>
* Added pre-proc test
* Fixed mean image tests
* Disabled scale tests for CPU
* Disabled test for Myriad
* Disable tests for GPU
* Added reverse input channels test
* Disabled test for GPU
* Disable Myriad tests
* Added links to tickets
* Initial summary dumper implementation
* Handle Tensoriterator body + add parser script
* Add support of XML reports merging + report OP names with versions
* Remove debug device name change
* Fix windows building issue
* Add --disable_test_skips command line option
* Gtest failure with logging
* Change skipping logic and resolve linkage errors caused by extern
* Get graph body from Loop
* Fix disable_tests_skipping symbol redefinition
* Fix inline for currentTestIsDisabled
* Rollback get_body for Loop
* Handle cases with skip in test SetUp
* Report Loop and TI ops along with ops in subgraph body
* Resolve some PR comments
* Dummy commit to kick pre-commit validation
Co-authored-by: Efode, Irina <irina.efode@intel.com>
* Generate unique output file names in CheckExecGraphInfoSerialization testcase.
When multiple instances of this test were executed in parallel the same
file was accessed by multiple threads which was the cause of flakiness.
* Enable ExecGraphTests.CheckExecGraphInfoSerialization on GPU
* [IE] Add batched blob support
New `class BatchedBlob : public CompoundBlob` defined to allow to pass multiple blobs as 1 InferRequest input.
Motivation: There is the special user case when a number of plain images (e.g. `NV12Blob`) should be passed as one input for network which batch size > 1.
`class CompoundBlob` is not applicable for such cases due to:
1. `NV12Blob` is `CompoundBlob` which prevents to combine multiple NV12 images to a CompoundBlob
2. The default behavior in most of plugins - do not accept generic CompoundBlob as `SetBlob()` argument
Adding `SetBlob(name, vector<Blob::Ptr>...)` to `class IInferRequest`, `class InferRequest`, `class IInferRequestInternal`, ... - is not effective solution due to limited and specific use cases for `batched inputs`.
+ Apply rule-of-zero to CompoundBlob and inherited classes.
* Add "BATCHED_BLOB" optimization capability metric
* Add BatchedBlob usage to hello_nv12_input_classification
* Apply offline code review outcome:
1. Revert CompoundBlob public .ctors signatures
2. Remove 'workaround' .ctor for `BatchedBlob`
3. Revert tensor descriptors of `I420Blob` `NV12Blob` back to the 'fake' value.
* Code review fix
* Add functional tests for CPU, GPU, MULTI, HETERO
* update doc comment
* Apply code review change requests.
* [LPT] functional tests: FakeQuantize with dynamic intervals
* [LPT] decomposeFakeQuantize: removed debug info
* [LPT] Add NetworkHelper::mark_as_dequantization_op function
[ngraph] Fix compare runtime info function
[LPT] Fix test cases with no DEQUANTIZATION runtime attribute
[LPT] Change include path for dequantization op
* [LPT] Remove Subtract functional test, enable and rename legacy tests
Co-authored-by: Vladislav Golubev <vladislav.golubev@intel.com>
Co-authored-by: Aleksandr Pertovsky <aleksandr.pertovsky@intel.com>
* Added tests
* Changed iterator algorithm
* Fixed legacy tests
* Added plugin tests
* Disabled some tests
* Remover parameter tests
* Fixed conversion
* Use old approach for old tests
* Temp commit
* Fixed iterator
* Fixed some tests
* Change logic to compare iterators
* Disabled CPU functional test
* Temp commit
* Disabled test for GPU
* Fixed network copy
* Try to fix test for Windows
* Disabled test for GNA
* Disable plugin tests
* Disable legacy test
* Remove redundant code
* fix typo in LRN docs
* fix link to reference in LRN doc
* LRN, LRN_IE types alignment with spec
* align LRN ref implementation to plugins behavior
* update LRN docs
* Improve LRN reference implementation performance
* restore LRN constructor with no axes in the input
* apply code format
* revert double->float size_t->int change
* small fix to example in doc
* revert double->float size_t->int in onnx_importer and backend tests
* Changes to docs after review
Mingyu Kim