* Bucketize: Revise op class and add type_prop unit tests
* Bucketize: Develop reference implementation
* Bucketize: Add unit tests
* Bucketize: Add single layer test and cpu instantiation
* Bucketize: Add unit test with empty buckets for INTERPRETER
* Bucketize: Typo in buckets element type check
* Bucketize: Add custom generated inputs in single layer test class
* Bucketize: Use random_device to generate seed for data blob
* Bucketize: Remove unsupported f64 precision
* Bucketize: Add function description
* Bucketize: Remove randomness of inputs generation by using static seed
* Bucketize: Support different precisions for data and bucket inputs
* Bucketize: Refactor type_prop tests and improve backend unit test coverage
* Enable CoreThreadingTestsWithIterations tests for GNA
Sync rest of GNA Lib API,
Sync Config for MT tests
Change models in CoreThreadingTestsWithIterations to be compat with GNA
* Use parameter for model set selection
* Fix style
* Disable HETERO CoreThreadingTestsWithIterations tests and create issue 45658
* Fixed tests compilation for Android ARM
* Small fixes
* Fixed issues CVS-44775, CVS-34206, CVS-34349
* Disabled KSO tests for Template
* Eliminated invalid subgraphs
* Enabled KSO QueryNetwork tests for Template
* Fixed other plugins as well
* Used NodeTypeInfo instead of std::string
Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
changed PreprocessingPrecisionConvertTest:
- to force output precision to be same as input (and not FP32 always)
changed TEMPLATE plugin to allow U8 outputs
* [IE]: Allows plugins to disable Gather -> GatherIE conversion
Gather layer takes axis as 3rd input, not attribute and may
take indices as 0D scalar input
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Disables Gather -> GatherIE conversion
Gather -> GatherIE conversion may introduce Gather
operation decomposition into Unsqueeze + Gather +
Squeeze in case if indices input is 0D scalar input.
In case of dynamic Gather such decomposition will
break dynamic path. Myriad plugin has to support
Gather operation natively without legacy conversion.
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Enables native Gather support
Gather layer in contrast with GatherIE takes
axis as 3rd input, not attribute and may take
indices input as 0D scalar input.
0D -> 1D conversion happens automatically at
the beginning of frontend.
Axis as 3rd input is supported for single value
integral scalar only.
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU][Tests]: Enable new infra single layer Gather tests
* Removes corresponding tests from old infrastructure
* Enables test cases with 0D indices input
* Extracts base test fixture from shared tests fixture.
Unfortunately, Google Tests supports Combine generator
for tuples of size up to 10 only. Originally, shared
tests fixture already has 10 elements in tuple for
tests parameters. At the same time myriad plugin needs
to specify configuration option. Since configuration
option could not be test parameter we are forced to
use separate class, in order to get rid of code
duplication base class is used.
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
* [IE][VPU]: Updates firmware
Enables native Gather support on device side
* zero-copy (assuming determenistic app-level scheduling) for the multi-device, via "borrowing" the corresponding device-specific blobs and letting the app to implicitly use these
* Optimized Infer Request Scheduling
* remoteblob checks in the conventional SetBlob
* correctly (with status) reporting NOT_IMPLEMENTED
* SetBlob to accomodate for the RemoteBobs
* Tests for remote blobs support via MULTI: creating the shared_test in case the other (closed source) plugins would want to use that (in the private shared_tests instantiations).
Also instantiating the remote blobs tests for the some basic combinations to test the MULTI supports them
* macos compilation (and general plugin platform support) fix
* shuffled files, so that the MULTI tests are now part of the ieFuncTests (and need no separate target). Also brushed the macro that handales the NOT_IMPLEMENTED as bit
* further shuffled files, so that the initial MULTI tests are now part of the IE tests, yet specific instances do need separate targets
* Fixed misprint
* Brushing the code and comments a bit
* further brushing of the ScheduleToWorkerRequest: moving the task execution directly into the loop over devices (avoids pointers and 'else' clause)
* 1) zero-copy (assuming determenistic app-level scheduling) for the multi-device, via "borrowing" the corresponding device-specific blobs and letting the app to implicitly use these
2) Initial MULTI section in the opt guide (primarily to document a tip on helping the MULTI to keep the zero-copy path)
* [MULTI] remote context support and associated scheduling (respecting the remote data affinity)
* fix CentOS (old) gcc issue: https://gcc.gnu.org/bugzilla/show_bug.cgi?id=81880
since the intriduced therad_local string is template the bug manifests itself (and the string is not allocated/initialized).
the QA is to wrap the std::string into the function
* further fix for the old gcc versions issue, now with non-trivial thread_local destruction sefault: switching from the std::string to the plain const char*
* additional tests for the MULTI and remote blobs (no remote context and multi GPUs cases)
* fix for the tests (that now can check for more specific NotImplemented exeption).
Alos couple of line endings
* Range: Align operator with spec and add unit tests
* Range: Remove output shape from range ref impl signature
* Range: Exclude backend unit tests for CPU and GPU due to unsupported dynamic ops
* Range: Add single layer test class for Range-4
* Range: Add unit test for shape inference
* Range: Add unit tests for i32 and f32
* Range: Refactor Range v0 backend test and added test for f32 type
* Range: Add floating point tolerance in unit tests to avoid failures due to precision
* Range: Add subgraph tests for Range add element-wise
* Range: Refactor Range class for single layer tests and add range add element-wise test with truncated inputs
* [VPU] Fix dynamic networks import
* [IE][GNA][TESTS] Move ImportExport tests from GNA to shared part
* [VPU][Tests] Add ExportImport test for dynamic network
* [VPU] Review fixes
* [VPU][Tests] Review and test fixes
* [VPU][Tests] Move TEST_P to shared part
* Add reference implementation for PSROIPooling operator
* fix test_roi_pooling
* use std::roundf
* remove unnecessary copies in single layer tets
* Fixes after review
* fixes after review
* use element::Type_t instead of element::
* apply code format
* add PSROIPooling to evaluates_map
* apply code format
* ROIPooling: Specification and op class alignment
* ROIPooling: Add check to input tensor type to be aligned with spec
* ROIPooling: Corrected spec description for input tensor shape and box coordinates
* ROIPooling: Changed attributes pooled_h and pooled_w from Shape to plain int
* Revert "ROIPooling: Changed attributes pooled_h and pooled_w from Shape to plain int"
This reverts commit d49cfa8e53.
* ROIPooling: Further specification changes
* ROIPooling: Rename enum class ROIPoolingMethod methods
* Fix style
* ROIPooling: Draft reference implementation
* ROIPooling: Adjust feature map element type to float for attribute unit test
* ROIPooling: Add single layer test class
* ROIPooling: Corrected output index to iterate through output tensor elements
* ROIPooling: Added validation checks for input types in op constructor
* ROIPooling: Add unit tests
* ROIPooling: Attributes unit test changed to align with spec
* ROIPooling: Add check for batch id in reference implementation and unit test
* ROIPooling: Refactor single layer test class
* ROIPooling: Add test for invalid pooling method
* ROIPooling: Clean up unnecessary function declaration
* ROIPooling: Remove duplicated default ROIPooling method in op constructors
* ROIPooling: Add Infer method to generate suitable ROI data
* ROIPooling: CPU single layer test instantiation for max method
* ROIPooling: Remove enum class ROIPoolingMethod
* Revert "ROIPooling: Clean up unnecessary function declaration"
This reverts commit 074b540dea.
* ROIPooling: Refactor single layer tests after removing enum class ROIPoolingMethod
* ROIPooling: Add attribute checks in op constructor to align with spec and unit tests
* Resolve CI failure: clang could not resolve static conversion from uint64_t to size_t
* ROIPooling: Fix for output index calculation to loop through all ROIs
* ROIPooling: Add unit test for bilinear interpolation method
* ROIPooling: Add CPU single layer test instantiation for bilinear method
* ROIPooling: Clean up unnecessary enum class for pooling method
* ROIPooling: Add myriad single layer test instantiation
* ROIPooling: Add F16 precision single layer tests for CPU plugin
* ROIPooling: Add node validation check for string method attribute in constructor and unit tests
* ROIPooling: Spec changes to improve understanding of the operation
* ROIPooling: Fix for bilinear method when pooled size is 1x1
* ROIPooling: Add unit test for bilinear method and pooled size 1x1
* ROIPooling: Fix to broken format of specifications
* ROIPooling: Disable Myriad single layer tests
* ROIPooling: Handle dynamic dims and ranks for input tensors and unit tests
* ROIPooling: Code clean up
* ROIPooling: Address review comments
* ROIPooling: Changed location for makeROIPooling helper method
Co-authored-by: Kirill Molchanov <kirill.molchanov@intel.com>
* [CPU BF16] Greedy mode was added
* [IE TESTS][BF16] Added support for operations with bf16 precision in the single layer tests.
* Added cpu specific bfloat16 single layer tests for the jit_eltwise primitive.
* [CPU TESTS] Activation and logical single layer tests fixes.
* [IE TESTS] Fix activation single layer tests run.
* [IE TESTS][CPU] CPUTestBase further refactoring.
* [CPU BF16] Support for Bfloat16 type was added to the MVN layer. (#3)
* [CPU BF16] MVN layer bfloat16 compatibility.
* [CPU BF16] MVN bfloat16 minor fixes.
* [CPU BF16] MVN node exception about BF16 support replaced with precision redefinition.
* [CPU BF16] MVN layer bloat16 support fixed for quantization operations and blocking layout.
* [CPU] Input and output precision checks were added to MVN layer.
* [IE TESTS][CPU BF16] Most of the bloat16 tests have been fixed.
* Bf16 crop layer (#4)
* [IE TESTS][CPU] Cpu specific test for the Crop layer has been created.
* [IE TESTS][CPU] Deprecated Crop single layer test removed.
* [CPU BF16] Bfloat16 precision was added to the Crop layer.
* [CPU BF16] Crop layer minor code improvements.
* [IE TESTS][CPU] Crop layer test added 2D tensor tests.
* [IE TESTS][CPU] Crop layer test, obsolete comment removed.
* [IE TESTS][CPU] Fixed CropIE include path.
* Crop test fix for older gcc compiler.
* [CPU BF16] Reduce layer extended with bfloat16 support.
* [IE TESTS][CPU] CPU specific single layer test for Reduce operation.
* BF16 optimized layers
* [CPU BF16] Bfloat16 custom type added to the MKLDNN plugin.
* [CPU BF16] Mem alignment to 16 bytes added to bfloat16 class union.
* [IE TESTS][CPU] Permute cpu specific single layer test and minor cpu tests fixes
* MVN cpu single layer tests extended with nhwc ndhwc layouts.
* Mod mode removed from Eltwise cpu single layer test.
* Permute cpu specific single layer test.
* Smoke keyword was added to the CPU single layer tests.
* Normalize node was modified for BF16 support
* [CPU BF16] The RegionYolo layer has been extended with the bfloat16 type support.
* Resample node was extended with BF16
* Select layer was enabled with BF16
* psroi supports bf16 (#7)
* reorders replaces converts (#9)
* BF16 planar pooling was enabled
* [CPU BF16] Cpu_convert added to the RegionYOLO node.
* [IE TESTS][CPU] Crop single layer test has been rewritten using the StridedSlice operation.
* [IE TESTS][CPU] Covert layer test extended with bf16 precision.
* [CPU BF16] The bfloat16 class was renamed bfloat16_t and some refactoring has been done.
* [CPU BF16] RegionYOLO and Softmax were aligned with the review.
* [IE TESTS CPU] CPU single layer tests refactored according to the review suggestions.
* [IE TESTS CPU] The Reduce CPU single layer test was extended with different mem orders.
* [IE TESTS CPU] Minor fixes after the review.
* [IE TESTS CPU] Common plugin configuration has been moved to PreparePluginConfiguration function.
* Minor changes after review
* StridedSlice, Select, ScaleShift notes were resolved
* Fixes to the Reduce operation cpu test and minor fixes related to the review.
* GPU eltwise tests fix.
* psroi unrolled to the primary state; code clean (#12)
* PSROIPooling layer with C++ optimizations
* Minor fix for compatibility with CPUTestsBase for fuse_permute_reorder test.
* Code clean & psroi rollbacked
Co-authored-by: Maksim Kutakov <maksim.kutakov@intel.com>
Co-authored-by: Maksim Kutakov <maxim.kutakov@gmail.com>
Co-authored-by: Yury Gaydaychuk <yury.gaydaychuk@intel.com>
Svetlana Dolinina