* Enable low precision types for ConvertLike operation
* Migrate backend unit test suite to template plugin reference tests
* Fix typo in naming convention
* Avoid duplication of template plugin tests execution
* Add file to instantiate TEST_P and avoid test execution duplication
* revise tan op
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update doc
add examples in desciption
add the unit of measure
clear input type
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* add template plugin test case for int type
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* add template plugin test case for uint and float
remove the float test in backend
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* modify document
change type to any supported numeric type
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* fix compile error in openvino-lin
Signed-off-by: Hu, Yuan2 <yuan2.hu@intel.com>
* update spec, add visitors, backend test
* remove visitors test as it is implemented in another PR
* remove visitors test from CMakeLists
* remove old backend tests, refactor minor parts of the code
* add namespace
* refaactor template test for less_equal op
* update docs
* add host tensors validation
* create type_prop tests
* create serialization single layer test
* create visitor test
* create op_reference test
* add logicalAnd to constants.py
* create additional op_reference tests
* add check for number of visited attributes in visitor test
* update auto_broadcast description
* remoove backend test
* update LogicalNot params name
* remove backend test from CMakeList
* create util function for type_prop tests
* update op_reference tests
* remove typo in docs
* remove unsupported types from evaluate
* fix bug in op_reference test
* refactor visitor test
* update math formula in the spec
* update has_evaluate types
* Revise spec
* Comparison backend test POC
* Split Comparison ops tests into separate files
* remove comparison.cpp, remove unused imports, replace for_each with range based for
* remove unnecessary ngraph:: prefixes
* Fix links in spec
* Add Less to trusted ops list
* Add missing ','
* Use builder in backend tests
* Remove old backend tests for less, equal
* Revise Erf OP sepc
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Revise the NGraph Erf OP implment to switch to RTTI.
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Remove the duplicated Erf in the activation type vector.
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Add NGraph visitor API test case.
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Enalbe the Erf visitor API CmakeLists.txt.
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Revise the Erf OP backend test
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Migrate to use the template test.
* Add erf type_prop test.
* Update the license
* Unary Visitor test template fix
-Migrate OP Tanh to use RTTI;
-Remove the using namespace in the header file
-Migrate the Swish and Tanh visitor test to use template code
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Revert "Unary Visitor test template fix"
This reverts commit b686c933d3.
* Update the doc format.
* Update the document format and description.
Signed-off-by: Luwei Zhou <luwei.zhou@intel.com>
* Add Erf OP into the layer test summary list
* Migrate the Erf backend test into template_plugin infrastructure
* Update the Erf supported input type.
* Remove the boolean type support in erf reference implement.
validate_and_infer_elementwise_arithmetic() will fail with boolean type.
* Update the erf test with all supported types.
* Update with separate namespace of CommonReferenceTest
* Add visitor and backend tests.
* Add reduction_axes to SLTs, serialization and backend tests.
* Update backend tests.
* Move backend tests to template plugin, remove old ones.
* Apply correct format.
* Add BF16 to SLT, add comment regarding deprecated class.
* Remove BF16 precision as it is not supported in windows, no default values for attributes.
* Reuse Tensor from base_reference_test.hpp
* minor changes in Op class and add ref impl for acosh
* acosh in new test framework
* add Acosh type test
* add SLT for Acosh
* run more test
* new acosh plugin test
* add visitor test
* fix test utils
* add template test for all supported types in Acosh
* add builder to template tests
* update grn template_plugin test
* update maste to feature branch
* update docs
* add sign to intActivationTypes
* add RTTI macro
* update backend test
* add type prp test
* add visitor test
* add visitor and type_prop test to CMakeList
* add sign to constants.py
* delete backend tests and create new reference tests
* style fix
* remoove sign backend test from CMakeList
* create reference test for all supported types
* remove boolean type from evaluate method
* Add GRN shared single layer test instance for CPU
* Remove GRN backend tests from fused_op.in
* Init GRN new template reference tests
* Add more bias values to GRN single layer tests
* Add more GRN template reference test cases
* Remove unused parameter from GrnParams
* Refactor GRN template referene tests and add more types
* Add anonymous namespace
* Add bf16 type to cpu single layer tests
* Add Serialization test
* Add GRN to revised ops
* Moved CC macros for transformations to public API (to reuse their in plugin transformations)
* Added CC to template plugin
* Moved itt.h from nGraph to openvino/cc
* Fixed build
* Corrected tests to match CVS-53713
* Fixed tests configs
* Skip tests on GPU
* Commented condition inside main SetBlob because of MYRIAD
* Adopted tests
* Added LoadNetwork(filename) to AUTO
* Added more files
* So pointer can be used without loading
* Changed InferencePlugin, ICore to return internal interfaces
* Added SoPointers for InferRequest, ExecutableNetwork
* Fixed Windows
* Fixed KMB
* Fixes for KMB
* Removed dereference operator
* Play with include files
* Fixed compilation with older compilers
* Fixed comments
* Fixed win build
* Try to fix Windows
* Try to fix Windows 2
* Fixed windows
* Fixed windows
* Removed SOPointer as a base class
* Reverted back SOPointer split
* Code review
Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
* Fixed preprocessing for template plugin
* Added more tests instances
* Split common transformation to smaller ones which can be used by plugins
* Moved preprocessing transformation to Plugin API
* Added PreprocessConversionTest tests
* Disabled tests on GPU: CVS-51764
* Disabled some tests on VPU and TEMPLATE
* Support for input layout conversions in TEMPLATE plugin
* Improvements in Template Plugin
* Fixed compilation
* Fixes
* Disables some tests
* Fixed compilation on Windows
* Fixed docs
* Small refactoring in TEMPLATE plugin
* Fixed compilation on Windows
* Fixed code style
* Hide CALL_STATUS_FNC helpers to private API
* Moved some base classes to private place from plugin_api
* Updates for VariableState creation
* Take Jane's changes for Demension names
* Revert "Take Jane's changes for Demension names"
This reverts commit 9f6c8fa5a6.
* Removed ICNNNetwork include
* removed more icnnnetwork includes
* Added missed include with ie_input_info.hpp
* Fixed GNA plugin to provide names w/o \0
* Removed suppressions for IInferRequest deprecation
* Fixed Windows
* More fixes for Windows
* Fixed compilation on Windows
* Fixed comment in documentatipn
* Fixes for Andorid
* Fixes for old gcc 4.8
* WA for cross-compilations
* Fixed compilation
* Fixed HETERO plugin compilation for old compilers
* Flags
Co-authored-by: lab_ddpqa <lab_ddpqa@intel.com>
* Added PreprocessConversionTest tests
* Disabled tests on GPU: CVS-51764
* Disabled some tests on VPU and TEMPLATE
* Support for input layout conversions in TEMPLATE plugin
* [Plugins test] Add functional test for correct import/export support by plugins
Test suite creates number of models with various precisions.
For each model:
- If plugin doesn't support IMPORT_EXPORT_SUPPORT metric - skip the test
- Try LoadNetwork without cache enabled fails - skip the test
- Do one inference
If Load and Infer request is succeeded and plugin has import metric:
- Load network with cache enabled. Infer request and compare outputs with original infer
- Import network, perform inference. Compare outputs with previous ones
* Fix Centos build warnings
Myriad: reset executableNetwork before next load
Myriad: Reduced time consumption for Myriad tests
* Caching test suite - batch size parameter support
Test:
Use benchmark_app from this PR #4814
Run ./benchmark_app -h
Verify that template plugin is listed in supported caching devices
Run ./benchmark_app -m <model.onnx> -d TEMPLATE -i <file> -cache tmpCache
Verify that tmpCache is created and network is exported to blob
Verify that if model is ONNX (e.g. ResNet50) - that loading of network is performed faster when cache is available
Run several times: ./benchmark_app -m <model.onnx> -d TEMPLATE -i <file> -cache tmpCache -single_load
Verify that if model is ONNX (e.g. ResNet50) - that loading of network is performed faster when cache is available
Verify that in this mode loading of network is faster than without "-single_load" option
Gabriele Galiero Casay