* [clDNN] Handle negative axis in concat op
That enables following models for onnx importer path:
yolact-resnet50-fpn-pytorch
yolact-resnet101-fpn-pytorch
yolact-darknet53-fpn-pytorch
swin-tiny-patch4-window7-224
action-recognition-mkinetics-res34-mhsa
driver-action-recognition-adas-0002-decoder
horizontal-text-detection-0001
* Add tests for negative axis in Concat op
* Add visitor and backend tests.
* Add reduction_axes to SLTs, serialization and backend tests.
* Update backend tests.
* Move backend tests to template plugin, remove old ones.
* Apply correct format.
* Add BF16 to SLT, add comment regarding deprecated class.
* Remove BF16 precision as it is not supported in windows, no default values for attributes.
* Reuse Tensor from base_reference_test.hpp
* minor changes in Op class and add ref impl for acosh
* acosh in new test framework
* add Acosh type test
* add SLT for Acosh
* run more test
* new acosh plugin test
* add visitor test
* fix test utils
* add template test for all supported types in Acosh
* add builder to template tests
* update grn template_plugin test
* update maste to feature branch
* new implementation of FakeQuantize
* move FakeQuantize backend test to fake_quantize.in.cpp
* enable some test for FakeQuantize
* Add support for PDPD broadcasting and some backend tests
* arm plugin expect less attributes in function call
* try to fix arm plugin build
* try to build arm plugin
* start changing backend test
* add check for attributes number in visitor test
* fix backend test after refactoring
* add default parameter value to runtime::reference::fake_quantize
* Revert "add default parameter value to runtime::reference::fake_quantize"
This reverts commit 9d2c00d967.
* add SLT for FakeQuantize
* remove fesetround
* change `v1` namesapce to `v0` in ref impl
* add FakeQuantize-1 to VERIFIED_OP_REFERENCES
* pass immutable reference to test functions
* Move type prop tests to separate file, add cases with exceptions thrown
* Add visitor test, add step to pbc attributes
* SLT for CPU, adjust GPU and SSLT to serve the step attr
* Add backend test
* Fix variance issue, verify by SLT
* Formatting fix
* Add another backend testcase
* Add PriorBoxClustered to trusted ops list
* Add step attr description, remove obsolete comments from ref impl
* Test multiple step values in SLT
* DRAFT: hot-swap async request (when VPU or other acceleratore finally loaded)
* DRAFT2: communicating the hot-swap back to the AutoExecNetwork, added logic for blobs (and keeping them internally to the AutoRequest), added lot's of comments for fixme (items to close the semantics and behaviour)
* Rebase/refactor code and fix tests issue
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Fix logic for AutoExecutableNetwork
1. force loadNetwork in parallel by std::launch::async
2. address some fixme in auto_exec_network.cpp
3. capture by reference
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Fix core dump
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Lambda explicit capture by value
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Add debug log to detect destory order of plugin and core
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Use sync to load cpu and gpu to check ci
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Revert "Use sync to load cpu and gpu to check ci"
This reverts commit 66e09ccd47321e26f68392976d59b1e69cd3df1a.
* Copy network in lambda
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Try to fix CanCreateInferRequest test in Centos
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Remove print log
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Fix CI issues in AUTO because GPU execNetwork doesn't support SetConfig
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Address reviewer's comment: handle load network failure
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* weak_ptr rather than plain ICore* to make sure we hold the Core (whihc holds the plugins in turn) from the destruction in case we need that
* Replace ie::ICore* to shared_ptr<ie::ICore>
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
Co-authored-by: myshevts <maxim.y.shevtsov@intel.com>
* Add output_padding and output_shape into GroupConvolutionBackprop SLTs.
* Add legacy API for arm-plugin dependency.
* Replaced templated input, output and filter with one template.
* Apply correct format.
* Change to use INSTANTIATE_TEST_SUITE_P macro.
* [IE CLDNN] Build ICD loader from sources
* [IE CLDNN] Switched ocl submodules to latest tag instead of master
* [IE CLDNN] Added several cmake variables to enable find_package for OpenCL
* Create output shape for Convoution Backprop SLTs.
* Add output_padding attribute to SLT scope.
* Introduce SLT for Serializaton.
* Introduce new test layer class ConvolutionBackpropLayerTest which contains output_padding attribute and output_shape input. Old one is deprecated, but cannot be removed due to kmb plugin dependency.
* Add ConvolutionBackpropDataLayerTest into TEST_P.
* ConvolutionBackpropDataLayerTest left as legacy class used by kmb_plugin.
* Remove redundant variables.
* Switch to new API for gpu SLTs.
* Remove legacy API.
* Introduce legacy API to match dependency for KMB and ARM plugins.
* Create test cases for output_padding attribute.
* Fixing smoke_Deconv tests.
* AUTO plugin will ignore other plugins' configuration
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Update tests
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Support PER_COUNT config which is needed in benchmark_app
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Address reviewer comments: check config and throw exception for unsupported, but that begin with "AUTO_" will be ignored
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Fix CI tests issue
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Corrected tests to match CVS-53713
* Fixed tests configs
* Skip tests on GPU
* Commented condition inside main SetBlob because of MYRIAD
* Adopted tests
* batch support for interpolate
* hash update
* compilation errors solved
* changes in tests, so not to break other plugins
* changes in tests, so not to break other plugins
* Revert "changes in tests, so not to break other plugins"
This reverts commit 67e5c1e4ddba4f0cc858eb1293e50ce9d9ae0227.
* Revert "changes in tests, so not to break other plugins"
This reverts commit f6a537d2236f0b64f0ff028627af9e0e388a2d23.
* review corrections
* Firmware update
* Update SelectDevice policy in auto plugin
Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>
* Implement limit device list for AUTO plugin
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Add tests for AUTO limit device feature
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Add gpu tests for auto-plugin
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Fix CI cpuFuncTests issue due to BATCHED_BLOB
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Override LoadNetwork(modelPath, config) in AUTO plugin
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Update SelectDevice() logic for LoadNetwork(model, config)
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Update GetNetworkPrecision logic for auto-plugin
Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>
* Address reviewers' comments
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Add tests for AUTO:GPU,CPU case
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Update logic in GetNetworkPrecision for auto-plugin
Signed-off-by: Zhengtian Xie <zhengtian.xie@intel.com>
* Address reviewer's comment: clean and simplify code
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Fix wrong usage of convolution weight index
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Address reviewer comment: fix get network precision logic
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Fix rebase issue
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
* Fix ie_core.cpp header change
Signed-off-by: Shoujiang Ma <shoujiang.ma@intel.com>
Co-authored-by: zhengtian.xie <zhengtian.xie@intel.com>
* [IE TESTS] Fix comparation in LayerTestUtils
* Fixes
* Small fix
* Int4 fixes
* remove extra
* Fix NMS
* Some fixes for tests
* Add small fix
* [IE TESTS] Remove const folding as a result engine
* Remove extra
* Revert remove constant folding (DSR test) & fix some cases for cpu
* Fix GNA
Edward Shogulin