Commit Graph

44 Commits

Author SHA1 Message Date
Anton Pankratov 5c9b6915dc
Added undefined perfomnance hint value (#10082)
* Added undefined perfomnance hint value

* Added tests

* Fixed tests

* fixed dormat
2022-02-03 18:03:45 +03:00
Wilson Seok 3d9da2901e
Template slt bug fix/mish partial dynamic (#9976)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* fix demension dynamic support bug in mish op reference test
2022-02-03 11:32:39 +03:00
Ilya Lavrenov 4717e7639c
Param/Const => Result tests (#9294)
* Tests for param => result

* Added const => result, param => result tests

* Disabled tests on CPU

* Added more tests

* Enabled import / export for template

* clang-format

* Reverted scatter tests

* Rename back

* Fixed typo

* Fixed compilation for GNA

* Fixed comments

* Fixed collisions

* Revert renaming back

* Added skip filters for GNA / MYRIAD
2022-02-01 11:01:12 +03:00
Steve Yoo e8b954d6ec
Add testcases of index type i32 for NonMaxSuppression (#9902) 2022-01-28 07:53:01 +03:00
Alexey Suhov a79830cb55
Update year to 2022 in copyright notice (#9755) 2022-01-19 01:07:49 +03:00
Luo Cheng 68d8ca8060
MulticlassNms/MatrixNms: ngraph op support FP16 output (#9481)
* recover overwritten code in #8520

* support fp16

* update spec

* apply review comments

* support dynamic type check
2022-01-14 07:54:32 +03:00
Steve Yoo a23a398dc0
Add SLT to Template Plugin: NonMaxSuppression-4,3,1 (#9511)
* Add SLT to Template Plugin: NonMaxSuppression-4

* Add SLT to Template Plugin: NonMaxSuppression-4,3,1
2022-01-13 12:42:56 +03:00
Vitaliy Urusovskij 60e71e531b
Extend Tile test with different ops types (#8804) 2021-12-13 12:53:08 +03:00
Wilson Seok 9faf661250
Add slt in template plugin/experimental detectron grid generator (#8923)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of ExperimentalDetectronPriorGridGenerator

* implement actual_comparision_size for compare

* update slt for actual comparison size and add visitor api test

* fixed clang error
2021-12-08 19:07:40 +03:00
Steve Yoo 42f5034892
Migrate Sort (MatrixNms-8, MulticlassNms-8, NonMaxSuppression-5) (#8394)
* Migrate Sort (MatrixNms-8, MulticlassNms-8, NonMaxSuppression-5)

* Add right multiclass_nms.cpp

* Add struct Attributes to matrix_nms

* Add constructors to opset8::MatrixNms::Attributes

* Fix code format of opset8::MatrixNms::Attributes::Attributes
2021-11-26 22:35:43 +03:00
Steve Yoo 808323afa8
Migrate Movement 1 (Broadcast-1, Concat-1, Tile-1) (#8388)
* Migrate Movement 1 (Broadcast-1, Concat-1, Tile-1)

* Add Broadcast-3

* Update to namespace opset

* Add broadcast_test_helper
2021-11-24 05:20:41 +03:00
Steve Yoo d248bdc91a
Migrate Sort (TopK-1) (#8423)
* Migrate Sort (TopK-1)

* Add topk_mode_sort_order

* Skip topk_min_sort_none in Windows

* Add types to tests

* Skip topk_max_sort_none and topk_min_sort_none

* Modify names from 1d to 1dMaxMin and SetUp1 to SetUpSecond

* Add outIdx to run tests one by one

* Set default value 0 to outIdx

* Remove copy_data
2021-11-23 10:29:55 +03:00
Evgeny Talanin 2777820882
Skip Exp test (#8692)
* Skip Exp test

* Fix regexp

* One more attempt...

* Update exp.cpp
2021-11-19 11:08:39 +03:00
Irina Efode 3efd842dd9
[IE TESTS] Skip sporadic failures for ref test (#8685) 2021-11-18 18:52:46 +03:00
Steve Yoo 90094e8a8a
Migrate Sequence (CTCGreedyDecoder-1, CTCGreedyDecoderSeqLen-6, GRUCell-3, LSTMCell-4, OneHot-1, RNNCell-1) and Sort (ExperimentalDetectronTopKROIs-6) (#8314) 2021-11-16 08:46:21 +03:00
Steve Yoo f66d9216ef
Migrate Movement 2 (BatchToSpace-2, DepthToSpace-1, Roll-7, ShuffleCha… (#8158)
* Migrate Movement2 (BatchToSpace-2, DepthToSpace-1, Roll-7, ShuffleChannels-1, SpaceToBatch-2, SpaceToDepth-1)

* Fix typos while copying

* Update to opset namespace and add i4, u4, bf16 tests when available

* Remove i4, u4 tests from BatchToSpace and Roll
2021-11-16 03:32:29 +03:00
Alexandra Sidorova 5352c2b370
commented test (#8596) 2021-11-15 17:01:02 +03:00
Steve Yoo b320061ea3
Migrate Movement 1 (Gather-1, Gather-7, Pad-1) (#8414) 2021-11-15 04:31:59 +03:00
Steve Yoo 7a7ea100ec
Migrate Movement 1 Operations (StridedSlice-1) (#8221)
* Migrate StridedSlice-1

* Update generate function to literals for bf16 and f16

* Add shapes to tensors
2021-11-12 12:19:19 +03:00
Steve Yoo e3f1813e5c
Migrate Movement 2 (GatherElements-6, GatherND-5) (#8282) 2021-11-03 08:02:19 +03:00
Wilson Seok 75c6af7af5
Migrate ngraph backend test/experimental detectron detection & experimental detectron generate proposals (#8264)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of experimental_detectron_detection_output and experimental_detecteion_generate_proposals and remove ngraph backend test

* modify visitor api test of experimental_detectron_detection for clang-format

* modify visitor api test of experimental_detectron_detection for clang-format again

* modify visitor api test of experimental_detectron_detection for clang-format again2
2021-11-02 10:48:15 +03:00
Wilson Seok f912a8102d
Migrate ngraph backend test/psroi pooling/deformable psroi pooling/proposal (#8152)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add op reference test of psroi_pooling and deformable_psrio_pooling

* update op reference test

* remove ngraph backend test

* add op reference test of proposalV1 and proposalV4

* update skip_test_config.cpp to avoid failure of accuracy drop in fp16/bf16 test case of proposal
2021-11-01 04:47:42 +03:00
Wilson Seok 132ae33de0
Migrate ngraph backend test/deformable convolution (#8045)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* add initial version of op reference test of deformable convolution

* update reference test

* update reference test 2

* update deformable_convolution referencet est

* add deformable_convolution_opset8 op reference test

* update skip_test_config.cpp

* remove backend test and add visitor api test

* merge test code of deformable_convolution v1 and v8 in a single file

* merge deformable_convolition_opset8 of visitor api test into single file
2021-10-20 11:19:19 +03:00
Irina Efode 3f690314fa
[IE TESTS] Behavior2.0 -> Plugin (#7579)
* Need to remove

* Preprocessing + InferRequest

* infer_request_callback

* tmp commit

* InferRequest

* tst

* tetet

* Fix template

* SetBlobType

* InferRequest Conformance

* Add prc

* Remove prc

* Fix paths

* commit

* Fixes for review

* Dynamic Batch

* fix

* fiz

* Try

* fkf

* Fix azure

* Centos

* skip

* conformance fix

* fix template

* Small fix

* small fix in print

* Fixes

* Behavior 2.0 -> ExecutableNetwork

* Export

* Skip configs

* Incorrect config

* Extend ExecNet

* add_out

* GnA+CPU

* fix template

* fix centos

* Init

* init

* Fix merge

* Separate OV_CORE_INTEGRATION

* vers

* plugin

* Remove test_plugin

* plugin

* test

* configuration

* config

* core_integration

* Small refactor

* Clean up exec net

* Config

* Clean&Up behavior tests

* Remove extra

* query network

* Version

* Add new tests

* merge

* fix win

* Fix some ci problems

* Refactor

* gpu

* myriad

* template

* gna

* Fix all plugin

* ov2.0 exec_nry

* openvino2.0

* build

* fix ci

* fix ci

* fix myriad

* Try to fix ci

* Try

* try

* Update windows.yml

* Update windows.yml

* Revert "Update windows.yml"

This reverts commit 93e326229c.

* ddd

* Update windows.yml

* Revert "Update windows.yml"

This reverts commit 5eb4bf875a.

* Revert "Update windows.yml"

This reverts commit 351ede4e1e.

* fix inference chaining

* Fix issues

* try to remove mkldnn from commit

* GPU

* Fix ov namespace

* fix ci

* try to fix kmb

* Try to fix

* Merge

* fix ci

* gna

* fix myriad

* merge

* Myriad

* myriad

Co-authored-by: Alexander Zhogov <alexander.zhogov@intel.com>
2021-10-15 11:47:50 +03:00
Wilson Seok a8f0109584
Migrate ngraph backend test/activations (#7973)
* Remove fp16 of Convert layer test from skip_tests.config.cpp as it works now

* update repo

* create new PR from PR7849

* remove backend tests of activation operations
2021-10-14 09:38:30 +03:00
Ilya Churaev c323775f2c
Add input/output to ov ExecNetwork (#7650)
* Added template for new tests

* Fixed simple test

* Added output tests

* Removed get_result/get_parameter methods

* Fixed documentation

* Fixed functional tests

* Fixed caching tests

* Added new test for import

* Added new tests

* Fixed code style

* Fixed comments

* Fixed tests

* Fixed code style

* Save version in the function
Fixed pre-post processing

* Change IR version

* Fixed documentation

* Fixed MockICore

* HETERO almost works

* Fixed tests and core logic

* Disabled some CPU tests

* Tmp disable fp16 for template

* Fixed tests and clang-format

* Small fixes

* Fix

* Simplified code in templatePlugin

* Added IE precisions checks

* Simplified hetero plugin

* Added ieImportExportedFunction test

* Added MYRIAD test

* Skip tests directly in tests

* More correct filter for CPU

* Fixed CPU tests

* Template plugin tests

* Some comments

* FIxed clanf-format

* Removed myriad tests

* Fixed comment

* small changes

* Fixed condition

* Fixed unit tests

* clang-format

* Comment

* Hetero plugin update

* Fixed tests

* Moved re-create under ig

* Fixed clang-format

* Fixed some caching_tests

* Disable some caching_tests

* Fixed setLayout with dynamic case

* Fixed clang-format

* Disable execution graph

* Disabled one more CPU test

* Simplified regex

* Disabled GNA tests

Co-authored-by: y <ilya.lavrenov@intel.com>
2021-10-12 13:11:25 +03:00
Ilya Lavrenov 0bebd53b4a
Inference chaining: static and dynamic cases (#7776)
* Fixed precisions conversion in new API

* Added tests

* Fixed old IR cases

* Disable FP16

* Fixed regex for CentoOS

* Refactored tests to use new API

* Temp

* Fixed tests

* Moved smart reshape related sources to ngraph

* Added tests for invalid names

* Moved reshape to tensor_names

* clang-format

* Fixed CC build

* Removed IEConv, IEDeconv from primitives pririty

* Added tests for Inference chaining

* Fixed dynamic chaining for template plugin

* Added test for 2 conflicting names for the single parameter

* Removed invalid test

* Added more tests for dynamism

* Fixed clang-format

* Fixed macosx compilation

* Some simplifications
2021-10-04 14:51:14 +03:00
Mikhail Nosov f8ed195841
Fix 'NV12 batch case' (was sporadic failure) (#7790)
Introduced 'absolute threshold' for LayerTests and BaseReferenceTests to consistently catch absolute differences
Previously, when set 'threshold=1.f' it was treated as 'allowed difference is 100%", so there was no way to allow absolute difference as 1.f
2021-10-01 20:21:52 +03:00
Mikhail Nosov a883b5c097
Temporary disable sporadically failed test (PR #7601) (#7782)
* Temporary disable sporadically failed test

* Looks like skip test config didn't skip the test
2021-10-01 10:25:08 +03:00
Ilya Lavrenov d074eea063
Fixed regex for template tests skip (#7725) 2021-09-29 01:58:02 +03:00
Maxim Shevtsov 920e58caba
disabling tests for template plugin that fails due to missing impl (CVS-66280) (#7651) 2021-09-24 16:23:13 +03:00
Irina Efode 841c3531fb
[IE TESTS] Behavior2.0 -> InferRequest() (#6559)
* Need to remove

* Preprocessing + InferRequest

* infer_request_callback

* tmp commit

* InferRequest

* tst

* tetet

* Fix template

* SetBlobType

* InferRequest Conformance

* Add prc

* Remove prc

* Fix paths

* commit

* Fixes for review

* Dynamic Batch

* fix

* fiz

* Try

* fkf

* Fix azure

* Centos

* skip

* conformance fix

* fix template

* Small fix

* small fix in print

* Fixes
2021-08-25 14:43:19 +03:00
Gladilov, Gleb 63211d548f
Fixes skip tests config after tests renaming (#6231)
Signed-off-by: Gladilov, Gleb <gleb.gladilov@intel.com>
2021-06-18 13:34:30 +03:00
Ilya Lavrenov 26bfa6f0ac
Tests for dynamic preprocessing in SetBlob (#5798)
* Corrected tests to match CVS-53713

* Fixed tests configs

* Skip tests on GPU

* Commented condition inside main SetBlob because of MYRIAD

* Adopted tests
2021-05-26 18:07:08 +03:00
Ilya Churaev cc810297f4
Align style doc with samples (#5709)
* Added clang-format config

* Fixed style

* Fixed code-style for snippets and fixed build

* Disable clang-format for snippets

* Fixed comments
2021-05-25 10:32:48 +03:00
Ilya Lavrenov bc15656a32
Template set precision for output (#5693) 2021-05-19 22:58:03 +03:00
Ilya Lavrenov 8b1b900591
CVS-44774: Fixed preprocessing for template plugin (#4118)
* Fixed preprocessing for template plugin

* Added more tests instances

* Split common transformation to smaller ones which can be used by plugins

* Moved preprocessing transformation to Plugin API

* Added PreprocessConversionTest tests

* Disabled tests on GPU: CVS-51764

* Disabled some tests on VPU and TEMPLATE

* Support for input layout conversions in TEMPLATE plugin

* Improvements in Template Plugin

* Fixed compilation

* Fixes

* Disables some tests

* Fixed compilation on Windows

* Fixed docs
2021-04-30 10:47:29 +03:00
Ilya Lavrenov 8e261de0a8
Added PreprocessConversionTest tests (#4946)
* Added PreprocessConversionTest tests

* Disabled tests on GPU: CVS-51764

* Disabled some tests on VPU and TEMPLATE

* Support for input layout conversions in TEMPLATE plugin
2021-03-25 16:31:33 +03:00
Alexey Suhov a748c26fee
Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Ilya Lavrenov 8685c20baf
Fixed HETERO + Template cases (#3580)
* Fixed tests compilation for Android ARM

* Small fixes

* Fixed issues CVS-44775, CVS-34206, CVS-34349

* Disabled KSO tests for Template

* Eliminated invalid subgraphs

* Enabled KSO QueryNetwork tests for Template

* Fixed other plugins as well

* Used NodeTypeInfo instead of std::string

Co-authored-by: apankratovantonp <anton.pankratov@intel.com>
2020-12-16 12:17:29 +03:00
Ilya Lavrenov e4260cdc3f
Template device testing (#3521)
* Added template plugin testing on public CI

* Updated tests config

* Added DEVICE_TEMPLATE constant to tests

* Updated tests

* Disable template plugin by default

* Fixes

* Fixed HETERO tests
2020-12-09 17:13:32 +03:00
Anton Pankratv bfedee88b2
Added split test into template plugin (#1669)
* Added split test into template plugin

* Fixed split test

* Fixed test parameters style
2020-08-15 14:44:13 +03:00
Anton Pankratv 18836f53cd
Implemented inference in template plugin (#1308)
* Implemented inference in template plugin

* Fixed tests

* Removed thirdparty dependency

* Simplified executor configuration

* removed half

* Fixed cmake

* Fixed ngraph node check

* device blob allocation

* Fixed enum error
2020-07-28 17:25:31 +03:00
Alexey Suhov 0064c299c3
add plugin template (#515) 2020-05-22 22:34:00 +03:00