Commit Graph

18 Commits

Author SHA1 Message Date
Irina Efode a7a9364b41
[IE TESTS] Add local_cache arg to the subgraphDumper (#6063) 2021-06-08 14:23:45 +03:00
Irina Efode bcdd915c9f
[IE TESTS] Add Conformance mode (test counters alignment between plugins) in (#5564) 2021-06-02 12:17:07 +03:00
Irina Efode 5e92154422
[IE TESTS] Enable DLB suite (#5717)
* [IE TESTS] Enable DLB suite

* test

* test

* Skip config
2021-05-28 18:09:12 +03:00
Mikhail Treskin 71b87255ab
Skip Assign and ReadValue from extractor. (#5663) 2021-05-17 22:47:29 +03:00
Mikhail Treskin c1a38109c7
[SubgraphsDumper] Extract statistics instead of constants with weights. (#5149)
* Store weights range in meta info instead of cloning whole constant

* Add command line option for constants size serialization threshold

* Update IR Runner to handle OP meta information

* Fix interpolate type_prop tests

* Skip new failures in SLT

* Fix models count

* Add dynamism elimination option.

* TopK shape propagation changed

* Fix type_prop tests for TopK
2021-05-17 12:13:02 +03:00
Irina Efode 7fa93b226e
[IE TESTS] Skip all tests in conformance suite for myriad plugin (#5560) 2021-05-12 15:01:02 +03:00
Ilya Lavrenov e8a2ca6fb6
Added precompiled headers to inference_engine_obj (#5490) 2021-05-04 12:27:48 +03:00
Irina Efode 60ac91b446
[IE TESTS] Allow to specify skip tests config by list file (#5388)
* [IE TESTS] Allow to specify skip tests config by list file

* Fix func name

* Fix includes

* TEmplate
2021-04-28 11:02:26 +03:00
Irina Efode d2868c9873
[IE TESTS] Update conformance Readme file (#5374)
* [IE TESTS] Update conformance Readme file

* [IE TESTS] Update conformance Readme file
2021-04-26 11:17:31 +03:00
Irina Efode e4d4eda31b
[IE CONFORMANCE] Skipping tests on device (#5329)
* Init

* test

* f

* ddd

* Extend
2021-04-22 16:53:53 +03:00
Irina Efode f2f0fb36da
[IE TESTS] Enable validation of template plugin in Conformance suite (#5345)
* Init

* Remove device dependency
2021-04-22 16:19:16 +03:00
Irina Efode 7963dc93ed
[IE TESTS] Small refactoring of conformance suite (#5123)
* TEST

* test

* tmp

* c

* Workaround fro unsaved report

* d

* e

* tmp

* test

* Timeout + fix for summarize

* Fixes

* Remove debug coe
2021-04-20 14:43:33 +03:00
Mikhail Treskin 89b876b592
Add constant subgrpahs handling in extractor (#5079)
* Initial summary dumper implementation

* Handle Tensoriterator body + add parser script

* Bump tox from 3.20.1 to 3.21.2 in /ngraph/python (#32)

Bumps [tox](https://github.com/tox-dev/tox) from 3.20.1 to 3.21.2.
- [Release notes](https://github.com/tox-dev/tox/releases)
- [Changelog](https://github.com/tox-dev/tox/blob/master/docs/changelog.rst)
- [Commits](https://github.com/tox-dev/tox/compare/3.20.1...3.21.2)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

* Remove extra main files

* Fix constant subgraphs on operation ports handling

* Rollback accident change of GPU device name in test_constants.hpp

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-04-02 12:58:45 +03:00
Mikhail Treskin 4e699840fd
Separate SLT Summary and Environment from bcase class implementation (#4966) 2021-03-26 14:27:27 +03:00
Irina Efode fa37277e3e
[IE TESTS] Allow to save Conformance report with unique names (#4844)
* [IE TESTS] Lock report file (between processes and threads)

* Fix condition

* t

* Fix CI

* Fix ci

* win

* Fix win

* Fix reading logic

* Fix rights

* d

* Fixes

* d

* ddd

* s

* dd

* Allow to write reports by unique name

* tp

* fix ci

* remove extra lines
2021-03-25 15:29:20 +03:00
Alexey Suhov a748c26fee
Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
Irina Efode 8e080d4504
[IE TESTS][Conformance] Add conformance tests runner (#3694)
* [IE TESTS][Conformance] Add conformance test target

* Handle creashes. Added crashed tests to the report

* Fix report and flags

* Apply comments

* Apply comment

* Remove flag, fix

* copyrights

* Generate in

* Remove extra code

* fix mac

* CI fixes

* fix win

* Fixes

* Input fixes

* fix flag

* Add generate in

* Fix compare

* Fixes CI
2021-03-15 12:20:53 +03:00
Irina Efode 11f591c168
Unique Subgraphs\Operations extractor (#3742)
* Initial Subgraphs Dumper and IR runner test inplementation

* Implement matchers configuration

* Refactor MatcherConfig

* Add OP cloners factory

* Remove IR runner test (to be added in separate PR)

* Use different nodes comparison method

* Remove extra include of <any> which fails build with old glibc

* Add README.md

Co-authored-by: Mikhail Treskin <mikhail.treskin@intel.com>
2021-03-12 17:22:38 +03:00