e1bffcc36c
Add json validate ( #6449 )
...
* Add json validate
* Fix json schema
* Fix schema loader
* Add unit test
* Update bom file
* Update all requarments
* Update dev requarments
* Update requrments
* Update path to schema
* Update schema
* Add some unit tests
* Move schema to root dir
* Update schema path in bom file
* Fix unit test
* Fix bom
* Change path to schema
* update setup
* Fix setup
* Fix mo args test
* Refactoring some code
* Refactoring according to review
* Update sort imports
* Remove id attribute from schema
* Refactoring validator
* Fix according to review
* Move schema from json to dict. Update unit tests.
* Fix BOM file
* Update bom file
2021-07-22 21:12:44 +03:00
4efe708023
Make DB query for MemCheckTests optional in precommit ( #6526 )
...
* add try/catch
* add error msg
2021-07-07 14:38:49 +03:00
a1eb5b1fd5
Change target branch field (fix null) ( #6433 )
2021-06-30 12:53:17 +03:00
ad997410c8
Port to master ( #6279 )
...
* add single_layer_test for Interpolate-1 (#6133 )
* Fixed InferenceEngineConfig.cmake usage in include() (#6136 )
* Deprecated API updates (#6252 )
* Fixed links to OMZ / DL Streamer (#6257 )
* Added doxygen deprecation for LowLatency
Co-authored-by: Elena Gvozdeva <elena.gvozdeva@intel.com>
2021-06-22 17:43:17 +03:00
089f76cc7f
Add `branch` field to submit to DB in MemCheck/TimeTests ( #6073 )
2021-06-11 12:57:01 +03:00
5834eef8f0
Change model_path to model_name in timeline report ( #5457 )
2021-05-06 11:54:16 +03:00
e121fbd7de
Add int8 models to memcheck tests ( #5333 )
2021-04-23 12:56:59 +03:00
ed0b66f31d
Fix timeline report for MemCheck by querying target instead of current branch ( #5350 )
2021-04-22 15:51:35 +03:00
6478f1742a
Align copyright notice in python scripts (CVS-51320) ( #4974 )
...
* Align copyright notice in python scripts (CVS-51320)
2021-03-26 17:54:28 +03:00
3a703d546c
[Stress] MemCheck add FP16 models to configs ( #4503 )
2021-03-12 01:14:40 +03:00
7ba9723242
[Stress] Add precision field to MemCheck configs ( #4362 )
2021-02-24 14:56:09 +03:00
08f54dbac8
Fix `metadata_from_manifest()` according to new manifest version ( #3771 )
2020-12-31 09:57:58 +03:00
9f427bbf6e
Add WA for OMZ Keras models in stress tests ( #3272 )
2020-11-23 17:32:35 +03:00
0ef1fb8a09
Update MemCheckTests OMZ part: get_testdata.py and configs ( #2722 )
2020-10-30 00:37:02 +03:00
b8a8fe7c0d
Sort memcheck timeline report for failures ( #2088 )
2020-09-09 10:10:22 +03:00
2386c5d376
[Stress] Define `--timeout` in run_memcheck.py used in gtest-parallel ( #1576 )
2020-08-05 12:33:01 +03:00
25cadb661b
[Stress] Enable OMZ info_dumper.py in get_testdata.py ( #1485 )
...
* [Stress] Support OMZ model_info.py in get_testdata.py
* [Stress] Copy IRs from OMZ models folder to IRs folder
* [Stress] Support modified configs in C++ tests
* [Stress] Deprecate support of --env_conf due refactoring of configs
* [Stress] Update configs:
1. Removed env configs due deprecation
2. Moved test configs to a new format
* [Stress] Extend MemCheck records with info from test config
2020-07-31 12:13:12 +03:00
9299e32df0
Add product version to memcheck records ( #1508 )
2020-07-30 10:17:56 +03:00
6fcad95c71
[Stress] Redesign of MemCheckTests ( #650 )
...
* [Stress] Redesigned MemCheckTests: 1. Added MemCheckPipeline to incapsulate measures and logging. 2. Moved references to array
* [Stress] Added tracking of THREADS in MemCheckTests
2020-07-23 11:07:13 +03:00
5665ec9b26
[Stress] Small improvement of scripts ( #1302 )
...
* [Stress] Extend CLI with arguments checks for compare_memcheck_2_runs.py
* [Stress] Extend requirements.txt with PyYAML
2020-07-22 10:24:15 +03:00
57779511d6
[Stress] Integrate compare_memcheck_2_runs call in run_memcheck.py ( #1036 )
...
* [Stress] Define Database constant arguments in memcheck_upload.py only
* [Stress] Simplify computations using HashableDict in `compare_memcheck_2_runs`
* [Stress] Add comparison using pandas
2020-07-20 10:23:51 +03:00
930d687ed9
[Stress] Specify OMZ `develop` branch in get_testdata.py ( #1318 )
...
Since in validation OMZ is used from a package (and OMZ is from develop branch), align OMZ default for get_testdata.py
2020-07-16 15:28:25 +03:00
c0b28daf9c
Fix MemCheckTests failures caused by change in OMZ models scope ( #1214 )
...
Run only models available in OMZ to prevent failures
Remove person-reidentification-retail-0031.xml from configs
2020-07-08 12:33:39 +03:00
0e904405f7
[Stress] Add --ref_db_collection in compare_memcheck_2_runs.py ( #1157 )
2020-07-02 13:14:07 +03:00
52a42624e9
Add memcheck runner script ( #1031 )
...
Script executes measurement isolated with gtest-parallel,
handles database uploading and reports generation.
2020-06-22 16:23:09 +03:00
3417004e6d
Add memcheck comparison script ( #935 )
...
Add compare_memcheck_2_runs.py compares two runs.
Add handling of broken files for `parse_memcheck_log`
2020-06-19 15:56:32 +03:00
626bc4f3d4
Add commit links to memcheck report ( #820 )
2020-06-08 15:08:58 +03:00
72d9a9fae7
Use pre-defined DB collection names in memcheck_upload.py CLI ( #651 )
...
Use argparses `choices` for `--db_collection` option.
Also removed unnecessary redefinition of `db_collection` in memcheck_upload.py
2020-06-03 13:54:38 +03:00
1d179fdb39
Add parallel downloads to stress tests ( #678 )
2020-06-02 17:24:22 +03:00
deb008a26f
publish master branch snapshot, revision 8d31237e2c3f673cbb0f0ba110fc10f5cce1d2bb
2020-05-22 02:23:12 +03:00
ba0a339888
publish master branch snapshot, revision 59af1853ca21ea08acf17b177da0b239753deb46
2020-05-18 17:21:58 +03:00
645641e87d
add execute permissions to get_testdata.py
2020-05-14 23:17:54 +03:00
5b428f0655
publish master branch snapshot, revision 49482ae3bea0cbaa07474f86f36db11943142687
2020-05-13 21:12:22 +03:00
357cc7eb4c
publish master branch snapshot, revision 0110d9c98fd7209589d06344f0d836f61d81f4b3
2020-04-27 21:21:29 +03:00
127cbac5bc
publish master branch snapshot, revision cdcab9d7ab48ffb0ee5629fabbfa06cb45debd9b
2020-04-15 19:01:57 +03:00
iliya mironov