Commit Graph

17 Commits

Author SHA1 Message Date
Vitaliy Urusovskij 31907e51e9
Fixed several issues in time_tests (#6481)
* Fixed return in `run_timetest`

* Fixed `parse_stats()` argument type notation

* Pass message from `timetest` exe to test error msg to be uploaded to DB
2021-07-01 16:37:23 +03:00
Victor Kuznetsov af915859e3
Add float instance to time_tests parse_stats (#5726) 2021-05-21 11:12:05 +03:00
Victor Kuznetsov c907fb9f52
Log have time measures nested (#5402) 2021-05-18 18:00:10 +03:00
Victor Kuznetsov 4790c79eb4
Add time_tests dir path to sys.path (#5498) 2021-05-06 14:57:50 +03:00
Alexander Shchepetov e864972f83
Add experiments timings to data to submit to DB(#5108) 2021-04-12 09:29:10 +03:00
Victor Kuznetsov 69a06f5977
Remove time-tests outliers using Inter Quartile Range (IQR) (#5014)
Change number of times to execute binary to aggregate statistics from 3 to 10.
2021-04-02 11:35:38 +03:00
Alexey Suhov 6478f1742a
Align copyright notice in python scripts (CVS-51320) (#4974)
* Align copyright notice in python scripts (CVS-51320)
2021-03-26 17:54:28 +03:00
Victor Kuznetsov 1da8f65b45
Add removing of statistics file in time_tests (#4275) 2021-02-11 12:02:39 +03:00
Victor Kuznetsov 73f846648c
change tempfile usage (#4245) 2021-02-10 10:23:31 +03:00
Andrey Somsikov 359c2ca018
Upgrade pyyaml to the latest (#4134) 2021-02-03 07:07:01 +03:00
Vitaliy Urusovskij 12b690952c
Time tests improvements (#2642)
* Remove extra functions from run_timetest.py

* Add `log.debug` of raw and aggregated statistics in run_timetest.py

* Implement storing of models locally for test_timetest.py
2020-10-14 20:05:52 +03:00
Vitaliy Urusovskij 474dcc277f
Prepare new test configuration for test_timetest.py (#2561)
* Add logging of DB upload to tconf with refs saving

* Prepare `.automation/tgl_test_config.yml` with models from VPUX package

* Add restriction on `exe` and `model` existence in run_timetest.py
2020-10-08 10:30:43 +03:00
Vitaliy Urusovskij c3ff2948a4
Timetests test_runner improvements (#2552)
* Remove `generate_tmp_path` as unnecessary after refactoring

* Add `check_positive_int` check for `-niter` CLI key

* Replace `TestConfDumper` with number of fixtures:
1. Save all test info in global `request` and `pytestconfig` fixtures
2. Add `test_info` fixture for retrieving test info from test
3. Add `prepare_tconf_with_refs` fixture for test conf dump
2020-10-07 17:15:02 +03:00
Vitaliy Urusovskij 6949d93e42
Add `"cl_cache"` preparation in test_timetest.py (#2490) 2020-10-06 14:16:50 +03:00
Vitaliy Urusovskij 639052d0b8
Support references in test_timetest.py (#2431) 2020-10-01 11:35:57 +03:00
Vitaliy Urusovskij d48d2109dc
Test timetest MVP (#2345) 2020-09-21 21:33:42 +03:00
Vitaliy Urusovskij 20266276ec
New layout for `time_tests` (#2321)
* Change folders' layout for `time_tests`

* Refactoring of namings in `time_tests`
2020-09-18 18:53:49 +03:00