Commit Graph

7 Commits

Author SHA1 Message Date
Evgeny Kotov 07fd0f97df
read_model vs ovc.convert performance tests fix OVVP output data (#23724)
### Details:
 - send tests start datetime in version field

### Tickets:
 - 137070
2024-04-23 12:56:41 +00:00
Evgeny Kotov ab64489d9b
Implement performance tests in nightly validation to compare read_model and ovc.convert with OVVP output (#23303)
### Details:
 - add nightly performance tests with skip list
 - [restored PR](https://github.com/openvinotoolkit/openvino/pull/21353)
- [restored PR
#2](https://github.com/openvinotoolkit/openvino/pull/22325)
 - added OVVP support
 - extend skip list with the models that have unstable results

### Tickets:
 - 126282
2024-03-27 06:02:01 +00:00
Jacek Pawlak 239466ca5d
copyright year update (#23370)
New PR due to merge
conflicts(https://github.com/openvinotoolkit/openvino/pull/22917)

Updated the copyright year from 2018-2023 to 2018-2024 in all openvino
files

Ref. to script: CVS-101144

Command used:
```bash
git grep -lz '2018-2023 Intel Corporation' | xargs -0 sed -i '' -e 's/2018-2023 Intel Corporation/2018-2024 Intel Corporation/g'
```
2024-03-14 09:37:02 +00:00
Evgeny Kotov 90087dbb48
Use time limits instead of number iterations limits in GHA performance tests (#21407)
* use perf_counter_ns to measure performance; meausure within time not count

* fixes

* remove nightly

* set 60 secs by default

* fix output html

* code review fixes

* fix runtime duration

* remove unneeded inference

* cleanup
2023-12-07 11:53:27 +04:00
Roman Kazantsev c1cfb00f81
[TF Hub] Fix typo in test file name (#21408)
Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-30 23:49:01 +00:00
Roman Kazantsev 7c590bf180
[Hub Tests] Apply Python code formatting (#21286)
* Apply Python code formatting

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

* Apply Python code formatting

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>

---------

Signed-off-by: Kazantsev, Roman <roman.kazantsev@intel.com>
2023-11-28 16:54:02 +04:00
Evgeny Kotov 965313ba0b
[TF Hub][Perf Tests]Implement performance tests in precommit to compare read_model and convert_model paths (#21023)
* begin

* fixes

* measure time and compare

* fix bug + update precommint models

* cleanup

* add wget to install requirements; add to linux.yml

* fixes + improvements

* output results to html

* remove unneeded code

* fix

* code review fixes

* store downloaded models in cache

* use 1000 runs

* use model paths from tf-hub tests

* use tf hub api to download instead of wget; measure some time stats

* small fixes

* remove unneeded files

* use own list of models

* remove uneeded if

* remove unstable models

* remove unstable models

* fix requirements

* code review fixes

* Update .github/workflows/linux.yml

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* fix round_num function

* remove unstable network

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* code review fixes

* build fix

* code review fixes

* code review fixes

* code review fixes

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/performance_tests/test_tf_hub_perfomance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* Update tests/model_hub_tests/models_hub_common/test_performance_model.py

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>

* code review fixes: use autoflake

* remove unneeded tensorflow_text

* Update .github/workflows/linux.yml

* Update linux.yml

Added TensorFlow_Hub_Performance_Models_Tests to final status check

---------

Co-authored-by: Roman Kazantsev <roman.kazantsev@intel.com>
Co-authored-by: Ilya Lavrenov <ilya.lavrenov@intel.com>
2023-11-24 18:13:44 +04:00