History

Ilya Lavrenov 07f94ea602 Minimized usage of `IE_MAIN_SOURCE_DIR` (#6422 ) * Minimized IE_MAIN_SOURCE_DIR hardcode * Used COMPILE_OPTIONS instead of COMPILE_FLAGS * Fixed compilation * Enabled NGRAPH_DYNAMIC_COMPONENTS_ENABLE by default * Fixes * Moved GNA related file * Fixed backend compilation * Fixed Windows for ngraph * Fixed <root>/tests build * More updates * Fixed scripts install * Fixed Windows * Fixed Windows		2021-06-30 18:15:41 +03:00
..
include/timetests_helper	Align copyright notice in cpp and cmake source files (CVS-51320) (#4950 )	2021-03-25 02:40:09 +03:00
scripts	Add float instance to time_tests parse_stats (#5726 )	2021-05-21 11:12:05 +03:00
src	Moved gflags, preprocessing dependencies to root (#6309 )	2021-06-23 09:53:18 +03:00
test_runner	Change target branch field (fix null) (#6433 )	2021-06-30 12:53:17 +03:00
CMakeLists.txt	Minimized usage of `IE_MAIN_SOURCE_DIR` (#6422 )	2021-06-30 18:15:41 +03:00
README.md	Make stress and time tests build dependent from gflags from samples (#5883 )	2021-06-04 10:27:23 +03:00

README.md

Time Tests

This test suite contains pipelines, which are executables. The pipelines measure the time of their execution, both total and partial. A Python runner calls the pipelines and calcuates the average execution time.

Prerequisites

To build the time tests, you need to have OpenVINO™ installed or build from source.

Measure Time

To build and run the tests, open a terminal, set OpenVINO™ environment and run the commands below:

Build tests:

mkdir build && cd build
cmake .. && make time_tests

If you don't have OpenVINO™ installed you need to have the build folder, which is created when you configure and build OpenVINO™ from sources:

cmake .. -DInferenceEngine_DIR=$(realpath ../../../build) && make time_tests

For old versions of OpenVINO™ from sources use -DInferenceEngineDeveloperPackage_DIR:

cmake .. -DInferenceEngineDeveloperPackage_DIR=$(realpath ../../../build) && make time_tests

Run test:

./scripts/run_timetest.py ../../bin/intel64/Release/timetest_infer -m model.xml -d CPU

Run several configurations using pytest:

pytest ./test_runner/test_timetest.py --exe ../../bin/intel64/Release/timetest_infer

# For parse_stat testing:
pytest ./scripts/run_timetest.py