openvino/tests/time_tests
Victor Kuznetsov 089f76cc7f
Add `branch` field to submit to DB in MemCheck/TimeTests (#6073)
2021-06-11 12:57:01 +03:00
..
include/timetests_helper Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
scripts Add float instance to time_tests parse_stats (#5726) 2021-05-21 11:12:05 +03:00
src Make stress and time tests build dependent from gflags from samples (#5883) 2021-06-04 10:27:23 +03:00
test_runner Add `branch` field to submit to DB in MemCheck/TimeTests (#6073) 2021-06-11 12:57:01 +03:00
CMakeLists.txt Make stress and time tests build dependent from gflags from samples (#5883) 2021-06-04 10:27:23 +03:00
README.md Make stress and time tests build dependent from gflags from samples (#5883) 2021-06-04 10:27:23 +03:00

README.md

Time Tests

This test suite contains pipelines, which are executables. The pipelines measure the time of their execution, both total and partial. A Python runner calls the pipelines and calcuates the average execution time.

Prerequisites

To build the time tests, you need to have OpenVINO™ installed or build from source.

Measure Time

To build and run the tests, open a terminal, set OpenVINO™ environment and run the commands below:

  1. Build tests:
mkdir build && cd build
cmake .. && make time_tests

If you don't have OpenVINO™ installed you need to have the build folder, which is created when you configure and build OpenVINO™ from sources:

cmake .. -DInferenceEngine_DIR=$(realpath ../../../build) && make time_tests

For old versions of OpenVINO™ from sources use -DInferenceEngineDeveloperPackage_DIR:

cmake .. -DInferenceEngineDeveloperPackage_DIR=$(realpath ../../../build) && make time_tests
  1. Run test:
./scripts/run_timetest.py ../../bin/intel64/Release/timetest_infer -m model.xml -d CPU
  1. Run several configurations using pytest:
pytest ./test_runner/test_timetest.py --exe ../../bin/intel64/Release/timetest_infer

# For parse_stat testing:
pytest ./scripts/run_timetest.py