openvino/tests/time_tests
Ilya Sharikov 26c8b29b35
Added missing modules for timetests (#6896)
2021-08-03 12:19:40 +03:00
..
include/timetests_helper Align copyright notice in cpp and cmake source files (CVS-51320) (#4950) 2021-03-25 02:40:09 +03:00
scripts Fixed several issues in time_tests (#6481) 2021-07-01 16:37:23 +03:00
src Common tests library for shared functionality (#6578) 2021-07-23 10:37:35 +03:00
test_runner Added missing modules for timetests (#6896) 2021-08-03 12:19:40 +03:00
CMakeLists.txt Develop installation rules for time and stress tests (#6649) 2021-07-16 16:30:20 +03:00
README.md Make stress and time tests build dependent from gflags from samples (#5883) 2021-06-04 10:27:23 +03:00

README.md

Time Tests

This test suite contains pipelines, which are executables. The pipelines measure the time of their execution, both total and partial. A Python runner calls the pipelines and calcuates the average execution time.

Prerequisites

To build the time tests, you need to have OpenVINO™ installed or build from source.

Measure Time

To build and run the tests, open a terminal, set OpenVINO™ environment and run the commands below:

  1. Build tests:
mkdir build && cd build
cmake .. && make time_tests

If you don't have OpenVINO™ installed you need to have the build folder, which is created when you configure and build OpenVINO™ from sources:

cmake .. -DInferenceEngine_DIR=$(realpath ../../../build) && make time_tests

For old versions of OpenVINO™ from sources use -DInferenceEngineDeveloperPackage_DIR:

cmake .. -DInferenceEngineDeveloperPackage_DIR=$(realpath ../../../build) && make time_tests
  1. Run test:
./scripts/run_timetest.py ../../bin/intel64/Release/timetest_infer -m model.xml -d CPU
  1. Run several configurations using pytest:
pytest ./test_runner/test_timetest.py --exe ../../bin/intel64/Release/timetest_infer

# For parse_stat testing:
pytest ./scripts/run_timetest.py