natas_hw
/
grpc
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
grpc/tools/run_tests
History
Paulo Castello da Costa bb418da2b5
Run example benchmarks v2 test in continuous build. (#25976) 
This commit includes the following changes:

1. A new load test template generator (loadtest_template.py) is added. The template generator combines existing configurations or templates for several languages into a single template that can be used to generate configurations for different languages or combinations of languages.

2. A basic template generated from the example tests in grpc/test-infra (loadtest_template_basic_all_languages.yaml) is added.

3. The load test config generator is updated to use the combined template.

4. An example run consisting of a single test (generated from the combined template) is added and set up to run continuously.
 		2021-04-20 21:50:35 -07:00
..
artifacts also build python3.6 aarch64 manylinux2014 wheel (#25928) 2021-04-09 15:21:54 +02:00
build_stats cleanup tools/run_tests directory 2016-12-22 10:47:52 +01:00
dockerize Use crosscompilation to build python armv7 wheels (#25704) 2021-03-17 18:49:32 +01:00
generated RBAC engine matchers implementation. (#25997) 2021-04-19 13:05:27 -07:00
helper_scripts Upgrade setuptools and ProtoBuf Python in prep_xds.sh (#26029) 2021-04-20 17:47:21 -07:00
interop Upgrade sanity Docker image to debian:stretch 2018-12-10 16:21:49 -08:00
lb_interop_tests Yapf all target python sources 2020-01-03 09:25:10 -08:00
performance Run example benchmarks v2 test in continuous build. (#25976) 2021-04-20 21:50:35 -07:00
python_utils Fix invalid use of python's traceback.print_exc (#25743) 2021-03-17 12:04:15 -07:00
sanity More informative result from check_submodules.sh (#25859) 2021-04-01 12:13:04 -07:00
xds_k8s_test_driver Naming fix (secrets manager -> secret manager) (#25990) 2021-04-16 10:07:46 -07:00
README.md remove leftovers of stress tests 2018-05-21 10:28:12 -07:00
run_grpclb_interop_tests.py Yapf all target python sources 2020-01-03 09:25:10 -08:00
run_interop_tests.py try setting GO111MODULE in interop test runner 2020-11-30 17:20:53 -08:00
run_microbenchmark.py Fix python3 performance tests - incomplete migration from python2 (#25734) 2021-03-16 16:49:30 -07:00
run_performance_tests.py Yapf all target python sources 2020-01-03 09:25:10 -08:00
run_tests.py Revert "Added portability test with openssl 1.0.2 (#25770)" (#25812) 2021-03-25 11:28:10 -07:00
run_tests_matrix.py Revert "Added portability test with openssl 1.0.2 (#25770)" (#25812) 2021-03-25 11:28:10 -07:00
run_xds_tests.py Upgrade setuptools and ProtoBuf Python in prep_xds.sh (#26029) 2021-04-20 17:47:21 -07:00
start_port_server.py Migrate the bm_diff benchmarks to python3 (#25619) 2021-03-09 15:44:00 +01:00
task_runner.py improve python3 compatibility of the task_runner.py script 2020-08-28 10:14:17 -04:00

README.md

Overview

This directory contains scripts that facilitate building and running tests. We are using python scripts as entrypoint for our tests because that gives us the opportunity to run tests using the same commandline regardless of the platform you are using.

Unit tests (run_tests.py)

Builds gRPC in given language and runs unit tests. Use tools/run_tests/run_tests.py --help for more help.

Example

tools/run_tests/run_tests.py -l csharp -c dbg

Useful options (among many others)
  • --use_docker Builds a docker container containing all the prerequisites for given language and runs the tests under that container.
  • --build_only Only build, do not run the tests.

Note: If you get an error such as ImportError: No module named httplib2, then you may be missing some Python modules. Install the module listed in the error and try again.

Note: some tests may be flaky. Check the "Issues" tab for known flakes and other issues.

The full suite of unit tests will take many minutes to run.

Interop tests (run_interop_tests.py)

Runs tests for cross-platform/cross-language interoperability. For more details, see Interop tests descriptions The script is also capable of running interop tests for grpc-java and grpc-go, using sources checked out alongside the ones of the grpc repository.

Example

tools/run_tests/run_interop_tests.py -l csharp -s c++ --use_docker (run interop tests with C# client and C++ server)

Note: if you see an error like no space left on device when running the interop tests using Docker, make sure that Docker is building the image files in a location with sufficient disk space.

Performance benchmarks (run_performance_tests.py)

Runs predefined benchmark scenarios for given languages. Besides the simple configuration of running all the scenarios locally, the script also supports orchestrating test runs with client and server running on different machines and uploading the results to BigQuery.

Example

tools/run_tests/run_performance_tests.py -l c++ node

Useful options
  • --regex use regex to select particular scenarios to run.

Artifacts & Packages (task_runner.py)

A generalized framework for running predefined tasks based on their labels. We use this to building binary artifacts & distrib packages and testing them)

Example

tools/run_tests/task_runner.py -f python artifact linux x64 (build tasks with labels python, artifact, linux, and x64)