History

Prashant Jaikumar 43628b286f Update googletest version to v1.8.1 Bazel builds of test/cpp/end2end:end2end_test were failing on Mac OS with v1.8.0 due to missing gtest symbols. The issue is not seen in v1.8.1. A WORKSPACE file was added to gtest repo in 1.8.1, so gtest.BUILD can be removed.		2019-06-20 18:17:13 -07:00
..
artifacts	Skip all ruby distrib tests that use ruby 2.2	2019-06-19 14:59:26 -07:00
build_stats	cleanup tools/run_tests directory	2016-12-22 10:47:52 +01:00
dockerize	add AspNetCore interop server	2019-02-14 18:25:28 +01:00
generated	Add out of bounds frame tests	2019-06-14 16:13:19 -07:00
helper_scripts	ruby-sigint ready to be merged!	2018-12-26 11:17:48 -08:00
interop	Upgrade sanity Docker image to debian:stretch	2018-12-10 16:21:49 -08:00
lb_interop_tests	Add a grpclb-in-DNS interop test suite	2018-10-23 00:00:08 -07:00
performance	Fix broken php7 performance benchmarks build	2019-03-18 15:12:46 -07:00
python_utils	fix uploading bazel RBE results to bigquery	2019-04-29 12:06:34 -04:00
sanity	Update googletest version to v1.8.1	2019-06-20 18:17:13 -07:00
README.md	remove leftovers of stress tests	2018-05-21 10:28:12 -07:00
run_build_statistics.py	Upgrade yapf to 0.20.0	2018-01-02 14:40:00 -08:00
run_grpclb_interop_tests.py	Add a grpclb-in-DNS interop test suite	2018-10-23 00:00:08 -07:00
run_interop_tests.py	make default service account email configurable	2019-06-06 14:12:55 -04:00
run_microbenchmark.py	Roll-forward "Config migration"	2019-05-20 15:47:24 -07:00
run_performance_tests.py	build C++ in benchmarks with cmake	2018-10-22 17:56:53 +02:00
run_tests.py	Resolve xcodebuild issue on Mac	2019-06-20 10:03:01 -07:00
run_tests_matrix.py	fix cannot find tests	2019-06-14 10:16:19 -07:00
start_port_server.py	remove python version number	2019-05-31 10:31:37 +08:00
task_runner.py	yapf run_tests	2017-12-11 18:08:35 -08:00

README.md

Overview

This directory contains scripts that facilitate building and running tests. We are using python scripts as entrypoint for our tests because that gives us the opportunity to run tests using the same commandline regardless of the platform you are using.

Unit tests (run_tests.py)

Builds gRPC in given language and runs unit tests. Use tools/run_tests/run_tests.py --help for more help.

Example

tools/run_tests/run_tests.py -l csharp -c dbg

Useful options (among many others)

--use_docker Builds a docker container containing all the prerequisites for given language and runs the tests under that container.
--build_only Only build, do not run the tests.

Note: If you get an error such as ImportError: No module named httplib2, then you may be missing some Python modules. Install the module listed in the error and try again.

Note: some tests may be flaky. Check the "Issues" tab for known flakes and other issues.

The full suite of unit tests will take many minutes to run.

Interop tests (run_interop_tests.py)

Runs tests for cross-platform/cross-language interoperability. For more details, see Interop tests descriptions The script is also capable of running interop tests for grpc-java and grpc-go, using sources checked out alongside the ones of the grpc repository.

Example

tools/run_tests/run_interop_tests.py -l csharp -s c++ --use_docker (run interop tests with C# client and C++ server)

Note: if you see an error like no space left on device when running the interop tests using Docker, make sure that Docker is building the image files in a location with sufficient disk space.

Performance benchmarks (run_performance_tests.py)

Runs predefined benchmark scenarios for given languages. Besides the simple configuration of running all the scenarios locally, the script also supports orchestrating test runs with client and server running on different machines and uploading the results to BigQuery.

Example

tools/run_tests/run_performance_tests.py -l c++ node

Useful options

--regex use regex to select particular scenarios to run.

Artifacts & Packages (task_runner.py)

A generalized framework for running predefined tasks based on their labels. We use this to building binary artifacts & distrib packages and testing them)

Example

tools/run_tests/task_runner.py -f python artifact linux x64 (build tasks with labels python, artifact, linux, and x64)