grpc/tools/run_tests
Craig Tiller 8448d499e2 [promises] Add `AllOk` combinator (#35304)
`AllOk` runs a set of promises concurrently, and like `TryJoin` waits for them all to succeed or one to fail.
Unlike `TryJoin` it returns a single unified status of the composition, so cannot handle member promises that might return `StatusOr` or the like.

Closes #35304

COPYBARA_INTEGRATE_REVIEW=https://github.com/grpc/grpc/pull/35304 from ctiller:all-review 30f5f809c6
PiperOrigin-RevId: 591031189
2023-12-14 13:21:35 -08:00
..
artifacts [Python Test] Increase Python Windows build artifact timeout (#34914) 2023-11-10 09:10:42 -08:00
build_stats cleanup tools/run_tests directory 2016-12-22 10:47:52 +01:00
dockerize Move docker images from dockerhub to artifact registry. (#31591) 2022-11-17 10:12:39 +01:00
generated [promises] Add `AllOk` combinator (#35304) 2023-12-14 13:21:35 -08:00
helper_scripts [Python Observability] Building package and add to run_test (#34207) 2023-12-12 10:51:35 -08:00
interop Upgrade sanity Docker image to debian:stretch 2018-12-10 16:21:49 -08:00
lb_interop_tests [Python] Migrate from yapf to black (#33138) 2023-06-09 15:08:55 -07:00
performance [benchmark] Delete references to `node_purejs`. (#33970) 2023-08-08 17:55:56 -07:00
python_utils [bazel RBE] add direct link to Fusion UI in bazel rbe invocations (#34101) 2023-08-21 09:33:20 +02:00
sanity Updated zlib to 1.3 (#35147) 2023-12-14 13:12:45 -08:00
xds_k8s_test_driver [PSM Interop] Log on debug level when resource deletion failure is 404 (#35131) 2023-12-04 15:01:51 -08:00
README.md Remove C# implementation (individual packages will continue to be maintained through v2.46.x patches or moved to grpc-dotnet) (#29225) 2022-04-28 12:00:34 +02:00
run_grpclb_interop_tests.py [Python] Migrate from yapf to black (#33138) 2023-06-09 15:08:55 -07:00
run_interop_tests.py [Ruby] add special status msg interop test (#33990) 2023-08-09 16:52:39 -07:00
run_microbenchmark.py [Python] Migrate from yapf to black (#33138) 2023-06-09 15:08:55 -07:00
run_performance_tests.py Fix Python DeprecationWarning: 'pipes' (#34941) 2023-12-07 13:02:23 -08:00
run_tests.py [Security - Testing] OpenSSL 1.0.2 and 1.1.1 CI Testing (#35236) 2023-12-12 14:52:43 -08:00
run_tests_matrix.py [Security - Testing] OpenSSL 1.0.2 and 1.1.1 CI Testing (#35236) 2023-12-12 14:52:43 -08:00
run_xds_tests.py [PSM Interop] Legacy tests: update Kokoro to Ubuntu 22.04 (#33685) 2023-07-25 11:08:19 -07:00
start_port_server.py Migrate the bm_diff benchmarks to python3 (#25619) 2021-03-09 15:44:00 +01:00
task_runner.py [Python] Migrate from yapf to black (#33138) 2023-06-09 15:08:55 -07:00

README.md

Overview

This directory contains scripts that facilitate building and running tests. We are using python scripts as entrypoint for our tests because that gives us the opportunity to run tests using the same commandline regardless of the platform you are using.

Unit tests (run_tests.py)

Builds gRPC in given language and runs unit tests. Use tools/run_tests/run_tests.py --help for more help.

Example

tools/run_tests/run_tests.py -l python -c dbg

Useful options (among many others)
  • --use_docker Builds a docker container containing all the prerequisites for given language and runs the tests under that container.
  • --build_only Only build, do not run the tests.

Note: If you get an error such as ImportError: No module named httplib2, then you may be missing some Python modules. Install the module listed in the error and try again.

Note: some tests may be flaky. Check the "Issues" tab for known flakes and other issues.

The full suite of unit tests will take many minutes to run.

Interop tests (run_interop_tests.py)

Runs tests for cross-platform/cross-language interoperability. For more details, see Interop tests descriptions The script is also capable of running interop tests for grpc-java and grpc-go, using sources checked out alongside the ones of the grpc repository.

Example

tools/run_tests/run_interop_tests.py -l python -s c++ --use_docker (run interop tests with C# client and C++ server)

Note: if you see an error like no space left on device when running the interop tests using Docker, make sure that Docker is building the image files in a location with sufficient disk space.

Performance benchmarks (run_performance_tests.py)

The run_performance_tests.py script is deprecated. See end-to-end benchmarking documentation for more info.

Artifacts & Packages (task_runner.py)

A generalized framework for running predefined tasks based on their labels. We use this to building binary artifacts & distrib packages and testing them)

Example

tools/run_tests/task_runner.py -f python artifact linux x64 (build tasks with labels python, artifact, linux, and x64)