natas_hw
/
grpc
0
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
grpc/tools/run_tests
History
Vijay Pai 739cecb0bc Merge pull request #10305 from vjpai/fixdep 
Resolve a circular dependence in build
 		2017-03-27 13:55:16 -07:00
..
artifacts Merge branch 'v1.2.x' of https://github.com/grpc/grpc into upmerge-1.2.0 2017-03-24 00:54:47 +01:00
build_stats cleanup tools/run_tests directory 2016-12-22 10:47:52 +01:00
dockerize Merge pull request #9857 from murgatroid99/merge_1.1.x_master 2017-02-27 10:50:31 -08:00
generated Merge pull request #10305 from vjpai/fixdep 2017-03-27 13:55:16 -07:00
helper_scripts add passing test that kills a process while there are active watch chan state calls 2017-03-20 21:07:20 -07:00
interop add http2 server test for unary calls that uses small frames and padding 2017-03-22 13:46:51 -07:00
performance Merge pull request #10115 from thunderboltsid/update-run-tests-scripts-to-python3.x 2017-03-13 22:38:12 -07:00
python_utils add http2 server test for unary calls that uses small frames and padding 2017-03-22 13:46:51 -07:00
sanity Merge remote-tracking branch 'upstream/master' into cares_bazel_rule 2017-03-17 16:00:17 -07:00
stress_test Modify shebang on python scripts 2017-03-12 19:53:12 +01:00
README.md Note to help diagnose errors with docker's default location for building 2017-01-06 14:15:54 -08:00
run_build_statistics.py Modify shebang on python scripts 2017-03-12 19:53:12 +01:00
run_interop_tests.py add http2 server test for unary calls that uses small frames and padding 2017-03-22 13:46:51 -07:00
run_microbenchmark.py Add a TODO to enable microbenmarking for performance testing 2017-03-24 17:01:27 -07:00
run_performance_tests.py Modify shebang on python scripts 2017-03-12 19:53:12 +01:00
run_stress_tests.py Modify shebang on python scripts 2017-03-12 19:53:12 +01:00
run_tests.py Merge pull request #7771 from y-zeng/cares_buildin 2017-03-24 14:52:04 -07:00
run_tests_matrix.py Turn off c_ares resolver by default 2017-03-19 22:31:14 -07:00
start_port_server.py Make testing scripts python3.x compatible 2017-03-12 17:47:53 +01:00
task_runner.py Modify shebang on python scripts 2017-03-12 19:53:12 +01:00

README.md

#Overview

This directory contains scripts that facilitate building and running tests. We are using python scripts as entrypoint for our tests because that gives us the opportunity to run tests using the same commandline regardless of the platform you are using.

#Unit tests (run_tests.py)

Builds gRPC in given language and runs unit tests. Use tools/run_tests/run_tests.py --help for more help.

######Example tools/run_tests/run_tests.py -l csharp -c dbg

######Useful options (among many others)

  • --use_docker Builds a docker container containing all the prerequisites for given language and runs the tests under that container.
  • --build_only Only build, do not run the tests.

#Interop tests (run_interop_tests.py)

Runs tests for cross-platform/cross-language interoperability. For more details, see Interop tests descriptions The script is also capable of running interop tests for grpc-java and grpc-go, using sources checked out alongside the ones of the grpc repository.

######Example tools/run_tests/run_interop_tests.py -l csharp -s c++ --use_docker (run interop tests with C# client and C++ server)

Note: if you see an error like no space left on device when running the interop tests using Docker, make sure that Docker is building the image files in a location with sufficient disk space.

#Performance benchmarks (run_performance_tests.py)

Runs predefined benchmark scenarios for given languages. Besides the simple configuration of running all the scenarios locally, the script also supports orchestrating test runs with client and server running on different machines and uploading the results to BigQuery.

######Example tools/run_tests/run_peformance_tests.py -l c++ node

######Useful options

  • --regex use regex to select particular scenarios to run.

#Stress tests (run_stress_tests.py)

Runs modified interop tests clients and servers under heavy load for an extended period of time to discover potential stability issues. The tests are internally using Kubernetes to run the client and server on GKE and upload statistics to BigQuery.

tools/run_tests/stress_test/run_on_gke.py --gcp_project_id=<google-cloud-platform-project-id> --config_file=<path-to-config-file>

The directory tools/run_tests/stress_test/configs/ contains the config files for several scenarios

#Artifacts & Packages (task_runner.py)

A generalized framework for running predefined tasks based on their labels. We use this to building binary artifacts & distrib packages and testing them)

######Example tools/run_tests/task_runner.py -f python artifact linux x64 (build tasks with labels python, artifact, linux, and x64)