Commit Graph

69 Commits

Author SHA1 Message Date
Sree Kuchibhotla 1b22cddc7d Add clientSuccess and serverSuccess to BQ schema 2016-08-01 22:13:33 -07:00
Ken Payson 45c0f2b305 Migrated python performance tests to use GA API 2016-07-06 19:26:09 -07:00
Masood Malekghassemi 3b5b20682b Make running individual Python tests less painful
Before this change, running Python tests individually required
building a tox environment via the run_tests script and then specifying
long environment variables to filter out just the test we wanted to run
(and then we wouldn't be able to get the output on interrupt, nor would
we have an easy way of determining the PID of the process for debugger
attachment). Now invoking the build_python.sh script creates a workable
python virtual environment that includes all necessary libraries and
tests (s.t. running a single test is now possible by just knowing the
module name). This does not change existing supported means of running
tests (e.g. through run_tests.py).

An additional way of running individual tests has been introduced.
Following invocation of `./tools/run_tests/build_python.sh` (or
run_tests.py), one may invoke

  ./$VENV/bin/python -m $TEST_MODULE_NAME

and acquire a single running process that *is* the test process (rather
than a parent of the process). $VENV is the virtual environment name
specified to `build_python.sh` (defaults to `py27`) and
$TEST_MODULE_NAME is what it says on the tin.
2016-07-01 10:18:45 -07:00
Masood Malekghassemi 1ff429da2a Organize Python tests to use grpcio-tools directly
Moves all tests into a separate package. This does not change existing
supported means of running tests (e.g. through run_tests.py).
2016-07-01 10:18:45 -07:00
Craig Tiller a286b040a9 small fixes 2016-06-13 15:20:39 +00:00
Ken Payson 9a36e6c7cd Changed Python Sync streaming qps to follow spec 2016-06-07 17:49:03 -07:00
Ken Payson 571c12ef18 Remove AsyncStreaming client from python qps tests 2016-06-06 23:13:27 -07:00
Jan Tattermusch 28f6c01d76 Revert "Revive C++ large-message throughput tests" 2016-05-22 21:23:43 -04:00
Jan Tattermusch 33b7361126 Merge pull request #6661 from vjpai/throughput_fix
Revive C++ large-message throughput tests
2016-05-22 17:29:05 -04:00
vjpai 3fe694fa35 Revive throughput tests . 2016-05-19 17:51:45 -07:00
Jan Tattermusch d27888b6db mark unconstrained scenarios with scalable category 2016-05-19 16:15:01 -07:00
Jan Tattermusch 5cbccd0781 set client params differently for sync and async client 2016-05-13 16:26:42 -07:00
Jan Tattermusch 37a907e471 add support for CLIENT_LANGUAGE setting 2016-05-13 15:09:32 -07:00
Jan Tattermusch 649d126ed3 set GOPATH when executing go worker 2016-05-11 12:26:39 -07:00
Jan Tattermusch 4bd3a7cecb change go scenarios to use sync api 2016-05-11 09:37:12 -07:00
Jan Tattermusch 3b59b0f417 integrate Go qps worker 2016-05-11 09:37:12 -07:00
Jan Tattermusch 594ff2054a Merge pull request #6524 from kpayson64/qps_improvements
Added true async qps streaming client
2016-05-11 09:11:24 -07:00
Jan Tattermusch 7363674e11 Merge pull request #6477 from jtattermusch/benchmarking_add_netperf
Add support for running netperf as part of benchmarks.
2016-05-10 20:33:02 -07:00
Ken Payson 1eb8d54a19 Added true async qps client 2016-05-10 16:57:14 -07:00
Jan Tattermusch 6de6971bdc explicitly specify request and response size for netperf 2016-05-10 14:33:21 -07:00
Jan Tattermusch 4de2c3254b add support for running netperf scenario 2016-05-10 14:33:07 -07:00
Jan Tattermusch 92d9106a35 dont use corelimit for throughput tests 2016-05-10 11:53:19 -07:00
Jan Tattermusch 16713b91cc enable previously disabled C# scenarios 2016-05-09 15:42:32 -07:00
Jan Tattermusch abd1b38885 comment out the right scenario 2016-05-08 18:47:40 -07:00
Jan Tattermusch ed4c3f17dd disable some C# scenarios 2016-05-06 15:39:08 -07:00
Jan Tattermusch 427699b638 mark some scenarios as smoketest and add a cmdline flag 2016-05-05 18:10:35 -07:00
Jan Tattermusch a21c7e9207 add support for scenario categories 2016-05-05 18:10:35 -07:00
Jan Tattermusch d7b162f601 add some more scenarios 2016-05-05 16:16:12 -07:00
murgatroid99 957fe8dc5d Updated a couple more scripts 2016-05-02 15:03:55 -07:00
Jan Tattermusch 501ca57665 kill pending python workers on start 2016-04-29 09:35:44 -07:00
Jan Tattermusch b8c44438b3 Merge pull request #6298 from grpc/python_qps_tests
Python QPS Tests
2016-04-28 21:48:13 -07:00
Ken Payson 0482c1046b Python QPS Worker/initial scenarios 2016-04-28 20:01:06 -07:00
Jan Tattermusch 1408920ab9 get rid of local qpsworkers before starting the tests 2016-04-27 18:26:53 -07:00
Jan Tattermusch ab8b9f5143 Merge pull request #6271 from jtattermusch/temporarily_disable_csharp_qps_unconstrained
temporarily disable csharp_protobuf_async_streaming_qps_unconstrained
2016-04-23 07:30:26 -07:00
Jan Tattermusch fa8d5b3ef7 temporarily disable csharp_protobuf_async_streaming_qps_unconstrained 2016-04-22 16:23:44 -07:00
Jan Tattermusch ffe7773e29 temporarily disable cpp_single_channel_troughput 2016-04-22 16:16:42 -07:00
Jan Tattermusch af7a8b62c8 address comments 2016-04-21 10:15:06 -07:00
Jan Tattermusch e222c002ae run both secure and insecure scenarios for java 2016-04-21 08:27:53 -07:00
Jan Tattermusch 299f97f821 make wrapped languages scenarios secure by default 2016-04-21 08:27:53 -07:00
Jan Tattermusch 1a3116840f add C# unconstrained scenario 2016-04-21 08:27:53 -07:00
Jan Tattermusch 108f93ddf0 add unary pingpong scenarios for c++ 2016-04-20 18:45:50 -07:00
Jan Tattermusch 679cfaf240 Merge pull request #6235 from vjpai/qps_driver_youre_fired
Delete qps_driver and dependent scripts, add quit to qps_json_driver
2016-04-20 18:44:04 -07:00
vjpai 1c81329421 Fix some of the scenarios core limits, thread limits, and depth 2016-04-20 14:17:27 -07:00
vjpai 92abf1cfd4 Merge branch 'master' into qps_driver_youre_fired 2016-04-20 13:06:25 -07:00
vjpai 29089c7b41 Deprecation of qps_driver and use of shell scripts, in progress 2016-04-20 12:38:16 -07:00
Jan Tattermusch 11433b7047 kill java processes properly 2016-04-20 09:21:50 -07:00
Jan Tattermusch f3b523b6c8 make RVM ruby accessible by performance tests 2016-04-19 14:32:37 -07:00
Jan Tattermusch de874a101f add java performance worker 2016-04-19 11:43:33 -07:00
Jan Tattermusch a5780e1607 add RubyLanguage to benchmarking scenarios 2016-04-18 08:37:12 -07:00
Jan Tattermusch 92265f6904 fix field names in schema 2016-04-15 14:53:53 -07:00