601cff4018
More programmatically generate scenarios
2016-09-19 07:30:45 -07:00
bcc60f75d4
Merge branch 'master' into uv_core_transport
2016-09-16 13:44:28 -07:00
bf4939fd22
Extend sweeps further, add streaming
2016-09-16 13:41:00 -07:00
232ca0275e
Removed unnecessary notes from scenario_config.py
2016-09-16 13:30:19 -07:00
9030c81f20
Add a libuv endpoint to the C core, for use in the Node library
2016-09-16 13:25:08 -07:00
8c985c2866
Allow more sync threads
2016-09-16 11:25:32 -07:00
5709469c46
Fix sync/async
2016-09-16 11:22:42 -07:00
86cf6dcb1c
Remove some scenarios we can't run yet
2016-09-13 10:33:29 -07:00
0c98675e54
Fix outstanding calls
2016-09-13 10:01:26 -07:00
1423a63db9
Lets not do payload sweeps just yet
2016-09-13 09:54:21 -07:00
b6df24765f
Properly categorize tests to allow sweeps to be run by adhoc
2016-09-13 09:41:26 -07:00
c5aa700538
Significantly increase sweep space
2016-09-13 09:36:09 -07:00
6c38c1be30
Reduce outstanding request count
2016-09-13 08:34:27 -07:00
15372a3f22
Use a # of total outstanding requests to drive benchmark config
...
Instead of specifying # of outstanding requests/channel, specify a total
outstanding size, and try to fit that to the number of channels.
2016-09-08 09:21:55 -07:00
4f2d9ae8e2
Add sync variants of important tests, add sweeps across different channel counts
2016-07-17 14:07:18 -07:00
6dbfce0a9d
Add clientSuccess and serverSuccess to BQ schema
2016-07-15 11:05:24 -07:00
45c0f2b305
Migrated python performance tests to use GA API
2016-07-06 19:26:09 -07:00
3b5b20682b
Make running individual Python tests less painful
...
Before this change, running Python tests individually required
building a tox environment via the run_tests script and then specifying
long environment variables to filter out just the test we wanted to run
(and then we wouldn't be able to get the output on interrupt, nor would
we have an easy way of determining the PID of the process for debugger
attachment). Now invoking the build_python.sh script creates a workable
python virtual environment that includes all necessary libraries and
tests (s.t. running a single test is now possible by just knowing the
module name). This does not change existing supported means of running
tests (e.g. through run_tests.py).
An additional way of running individual tests has been introduced.
Following invocation of `./tools/run_tests/build_python.sh` (or
run_tests.py), one may invoke
./$VENV/bin/python -m $TEST_MODULE_NAME
and acquire a single running process that *is* the test process (rather
than a parent of the process). $VENV is the virtual environment name
specified to `build_python.sh` (defaults to `py27`) and
$TEST_MODULE_NAME is what it says on the tin.
2016-07-01 10:18:45 -07:00
1ff429da2a
Organize Python tests to use grpcio-tools directly
...
Moves all tests into a separate package. This does not change existing
supported means of running tests (e.g. through run_tests.py).
2016-07-01 10:18:45 -07:00
a286b040a9
small fixes
2016-06-13 15:20:39 +00:00
9a36e6c7cd
Changed Python Sync streaming qps to follow spec
2016-06-07 17:49:03 -07:00
571c12ef18
Remove AsyncStreaming client from python qps tests
2016-06-06 23:13:27 -07:00
28f6c01d76
Revert "Revive C++ large-message throughput tests"
2016-05-22 21:23:43 -04:00
33b7361126
Merge pull request #6661 from vjpai/throughput_fix
...
Revive C++ large-message throughput tests
2016-05-22 17:29:05 -04:00
3fe694fa35
Revive throughput tests .
2016-05-19 17:51:45 -07:00
d27888b6db
mark unconstrained scenarios with scalable category
2016-05-19 16:15:01 -07:00
5cbccd0781
set client params differently for sync and async client
2016-05-13 16:26:42 -07:00
37a907e471
add support for CLIENT_LANGUAGE setting
2016-05-13 15:09:32 -07:00
649d126ed3
set GOPATH when executing go worker
2016-05-11 12:26:39 -07:00
4bd3a7cecb
change go scenarios to use sync api
2016-05-11 09:37:12 -07:00
3b59b0f417
integrate Go qps worker
2016-05-11 09:37:12 -07:00
594ff2054a
Merge pull request #6524 from kpayson64/qps_improvements
...
Added true async qps streaming client
2016-05-11 09:11:24 -07:00
7363674e11
Merge pull request #6477 from jtattermusch/benchmarking_add_netperf
...
Add support for running netperf as part of benchmarks.
2016-05-10 20:33:02 -07:00
1eb8d54a19
Added true async qps client
2016-05-10 16:57:14 -07:00
6de6971bdc
explicitly specify request and response size for netperf
2016-05-10 14:33:21 -07:00
4de2c3254b
add support for running netperf scenario
2016-05-10 14:33:07 -07:00
92d9106a35
dont use corelimit for throughput tests
2016-05-10 11:53:19 -07:00
16713b91cc
enable previously disabled C# scenarios
2016-05-09 15:42:32 -07:00
abd1b38885
comment out the right scenario
2016-05-08 18:47:40 -07:00
ed4c3f17dd
disable some C# scenarios
2016-05-06 15:39:08 -07:00
427699b638
mark some scenarios as smoketest and add a cmdline flag
2016-05-05 18:10:35 -07:00
a21c7e9207
add support for scenario categories
2016-05-05 18:10:35 -07:00
d7b162f601
add some more scenarios
2016-05-05 16:16:12 -07:00
957fe8dc5d
Updated a couple more scripts
2016-05-02 15:03:55 -07:00
501ca57665
kill pending python workers on start
2016-04-29 09:35:44 -07:00
b8c44438b3
Merge pull request #6298 from grpc/python_qps_tests
...
Python QPS Tests
2016-04-28 21:48:13 -07:00
0482c1046b
Python QPS Worker/initial scenarios
2016-04-28 20:01:06 -07:00
1408920ab9
get rid of local qpsworkers before starting the tests
2016-04-27 18:26:53 -07:00
ab8b9f5143
Merge pull request #6271 from jtattermusch/temporarily_disable_csharp_qps_unconstrained
...
temporarily disable csharp_protobuf_async_streaming_qps_unconstrained
2016-04-23 07:30:26 -07:00
fa8d5b3ef7
temporarily disable csharp_protobuf_async_streaming_qps_unconstrained
2016-04-22 16:23:44 -07:00
ffe7773e29
temporarily disable cpp_single_channel_troughput
2016-04-22 16:16:42 -07:00
af7a8b62c8
address comments
2016-04-21 10:15:06 -07:00
e222c002ae
run both secure and insecure scenarios for java
2016-04-21 08:27:53 -07:00
299f97f821
make wrapped languages scenarios secure by default
2016-04-21 08:27:53 -07:00
1a3116840f
add C# unconstrained scenario
2016-04-21 08:27:53 -07:00
108f93ddf0
add unary pingpong scenarios for c++
2016-04-20 18:45:50 -07:00
679cfaf240
Merge pull request #6235 from vjpai/qps_driver_youre_fired
...
Delete qps_driver and dependent scripts, add quit to qps_json_driver
2016-04-20 18:44:04 -07:00
1c81329421
Fix some of the scenarios core limits, thread limits, and depth
2016-04-20 14:17:27 -07:00
92abf1cfd4
Merge branch 'master' into qps_driver_youre_fired
2016-04-20 13:06:25 -07:00
29089c7b41
Deprecation of qps_driver and use of shell scripts, in progress
2016-04-20 12:38:16 -07:00
11433b7047
kill java processes properly
2016-04-20 09:21:50 -07:00
f3b523b6c8
make RVM ruby accessible by performance tests
2016-04-19 14:32:37 -07:00
de874a101f
add java performance worker
2016-04-19 11:43:33 -07:00
a5780e1607
add RubyLanguage to benchmarking scenarios
2016-04-18 08:37:12 -07:00
92265f6904
fix field names in schema
2016-04-15 14:53:53 -07:00
4843b513c6
populate metadata about jenkins build in benchmark results
2016-04-15 13:43:39 -07:00
6d7fa5572e
result uploading
2016-04-15 10:17:22 -07:00
88cc4e26ed
minor changes to schema
2016-04-15 10:17:22 -07:00
efd9803be5
Uploading results to big query
2016-04-15 09:14:31 -07:00
7be244b647
fix redundant C++ scenario
2016-04-14 13:13:25 -07:00
d61c252f8e
add some more C# scenarios
2016-04-14 13:13:24 -07:00
4fec48b831
tiny fixes to scenario_config
2016-04-14 13:13:24 -07:00
0bda0b3e55
Configure performance scenarios with json
...
Run those json configurations as part of presubmits
2016-04-06 10:14:44 -07:00
39d1a66bb9
Merge pull request #6064 from ctiller/performance
...
Separate configuration from running logic for performance tests
2016-04-05 16:03:55 -07:00
182de56ae7
Merge pull request #6082 from jtattermusch/csharp_perfworker_features
...
Add some C# qps worker features
2016-04-05 15:10:00 -07:00
6dd74fcb91
always build qps_driver
2016-04-05 11:55:17 -07:00
084aa62861
Remove unnecessary -2016 from copyrights
2016-04-05 08:36:49 -07:00
d92d5c5dd2
Add copyright, tweak name
2016-04-04 13:49:29 -07:00
cb2cd26d04
Separate configuration from running logic for performance tests
2016-04-01 13:59:54 -07:00
7797e3fac7
Only build specified languages when running tests for those languages
2016-04-01 07:41:05 -07:00
bb1a45387e
add support for multiple languages
2016-03-31 16:35:29 -07:00
d7be789b09
build C# and node perf workers
2016-03-31 14:38:36 -07:00
9de3c7ad31
add a newline
2016-03-31 14:38:36 -07:00
b275844864
add run_performance_tests.py script
2016-03-28 18:17:24 -07:00
Craig Tiller