032f9bfb58
Start to log errors from benchmark
2016-09-29 10:10:00 -07:00
1a8c52e479
Collect stats on # failed requests
2016-09-28 17:28:04 -07:00
0c80c7d12c
Collecting failure status progress
2016-09-28 16:30:55 -07:00
5db24978b6
Merge remote-tracking branch 'upstream/master' into fail_fast
2016-09-28 13:21:31 -07:00
f91af0001d
Merge github.com:grpc/grpc into direct-calls
2016-09-28 11:00:12 -07:00
9477724003
Change C++ API to expose wait_for_ready instead of fail_fast.
2016-09-27 13:07:00 -07:00
af9da92a60
Dont run benchmarks outside of linux for now
2016-09-27 12:47:19 -07:00
91bb6241ab
Reduce # of benchmarks run as Jenkins unit tests
2016-09-27 12:46:08 -07:00
5abf79a91b
Merge github.com:grpc/grpc into direct-calls
2016-09-23 13:51:00 -07:00
e267f86c43
Properly init variable
2016-09-22 14:15:46 -07:00
ba1db3b630
Merge github.com:grpc/grpc into direct-calls
2016-09-15 15:57:35 -07:00
9e1c2d2358
Dont start requests until all clients have gotten connected
2016-09-14 08:37:10 -07:00
531976a6d4
Add an initial mark that clients could use to delay startup of requests
2016-09-14 08:28:37 -07:00
44b12f9e23
clang-format
2016-09-08 10:06:14 -07:00
cd1feaab30
Merge pull request #7816 from ctiller/benchmark-verbosity
...
Increase log verbosity for benchmark driver
2016-09-07 14:33:56 -07:00
0cb5a89d6f
Merge branch 'benchmark-verbosity' into direct-calls
2016-09-07 14:25:38 -07:00
bd37a21c26
Cleanup, debug support
2016-09-07 11:28:56 -07:00
8ef0eda856
Merge github.com:grpc/grpc into merge-parse
2016-08-22 11:39:08 -07:00
daf4699652
Merge pull request #6732 from ctiller/consistent_client_count
...
Make client_channels be across all clients, not per-client
2016-08-22 08:34:38 -07:00
74a1d9a939
Increase log verbosity for benchmark driver
2016-08-22 08:33:02 -07:00
378ffd8cc3
Merge github.com:grpc/grpc into merge-parse
2016-08-18 13:03:23 -07:00
0c6cce12b4
Merge pull request #7648 from vjpai/qps_better_ptr
...
Use unique_ptr properly in QPS async tests
2016-08-15 13:02:44 -07:00
ca04562286
Timing nuances
2016-08-09 08:38:03 -07:00
f50020ce03
Appease the const gods, improve readability, stop using 0 and 1 as
...
proxies for false and true.
2016-08-08 07:29:31 -07:00
d02988d6b5
clang-format
2016-08-05 09:47:47 -07:00
25128f1adf
Better ending for open-loop tests: never wait more than 1 second
...
if we are in termination mode
2016-08-05 09:45:03 -07:00
773ecd62dd
Dramatically reduce time required to complete sync test when running
...
with lots of threads (by parallelizing shutdown of course)
2016-08-05 09:26:56 -07:00
4f17395b81
Properly use unique_ptr rather than explicitly
...
deleting server context wrappers in QPS test
2016-08-05 01:32:34 -07:00
6e5c33c3e2
Don't assert if we're not able to set affinity for some reason
2016-07-30 02:56:46 -07:00
ad94fdfe51
Fix compile error
2016-07-15 06:42:29 -07:00
b23239b6d8
Merge branch 'histo' of github.com:vjpai/grpc into delayed-write
2016-07-15 06:37:41 -07:00
0a06cd7b68
Cleanup from code review
2016-07-14 13:21:24 -07:00
5fde20d9f0
clang-format
2016-07-13 19:25:59 -07:00
40317fd720
Resolve pernicious race between destructor and thread functions by insisting that destructor is invoked after the class has gone back to being a harmless single-threaded thing.
2016-07-13 19:20:25 -07:00
8da7b1f779
Fix some failures
2016-07-13 15:06:00 -07:00
ad7c527618
Temporary workaround by setting up a deadline on server shutdown.
...
This reveals an issue that needs to be solved:
D0713 14:48:28.049861213 14503 server.c:704] Waiting for 44 channels and 0/1 listeners to be destroyed before shutting down server
2016-07-13 14:51:44 -07:00
a831651aa5
Unify and make consistent the per-thread shutdown process
2016-07-13 10:32:26 -07:00
b5ee1cdcb9
Dont stall shutting down server
2016-07-13 08:39:35 -07:00
38fb8de100
get timeouts working on run_tests.py again
2016-07-13 08:23:32 -07:00
e64d693050
Better fine-tuning
2016-07-12 20:53:16 -07:00
61e2040de0
Get json_run_localhost working again
2016-07-12 17:26:52 -07:00
72376da8ba
Get json_run_localhost working again
2016-07-12 17:14:37 -07:00
9e3691c5bd
Actually run json_run_localhost tests
2016-07-12 16:29:46 -07:00
b19dbead67
Make request freelists per cq, to allow drastically higher requested call counts
2016-07-12 15:33:11 -07:00
1d03e100eb
Ensure timely response to marks
2016-07-12 09:50:56 -07:00
f782465fba
Fix some shutdown errors related to CQ/join ordering
2016-07-08 10:33:10 -07:00
aa8bbeb6c6
Merge branch 'verbose_errors' into histo
2016-07-08 09:41:59 -07:00
f373f2cf8b
Stop holding histogram for a long time
2016-07-08 09:40:55 -07:00
fbf03c1735
Fix high seqno tests, up runtimes for benchmark tests to flush more bugs
2016-07-07 13:10:09 -07:00
ceb1a7d79f
Add more information so that we can have a meaningful exit code
2016-07-07 11:06:04 -07:00
b0f15e8af3
Reduce assertions, use status codes, increase verbosity on errors
2016-07-06 13:57:01 -07:00
346da5f346
Merge github.com:grpc/grpc into consistent_client_count
2016-06-28 14:09:08 -07:00
5b47ac385b
Colocate calls for the same channel on the same CQ
2016-06-27 15:47:17 -07:00
c074408bd3
Merge github.com:grpc/grpc into consistent_client_count
2016-06-23 11:57:26 -07:00
5856dee7d6
Fix compile
2016-06-22 16:30:22 -07:00
88a3e93f0d
Better distribution
2016-06-22 08:18:07 -07:00
7e5d46496b
Better distribution
2016-06-22 08:17:27 -07:00
ddf694cc62
Merge branch 'master' into wheezy
2016-06-17 13:41:38 -07:00
3e45ed1c9a
Merge pull request #6838 from vjpai/trigger_happy
...
Revert unneeded change in qps worker
2016-06-16 18:00:25 -07:00
b31a9a0900
Include <cinttypes> for PRIuPTR. Not clear why this is needed.
2016-06-16 07:50:20 +00:00
b9e927afcc
Merge branch 'master' into wheezy
2016-06-15 22:57:21 -07:00
08e071abe0
Specify template parent explicitly
2016-06-15 10:58:15 -07:00
0ba114408e
Fix gpr_log format mismatches in c++ tests
2016-06-10 15:15:44 -07:00
e27d189f21
Factor out json seriailzation code and move it into parse_json.
...
This is for the same reasons as ParseJson, that is so that we can limit
the scope of the proto namespace differences between internal and
external.
2016-06-08 17:11:26 -07:00
74e6e135e9
I was trigger-happy with changes to qps_worker in the hope of improving
...
stability. I believe that this change was unneeded and actually
may hurt matters by holding a lock for too long.
Partially undoes #5444 , particular commit e7042b5
2016-06-08 13:32:16 -07:00
aaee544d69
merge and resolve conflicts
2016-06-03 15:34:01 -07:00
17487f9a22
Make grpc++ independent of protobuf
2016-06-03 15:21:15 -07:00
d4aa7cf5a5
Fix negation
2016-05-31 13:59:25 -07:00
1adb13143f
Add comment
2016-05-31 13:04:32 -07:00
dbd03b5e2d
Make client_channels be across all clients, not per-client
2016-05-31 13:00:33 -07:00
711472f846
Remove unused gflags and gtest includes
2016-05-31 12:57:38 -07:00
d8364f7af5
Deprecate perf_db use
2016-05-31 12:54:04 -07:00
e0ddc35aa3
Speed up tests
2016-05-23 15:57:48 -07:00
825cd4533c
Cleanup redundant tests
2016-05-23 15:54:38 -07:00
e67f7b6b54
Fix timeout on async server shutdown
...
Server was continuing to make requests for new calls forever, which were
starving out the shutdown sequence. Change order and win.
2016-05-23 14:50:24 -07:00
c0cb23b885
Merge branch 'guess_cpu' into test_affine
2016-05-20 11:17:31 -07:00
bd24a4611f
Better guesses at benchmarks turned unit tests cpu cost
2016-05-20 11:15:58 -07:00
c3b88b079e
Better testing
2016-05-16 11:21:17 -07:00
52237e3a96
clang-format
2016-05-13 14:37:25 -07:00
63d24f1c7d
Make qps workers connect before even warmup stage begins
2016-05-13 14:36:09 -07:00
b85e9d43f0
fix formatting
2016-05-11 10:21:45 -07:00
a21c7e9207
add support for scenario categories
2016-05-05 18:10:35 -07:00
e88030a2c2
Merge pull request #6340 from ctiller/fail_fast_breaks_qps
...
Disable fail fast for qps driver
2016-05-02 14:26:52 -07:00
97244d5810
clang-format, make code more self-documenting
2016-04-29 08:05:57 -07:00
5c123fd22b
Add a shard channel arg to client channel construction
...
C core automatically shares subchannels between channels. Therefore our
multiple channel performance tests were really testing single channel
performance.
2016-04-28 20:48:24 -07:00
b6e4440880
Disable fail fast for qps driver
2016-04-28 08:21:52 -07:00
241dea56c8
Merge pull request #6147 from ctiller/strong-includes
...
Rollup of changes from latest import
2016-04-21 18:59:06 -07:00
7beea147e5
Merge github.com:grpc/grpc into strong-includes
2016-04-21 17:07:36 -07:00
dfdfe26958
Make sure that there is at least one scenario, otherwise indicates malformed
...
input
2016-04-21 11:38:31 -07:00
8909428a1a
clang-format
2016-04-20 14:21:30 -07:00
92abf1cfd4
Merge branch 'master' into qps_driver_youre_fired
2016-04-20 13:06:25 -07:00
1f13c820ed
Eliminate unused source file
2016-04-20 13:04:35 -07:00
29089c7b41
Deprecation of qps_driver and use of shell scripts, in progress
2016-04-20 12:38:16 -07:00
87bac959ee
Eradicate Uniform, Deterministic, and Pareto interarrival
...
distributions since we don't use them and it's not sensible
to add them
2016-04-20 09:35:35 -07:00
e9a8d89dc2
fix formatting
2016-04-15 15:38:17 -07:00
33c161dffa
populate ScenarioResult.summary in JSON report
2016-04-15 14:53:54 -07:00
6321cec58e
fix formatting
2016-04-14 20:00:29 -07:00
453442eefb
fix formatting
2016-04-14 18:05:42 -07:00
969ffaf5c6
Enable JSON reports for qps drivers
2016-04-14 13:13:25 -07:00
f2ba7fe037
integrate ScenarioResult proto into qps driver
2016-04-14 13:13:25 -07:00
8f98e0b9dd
Add missing file
2016-04-11 23:39:12 -07:00
3ab2fe0094
Rollup of changes from the latest import
2016-04-11 20:11:18 -07:00
0bda0b3e55
Configure performance scenarios with json
...
Run those json configurations as part of presubmits
2016-04-06 10:14:44 -07:00
6169d5f7b0
Update copyrights
2016-03-31 07:46:18 -07:00
9533d042d4
Fix includes
2016-03-25 17:11:06 -07:00
f3d7638435
Merge pull request #5877 from vjpai/make_generic_payloads_great_again
...
Properly set server payload config in QPS tests
2016-03-25 16:26:39 -07:00
2e1903638e
Fix copyrights
2016-03-25 14:33:26 -07:00
f40df23eeb
Auto-changes
2016-03-25 13:38:14 -07:00
b830fb3a03
Merge branch 'master' into make_generic_payloads_great_again
2016-03-24 12:54:25 -07:00
a4942a012d
@jtattermusch correctly pointed out that we are not setting
...
payload config in our server config. This affect any generic server
tests that use anything other than 0-byte responses: essentially,
server-streaming or bidi throughput tests.
2016-03-21 12:44:02 -07:00
ca2886a05c
Made the code simpler to parse for humans
2016-03-21 12:04:18 -07:00
711766dc75
Ensure that no #includes are inside of a namespace.
2016-03-21 11:30:59 -07:00
847baf6fe0
clang-format and fix a typo caused by saving
2016-03-14 17:23:50 -07:00
63326281d7
1. Remove all deadlines from the RPCs and shutdown in this code.
...
These tests (especially unconstrained versions) can get very
backlogged and may take a while to finish. We sometimes flake waiting
for that. This is not hazardous (IMO), as the scripts that run these
tests already have timeouts to make sure that these don't truly go on
forever.
2. Make the time spent in the benchmark phase actually be
benchmark_seconds rather than benchmark_seconds-warmup_seconds
as it is currently.
2016-03-14 17:12:52 -07:00
2697f2141f
Merge branch 'master' into debug_qps_stream
2016-03-10 23:53:43 -08:00
baaf65546a
Fix formatting
2016-03-07 22:39:11 -08:00
710d58cfae
Disable profiling in qps_worker for now
2016-03-07 20:00:50 -08:00
2d9476898b
Revert "Ensure that no #includes are inside of a namespace."
2016-03-04 11:05:42 -08:00
2a8c280370
sanity
2016-03-02 20:52:34 -08:00
7d757ca29d
Ensure that no #includes are inside of a namespace.
2016-03-02 19:44:16 -08:00
c47c9497fa
clang-format
2016-02-26 14:39:59 -08:00
60a7e3336d
Finish clients fully before finishing servers
2016-02-26 10:30:17 -08:00
e7042b5ddf
Simplify Mark processing code
2016-02-25 20:28:05 -08:00
02eda41d21
Do stream operations in a more idiomatic way: Write, WritesDone, Read until fail, Finish
2016-02-25 19:43:57 -08:00
e2d39e08f9
Timer->UsageTimer consistently
2016-02-24 12:36:15 -08:00
86b258c462
Merge pull request #5388 from vjpai/bourne_again
...
Use traditional Bourne shell syntax for piping stdout and stderr
2016-02-24 10:29:22 -08:00
6483c32f7c
BSD platforms (such as Mac) are likely to have /bin/sh refer to traditional
...
Bourne shell syntax, not Bash syntax. Change "|&" to "2>&1 |" since that's the
traditional way to redirect stdout and stderr to a pipe
2016-02-24 09:29:12 -08:00
4ea4599a50
Merge github.com:grpc/grpc into naming-crisis
2016-02-23 17:13:38 -08:00
19fa540100
Fix copyrights
2016-02-23 08:19:39 -08:00
6541cabe9d
clang-fmt
2016-02-22 22:41:53 -08:00
732a875fe8
Add a sanity test for name aliasing
2016-02-22 15:59:19 -08:00
2d435b9178
Fix the slowdown factor
2016-02-19 00:42:08 -08:00
3b28872210
1. Adjust tsan/asan/msan slowdowns according to documentation
...
tsan documentation says 2-20x, so set it at 20x
asan documentation says 1.2-2.7x, so set it at 3x
msan documentation says 2-4x, so set it at 4x
This is now much less optimistic than before
2. Reactive tsan tests for qps_test
3. Set CPU load for qps_openloop_test
4. Divide qps_openloop_test Poisson rate by the slowdown factor of
the configuration
2016-02-19 00:28:28 -08:00
2815f184a3
Document variable names
2016-02-17 13:55:03 -08:00
8a2ff73640
Use more variables for better explanations
2016-02-17 09:21:10 -08:00
ed3cd423b6
Use three different load-factors and document load-factor variable
2016-02-17 08:49:03 -08:00
ee53dc5e08
Merge branch 'master' into loaded
2016-02-16 13:51:38 -08:00
e40aefb829
Fix the timeout
2016-02-13 01:25:30 -08:00
8ca0faaf52
use timeouts with proper fixture multipliers rather than raw,
...
since tsan slows things down a lot and may complicate issues such
as shutdown.
2016-02-13 00:25:45 -08:00
1a06082265
Add 70% load scenario for testing with open-loop
2016-02-12 17:34:08 -08:00
6583176337
clang-format
2016-02-12 15:59:03 -08:00
7914e62d48
Attack of the const police.
...
I also added some unrequested const's
2016-02-12 15:57:08 -08:00
761bcb4a18
Cleanup to make it work with clang build
2016-02-11 11:59:04 -08:00
914455782f
Sanity (clang-format and copyright)
2016-02-11 06:08:58 -08:00
1132c6b7db
Simplify and properly implement openloop testing.
...
Revive it in tests as well
2016-02-11 06:05:24 -08:00
9982c6fc3a
Fix random number generators and improve code style (stop using
...
operator overloads)
2016-02-10 14:55:33 -08:00
7a55684a13
Clang format and fix copyrights
2016-02-05 11:33:30 -08:00
bcfe99a547
Merge pull request #5008 from vjpai/worker_quit
...
Provide an RPC to quit the performance benchmarking workers
2016-02-04 16:32:03 -08:00
e4fdcd9242
Merge pull request #5013 from a-veitch/tag_set_to_context
...
Change all instances of census_tag_set to census_context
2016-02-04 12:42:35 -08:00
ed53c08238
Merge branch 'master' into worker_quit
2016-02-04 11:50:45 -08:00
9ded5dbf35
fix missed merge issue
2016-02-03 11:24:11 -08:00
7f1b65b8c6
Took out dependence on vector
2016-02-03 09:10:14 -08:00
574020edf1
Forgot to put this in the Mac version
2016-02-03 07:58:23 -08:00
ddb163a0e4
merge
2016-02-02 13:33:44 -08:00
2066443b7c
Function name changed on merge....
2016-02-02 11:48:12 -08:00
b47b556d33
Merge branch 'master' into worker_quit
2016-02-02 10:36:12 -08:00
2ed337aab3
clang-format
2016-02-02 09:43:35 -08:00
75d5c0f024
post merge
2016-02-02 09:43:02 -08:00
21e5d2b2f1
Add a Quit RPC so that we can conveniently shut down the workers from the driver.
2016-02-02 09:36:36 -08:00
daadcc8f74
at
2016-02-01 16:49:55 -08:00
33e51184fc
Address reviewer comments regarding const and shortage of comments
2016-02-01 16:40:06 -08:00
0d7a070e7e
Add core-limited scenario and protobuf-based QPS scenario
2016-02-01 14:10:47 -08:00
595674275b
Copyright and clang-format
2016-02-01 13:28:55 -08:00
6b05639ab1
Make sure that client limit is valid
2016-02-01 13:01:34 -08:00
7d45cdb60b
Enable properly working core limits on clients and servers,
...
and determine these dynamically if only one or the other is
specified but both are running on the same host
2016-02-01 13:00:19 -08:00
c5eec2be89
Make dynamic sizing of async threads work again
2016-02-01 09:46:30 -08:00
c64736d852
Clean-up core list usage and make it possible to reset the core list
2016-02-01 09:33:11 -08:00
03ba4d746a
Merge branch 'master' into corelimit2
2016-02-01 08:17:27 -08:00
5919e81ff1
Remove host option from ServerConfig proto since it is error-prone and
...
may cause inter-language confusion.
2016-01-29 01:24:05 -08:00
6c3de35d3d
Merge pull request #4775 from dgquintas/sync-async-plus-interfaces
...
Support mixing sync and async method in the same service + Separation of core from proto compiler output
2016-01-28 16:00:40 -08:00
269c4b98c5
Testing scenarios for various performance characteristics
2016-01-28 12:18:54 -08:00
6523391782
sanity fixes
2016-01-27 20:07:36 -08:00
b4e51b52bd
Merge branch 'master' of github.com:grpc/grpc into sync-async-plus-interfaces
2016-01-27 19:57:58 -08:00
5a9462339d
copyrights
2016-01-27 19:22:14 -08:00
16e45702ac
clang-format
2016-01-27 14:51:12 -08:00
1d71a0e084
Merge branch 'generic_qps' into dynamic_sizing2
2016-01-27 12:16:05 -08:00
36e7770101
Merge branch 'master' into generic_qps
2016-01-27 12:15:48 -08:00
7d8335f875
Don't log newlines
2016-01-27 12:00:41 -08:00
7a984f0e3a
Copyright
2016-01-27 11:24:57 -08:00
d02dd30a1f
Also dynamic sizing for num_clients on performance tests
2016-01-27 11:23:34 -08:00
32baa5e622
Allow dynamic sizing of async client and server thread pools
2016-01-27 10:01:41 -08:00
a24e9d774c
Sanity checks and asan fix
2016-01-27 09:45:29 -08:00
0c31b60805
Sanity failures (copyright, clang-format)
2016-01-27 09:03:18 -08:00
94aada9ee5
clang-format
2016-01-26 18:12:30 -08:00
020c2f36ac
Fix copyright
2016-01-26 18:11:22 -08:00
a091a23a7f
No need to put \n at end of a log message
2016-01-26 18:10:42 -08:00
a00f998089
Actually create async generic server
2016-01-26 17:51:35 -08:00
bdf4acbbfb
Properly state client name
2016-01-26 15:15:26 -08:00
0f14209061
Improve logging for test
2016-01-26 14:20:07 -08:00
57ecf766ab
clang-format
2016-01-26 12:42:48 -08:00
58da895a8c
localhost -> wildcard address
2016-01-26 10:57:07 -08:00
6a48405ed0
pre sync_stream.cc creation. Does not compile
2016-01-25 19:12:37 -08:00
826505cc8f
Merge branch 'master' of github.com:grpc/grpc into sync-async-plus-interfaces
2016-01-21 15:25:54 -08:00
f524844da9
Fix include guard
2016-01-19 15:34:14 -08:00
41859d025b
Added todo as a reminder to drive core selection automatically
2016-01-19 15:30:22 -08:00
4f5146dac2
Change name from coresched to limit_cores
2016-01-19 15:28:52 -08:00
4a0f8ea535
Merge branch 'sync_async_mix' of https://github.com/yang-g/grpc into yang-g-sync_async_mix
2016-01-19 14:51:55 -08:00
c833c82c08
Merge branch 'master' into corelimit2
2016-01-19 13:37:33 -08:00
861eb9f13a
Fix copyrights for sanity
2016-01-19 13:37:27 -08:00
2c42bb1d18
Copyright fixes for sanity
2016-01-19 13:02:42 -08:00
Craig Tiller