Commit Graph

886 Commits

Author SHA1 Message Date
Craig Tiller d41a4a720f s/gpr_slice/grpc_slice, and move around tests, impls 2016-10-26 16:16:06 -07:00
Yuxuan Li 1a9a0d8da8 fix logging problem 2016-10-26 11:12:16 -07:00
Yuxuan Li aa7411da04 minor fix for usage_timer.cc 2016-10-25 13:23:44 -07:00
Yuxuan Li 60d55f80c4 Change flag precision to flag stride, better description.
Add flag error_tolerence to define the search stopping criteria.
Move the equal condition in the binary search to smaller than condition.
Wrap get_cpu_usage(), so on non-linux platform, the compiler won't
complain and will get cpu usage to be 0.
2016-10-21 18:18:29 -07:00
Craig Tiller 8f67b647fd Merge github.com:grpc/grpc into buffer_pools_for_realsies 2016-10-20 15:53:04 -07:00
Craig Tiller afcc8752f3 clang-format 2016-10-18 16:10:06 -07:00
Vijay Pai d923583768 Minor cleanup - remove an unneeded header, mark a class final, explicitly specify parent class 2016-10-18 11:40:57 -07:00
Craig Tiller 20afa3d7c9 BufferPool --> ResourceQuota 2016-10-17 14:52:14 -07:00
Craig Tiller 654b242ce7 Merge branch 'direct-calls' into buffer_pools_for_realsies 2016-10-17 14:31:44 -07:00
Craig Tiller 14c836fcd1 Delambdaify 2016-10-17 13:56:13 -07:00
Craig Tiller b019d61f9a Fix benchmark shutdown 2016-10-17 13:23:51 -07:00
Craig Tiller c99945e44c Merge branch 'direct-calls' into buffer_pools_for_realsies 2016-10-10 10:20:48 -07:00
Craig Tiller fdc2b10dce Merge github.com:grpc/grpc into direct-calls 2016-10-10 10:16:35 -07:00
Mark D. Roth 70c0b32c0f Merge pull request #8219 from markdroth/fail_fast
Change C++ API to expose wait_for_ready instead of fail_fast.
2016-10-07 13:06:59 -07:00
Yuxuan Li c6c6cc269e change default values flags 2016-10-06 18:28:05 -07:00
Yuxuan Li 6a5b9924f3 resolve out_of_range error from stoi function. 2016-10-06 17:31:40 -07:00
Yuxuan Li 69c61319df change flags type, name according to the comments.
change binary search stride from 1 to FLAGS_precision
2016-10-06 17:00:48 -07:00
Yuxuan Li 77c18981c2 change binary search log info from GPR_INFO to GPR_DEBUG 2016-10-06 15:06:29 -07:00
Yuxuan Li c265a0ab02 clean up unnecessary new lines and logging. 2016-10-06 15:06:22 -07:00
Yuxuan Li 49aeb59389 clang-formated and latency_vs_load.cc is deleted as its functionality
has been merged into qps_json_driver.
2016-10-06 15:06:01 -07:00
Yuxuan Li d31c78c6f0 updated protobuf, merged latency_vs_load.cc(not deleted yet) and qps_json_driver.cc 2016-10-06 15:05:55 -07:00
Yuxuan Li 58977f1466 initial merge of latency vs load to qps_json_driver.cc 2016-10-06 15:05:50 -07:00
Yuxuan Li fe21ec90f6 batched changes 2016-10-06 15:05:29 -07:00
Craig Tiller 624f4ba76d Add missing delete 2016-10-06 11:56:54 -07:00
Craig Tiller 0895545a58 Complete reporting for failure rates 2016-09-29 11:01:14 -07:00
Craig Tiller 032f9bfb58 Start to log errors from benchmark 2016-09-29 10:10:00 -07:00
Craig Tiller 1a8c52e479 Collect stats on # failed requests 2016-09-28 17:28:04 -07:00
Craig Tiller 0c80c7d12c Collecting failure status progress 2016-09-28 16:30:55 -07:00
Mark D. Roth 5db24978b6 Merge remote-tracking branch 'upstream/master' into fail_fast 2016-09-28 13:21:31 -07:00
Craig Tiller f91af0001d Merge github.com:grpc/grpc into direct-calls 2016-09-28 11:00:12 -07:00
Mark D. Roth 9477724003 Change C++ API to expose wait_for_ready instead of fail_fast. 2016-09-27 13:07:00 -07:00
Craig Tiller af9da92a60 Dont run benchmarks outside of linux for now 2016-09-27 12:47:19 -07:00
Craig Tiller 91bb6241ab Reduce # of benchmarks run as Jenkins unit tests 2016-09-27 12:46:08 -07:00
Craig Tiller 5abf79a91b Merge github.com:grpc/grpc into direct-calls 2016-09-23 13:51:00 -07:00
yang-g e267f86c43 Properly init variable 2016-09-22 14:15:46 -07:00
Craig Tiller ba1db3b630 Merge github.com:grpc/grpc into direct-calls 2016-09-15 15:57:35 -07:00
Craig Tiller 9e1c2d2358 Dont start requests until all clients have gotten connected 2016-09-14 08:37:10 -07:00
Craig Tiller 531976a6d4 Add an initial mark that clients could use to delay startup of requests 2016-09-14 08:28:37 -07:00
Craig Tiller 44b12f9e23 clang-format 2016-09-08 10:06:14 -07:00
Craig Tiller cd1feaab30 Merge pull request #7816 from ctiller/benchmark-verbosity
Increase log verbosity for benchmark driver
2016-09-07 14:33:56 -07:00
Craig Tiller 0cb5a89d6f Merge branch 'benchmark-verbosity' into direct-calls 2016-09-07 14:25:38 -07:00
Craig Tiller bd37a21c26 Cleanup, debug support 2016-09-07 11:28:56 -07:00
Craig Tiller 8ef0eda856 Merge github.com:grpc/grpc into merge-parse 2016-08-22 11:39:08 -07:00
Craig Tiller daf4699652 Merge pull request #6732 from ctiller/consistent_client_count
Make client_channels be across all clients, not per-client
2016-08-22 08:34:38 -07:00
Craig Tiller 74a1d9a939 Increase log verbosity for benchmark driver 2016-08-22 08:33:02 -07:00
Craig Tiller 378ffd8cc3 Merge github.com:grpc/grpc into merge-parse 2016-08-18 13:03:23 -07:00
kpayson64 0c6cce12b4 Merge pull request #7648 from vjpai/qps_better_ptr
Use unique_ptr properly in QPS async tests
2016-08-15 13:02:44 -07:00
Craig Tiller ca04562286 Timing nuances 2016-08-09 08:38:03 -07:00
Vijay Pai f50020ce03 Appease the const gods, improve readability, stop using 0 and 1 as
proxies for false and true.
2016-08-08 07:29:31 -07:00
Vijay Pai d02988d6b5 clang-format 2016-08-05 09:47:47 -07:00
Vijay Pai 25128f1adf Better ending for open-loop tests: never wait more than 1 second
if we are in termination mode
2016-08-05 09:45:03 -07:00
Vijay Pai 773ecd62dd Dramatically reduce time required to complete sync test when running
with lots of threads (by parallelizing shutdown of course)
2016-08-05 09:26:56 -07:00
Vijay Pai 4f17395b81 Properly use unique_ptr rather than explicitly
deleting server context wrappers in QPS test
2016-08-05 01:32:34 -07:00
Vijay Pai 6e5c33c3e2 Don't assert if we're not able to set affinity for some reason 2016-07-30 02:56:46 -07:00
Craig Tiller ad94fdfe51 Fix compile error 2016-07-15 06:42:29 -07:00
Craig Tiller b23239b6d8 Merge branch 'histo' of github.com:vjpai/grpc into delayed-write 2016-07-15 06:37:41 -07:00
Craig Tiller 0a06cd7b68 Cleanup from code review 2016-07-14 13:21:24 -07:00
Vijay Pai 5fde20d9f0 clang-format 2016-07-13 19:25:59 -07:00
Vijay Pai 40317fd720 Resolve pernicious race between destructor and thread functions by insisting that destructor is invoked after the class has gone back to being a harmless single-threaded thing. 2016-07-13 19:20:25 -07:00
Craig Tiller 8da7b1f779 Fix some failures 2016-07-13 15:06:00 -07:00
Vijay Pai ad7c527618 Temporary workaround by setting up a deadline on server shutdown.
This reveals an issue that needs to be solved:
D0713 14:48:28.049861213   14503 server.c:704]               Waiting for 44 channels and 0/1 listeners to be destroyed before shutting down server
2016-07-13 14:51:44 -07:00
Vijay Pai a831651aa5 Unify and make consistent the per-thread shutdown process 2016-07-13 10:32:26 -07:00
Craig Tiller b5ee1cdcb9 Dont stall shutting down server 2016-07-13 08:39:35 -07:00
Craig Tiller 38fb8de100 get timeouts working on run_tests.py again 2016-07-13 08:23:32 -07:00
Craig Tiller e64d693050 Better fine-tuning 2016-07-12 20:53:16 -07:00
Craig Tiller 61e2040de0 Get json_run_localhost working again 2016-07-12 17:26:52 -07:00
Craig Tiller 72376da8ba Get json_run_localhost working again 2016-07-12 17:14:37 -07:00
Craig Tiller 9e3691c5bd Actually run json_run_localhost tests 2016-07-12 16:29:46 -07:00
Craig Tiller b19dbead67 Make request freelists per cq, to allow drastically higher requested call counts 2016-07-12 15:33:11 -07:00
Craig Tiller 1d03e100eb Ensure timely response to marks 2016-07-12 09:50:56 -07:00
Vijay Pai f782465fba Fix some shutdown errors related to CQ/join ordering 2016-07-08 10:33:10 -07:00
Vijay Pai aa8bbeb6c6 Merge branch 'verbose_errors' into histo 2016-07-08 09:41:59 -07:00
Vijay Pai f373f2cf8b Stop holding histogram for a long time 2016-07-08 09:40:55 -07:00
Craig Tiller fbf03c1735 Fix high seqno tests, up runtimes for benchmark tests to flush more bugs 2016-07-07 13:10:09 -07:00
Vijay Pai ceb1a7d79f Add more information so that we can have a meaningful exit code 2016-07-07 11:06:04 -07:00
vjpai b0f15e8af3 Reduce assertions, use status codes, increase verbosity on errors 2016-07-06 13:57:01 -07:00
Craig Tiller 346da5f346 Merge github.com:grpc/grpc into consistent_client_count 2016-06-28 14:09:08 -07:00
Craig Tiller 5b47ac385b Colocate calls for the same channel on the same CQ 2016-06-27 15:47:17 -07:00
Craig Tiller c074408bd3 Merge github.com:grpc/grpc into consistent_client_count 2016-06-23 11:57:26 -07:00
Craig Tiller 5856dee7d6 Fix compile 2016-06-22 16:30:22 -07:00
Craig Tiller 88a3e93f0d Better distribution 2016-06-22 08:18:07 -07:00
Craig Tiller 7e5d46496b Better distribution 2016-06-22 08:17:27 -07:00
Vijay Pai ddf694cc62 Merge branch 'master' into wheezy 2016-06-17 13:41:38 -07:00
Jan Tattermusch 3e45ed1c9a Merge pull request #6838 from vjpai/trigger_happy
Revert unneeded change in qps worker
2016-06-16 18:00:25 -07:00
Vijay Pai b31a9a0900 Include <cinttypes> for PRIuPTR. Not clear why this is needed. 2016-06-16 07:50:20 +00:00
Vijay Pai b9e927afcc Merge branch 'master' into wheezy 2016-06-15 22:57:21 -07:00
Vijay Pai 08e071abe0 Specify template parent explicitly 2016-06-15 10:58:15 -07:00
Yuchen Zeng 0ba114408e Fix gpr_log format mismatches in c++ tests 2016-06-10 15:15:44 -07:00
David Klempner e27d189f21 Factor out json seriailzation code and move it into parse_json.
This is for the same reasons as ParseJson, that is so that we can limit
the scope of the proto namespace differences between internal and
external.
2016-06-08 17:11:26 -07:00
vjpai 74e6e135e9 I was trigger-happy with changes to qps_worker in the hope of improving
stability. I believe that this change was unneeded and actually
may hurt matters by holding a lock for too long.
Partially undoes #5444 , particular commit e7042b5
2016-06-08 13:32:16 -07:00
yang-g aaee544d69 merge and resolve conflicts 2016-06-03 15:34:01 -07:00
yang-g 17487f9a22 Make grpc++ independent of protobuf 2016-06-03 15:21:15 -07:00
Craig Tiller d4aa7cf5a5 Fix negation 2016-05-31 13:59:25 -07:00
Craig Tiller 1adb13143f Add comment 2016-05-31 13:04:32 -07:00
Craig Tiller dbd03b5e2d Make client_channels be across all clients, not per-client 2016-05-31 13:00:33 -07:00
vjpai 711472f846 Remove unused gflags and gtest includes 2016-05-31 12:57:38 -07:00
vjpai d8364f7af5 Deprecate perf_db use 2016-05-31 12:54:04 -07:00
Craig Tiller e0ddc35aa3 Speed up tests 2016-05-23 15:57:48 -07:00
Craig Tiller 825cd4533c Cleanup redundant tests 2016-05-23 15:54:38 -07:00
Craig Tiller e67f7b6b54 Fix timeout on async server shutdown
Server was continuing to make requests for new calls forever, which were
starving out the shutdown sequence. Change order and win.
2016-05-23 14:50:24 -07:00
Craig Tiller c0cb23b885 Merge branch 'guess_cpu' into test_affine 2016-05-20 11:17:31 -07:00
Craig Tiller bd24a4611f Better guesses at benchmarks turned unit tests cpu cost 2016-05-20 11:15:58 -07:00
Craig Tiller c3b88b079e Better testing 2016-05-16 11:21:17 -07:00
Craig Tiller 52237e3a96 clang-format 2016-05-13 14:37:25 -07:00
Craig Tiller 63d24f1c7d Make qps workers connect before even warmup stage begins 2016-05-13 14:36:09 -07:00
Jan Tattermusch b85e9d43f0 fix formatting 2016-05-11 10:21:45 -07:00
Jan Tattermusch a21c7e9207 add support for scenario categories 2016-05-05 18:10:35 -07:00
Jan Tattermusch e88030a2c2 Merge pull request #6340 from ctiller/fail_fast_breaks_qps
Disable fail fast for qps driver
2016-05-02 14:26:52 -07:00
Craig Tiller 97244d5810 clang-format, make code more self-documenting 2016-04-29 08:05:57 -07:00
Craig Tiller 5c123fd22b Add a shard channel arg to client channel construction
C core automatically shares subchannels between channels. Therefore our
multiple channel performance tests were really testing single channel
performance.
2016-04-28 20:48:24 -07:00
Craig Tiller b6e4440880 Disable fail fast for qps driver 2016-04-28 08:21:52 -07:00
Nicolas Noble 241dea56c8 Merge pull request #6147 from ctiller/strong-includes
Rollup of changes from latest import
2016-04-21 18:59:06 -07:00
Craig Tiller 7beea147e5 Merge github.com:grpc/grpc into strong-includes 2016-04-21 17:07:36 -07:00
Vijay Pai dfdfe26958 Make sure that there is at least one scenario, otherwise indicates malformed
input
2016-04-21 11:38:31 -07:00
Vijay Pai 8909428a1a clang-format 2016-04-20 14:21:30 -07:00
vjpai 92abf1cfd4 Merge branch 'master' into qps_driver_youre_fired 2016-04-20 13:06:25 -07:00
vjpai 1f13c820ed Eliminate unused source file 2016-04-20 13:04:35 -07:00
vjpai 29089c7b41 Deprecation of qps_driver and use of shell scripts, in progress 2016-04-20 12:38:16 -07:00
vjpai 87bac959ee Eradicate Uniform, Deterministic, and Pareto interarrival
distributions since we don't use them and it's not sensible
to add them
2016-04-20 09:35:35 -07:00
Jan Tattermusch e9a8d89dc2 fix formatting 2016-04-15 15:38:17 -07:00
Jan Tattermusch 33c161dffa populate ScenarioResult.summary in JSON report 2016-04-15 14:53:54 -07:00
Jan Tattermusch 6321cec58e fix formatting 2016-04-14 20:00:29 -07:00
Jan Tattermusch 453442eefb fix formatting 2016-04-14 18:05:42 -07:00
Jan Tattermusch 969ffaf5c6 Enable JSON reports for qps drivers 2016-04-14 13:13:25 -07:00
Jan Tattermusch f2ba7fe037 integrate ScenarioResult proto into qps driver 2016-04-14 13:13:25 -07:00
Craig Tiller 8f98e0b9dd Add missing file 2016-04-11 23:39:12 -07:00
Craig Tiller 3ab2fe0094 Rollup of changes from the latest import 2016-04-11 20:11:18 -07:00
Craig Tiller 0bda0b3e55 Configure performance scenarios with json
Run those json configurations as part of presubmits
2016-04-06 10:14:44 -07:00
Craig Tiller 6169d5f7b0 Update copyrights 2016-03-31 07:46:18 -07:00
Craig Tiller 9533d042d4 Fix includes 2016-03-25 17:11:06 -07:00
Jan Tattermusch f3d7638435 Merge pull request #5877 from vjpai/make_generic_payloads_great_again
Properly set server payload config in QPS tests
2016-03-25 16:26:39 -07:00
Craig Tiller 2e1903638e Fix copyrights 2016-03-25 14:33:26 -07:00
Craig Tiller f40df23eeb Auto-changes 2016-03-25 13:38:14 -07:00
Vijay Pai b830fb3a03 Merge branch 'master' into make_generic_payloads_great_again 2016-03-24 12:54:25 -07:00
vjpai a4942a012d @jtattermusch correctly pointed out that we are not setting
payload config in our server config. This affect any generic server
tests that use anything other than 0-byte responses: essentially,
server-streaming or bidi throughput tests.
2016-03-21 12:44:02 -07:00
David Garcia Quintas ca2886a05c Made the code simpler to parse for humans 2016-03-21 12:04:18 -07:00
David Garcia Quintas 711766dc75 Ensure that no #includes are inside of a namespace. 2016-03-21 11:30:59 -07:00
Vijay Pai 847baf6fe0 clang-format and fix a typo caused by saving 2016-03-14 17:23:50 -07:00
vjpai 63326281d7 1. Remove all deadlines from the RPCs and shutdown in this code.
These tests (especially unconstrained versions) can get very
   backlogged and may take a while to finish. We sometimes flake waiting
   for that. This is not hazardous (IMO), as the scripts that run these
   tests already have timeouts to make sure that these don't truly go on
   forever.

2. Make the time spent in the benchmark phase actually be
   benchmark_seconds rather than benchmark_seconds-warmup_seconds
   as it is currently.
2016-03-14 17:12:52 -07:00
vjpai 2697f2141f Merge branch 'master' into debug_qps_stream 2016-03-10 23:53:43 -08:00
Craig Tiller baaf65546a Fix formatting 2016-03-07 22:39:11 -08:00
Craig Tiller 710d58cfae Disable profiling in qps_worker for now 2016-03-07 20:00:50 -08:00
Craig Tiller 2d9476898b Revert "Ensure that no #includes are inside of a namespace." 2016-03-04 11:05:42 -08:00
David Garcia Quintas 2a8c280370 sanity 2016-03-02 20:52:34 -08:00
David Garcia Quintas 7d757ca29d Ensure that no #includes are inside of a namespace. 2016-03-02 19:44:16 -08:00
Vijay Pai c47c9497fa clang-format 2016-02-26 14:39:59 -08:00
vjpai 60a7e3336d Finish clients fully before finishing servers 2016-02-26 10:30:17 -08:00
vjpai e7042b5ddf Simplify Mark processing code 2016-02-25 20:28:05 -08:00
Vijay Pai 02eda41d21 Do stream operations in a more idiomatic way: Write, WritesDone, Read until fail, Finish 2016-02-25 19:43:57 -08:00
vjpai e2d39e08f9 Timer->UsageTimer consistently 2016-02-24 12:36:15 -08:00
Nicolas Noble 86b258c462 Merge pull request #5388 from vjpai/bourne_again
Use traditional Bourne shell syntax for piping stdout and stderr
2016-02-24 10:29:22 -08:00
vjpai 6483c32f7c BSD platforms (such as Mac) are likely to have /bin/sh refer to traditional
Bourne shell syntax, not Bash syntax. Change "|&" to "2>&1 |" since that's the
traditional way to redirect stdout and stderr to a pipe
2016-02-24 09:29:12 -08:00
Craig Tiller 4ea4599a50 Merge github.com:grpc/grpc into naming-crisis 2016-02-23 17:13:38 -08:00
Craig Tiller 19fa540100 Fix copyrights 2016-02-23 08:19:39 -08:00
Craig Tiller 6541cabe9d clang-fmt 2016-02-22 22:41:53 -08:00
Craig Tiller 732a875fe8 Add a sanity test for name aliasing 2016-02-22 15:59:19 -08:00
Vijay Pai 2d435b9178 Fix the slowdown factor 2016-02-19 00:42:08 -08:00
Vijay Pai 3b28872210 1. Adjust tsan/asan/msan slowdowns according to documentation
tsan documentation says 2-20x, so set it at 20x
asan documentation says 1.2-2.7x, so set it at 3x
msan documentation says 2-4x, so set it at 4x
This is now much less optimistic than before

2. Reactive tsan tests for qps_test
3. Set CPU load for qps_openloop_test
4. Divide qps_openloop_test Poisson rate by the slowdown factor of
   the configuration
2016-02-19 00:28:28 -08:00
Vijay Pai 2815f184a3 Document variable names 2016-02-17 13:55:03 -08:00
Vijay Pai 8a2ff73640 Use more variables for better explanations 2016-02-17 09:21:10 -08:00
Vijay Pai ed3cd423b6 Use three different load-factors and document load-factor variable 2016-02-17 08:49:03 -08:00
Vijay Pai ee53dc5e08 Merge branch 'master' into loaded 2016-02-16 13:51:38 -08:00
Vijay Pai e40aefb829 Fix the timeout 2016-02-13 01:25:30 -08:00
Vijay Pai 8ca0faaf52 use timeouts with proper fixture multipliers rather than raw,
since tsan slows things down a lot and may complicate issues such
as shutdown.
2016-02-13 00:25:45 -08:00
Vijay Pai 1a06082265 Add 70% load scenario for testing with open-loop 2016-02-12 17:34:08 -08:00
Vijay Pai 6583176337 clang-format 2016-02-12 15:59:03 -08:00
vjpai 7914e62d48 Attack of the const police.
I also added some unrequested const's
2016-02-12 15:57:08 -08:00
Vijay Pai 761bcb4a18 Cleanup to make it work with clang build 2016-02-11 11:59:04 -08:00
Vijay Pai 914455782f Sanity (clang-format and copyright) 2016-02-11 06:08:58 -08:00
Vijay Pai 1132c6b7db Simplify and properly implement openloop testing.
Revive it in tests as well
2016-02-11 06:05:24 -08:00
Vijay Pai 9982c6fc3a Fix random number generators and improve code style (stop using
operator overloads)
2016-02-10 14:55:33 -08:00
murgatroid99 7a55684a13 Clang format and fix copyrights 2016-02-05 11:33:30 -08:00
Michael Lumish bcfe99a547 Merge pull request #5008 from vjpai/worker_quit
Provide an RPC to quit the performance benchmarking workers
2016-02-04 16:32:03 -08:00
Bogdan Drutu e4fdcd9242 Merge pull request #5013 from a-veitch/tag_set_to_context
Change all instances of census_tag_set to census_context
2016-02-04 12:42:35 -08:00
vjpai ed53c08238 Merge branch 'master' into worker_quit 2016-02-04 11:50:45 -08:00
Alistair Veitch 9ded5dbf35 fix missed merge issue 2016-02-03 11:24:11 -08:00
vjpai 7f1b65b8c6 Took out dependence on vector 2016-02-03 09:10:14 -08:00
vjpai 574020edf1 Forgot to put this in the Mac version 2016-02-03 07:58:23 -08:00
Alistair Veitch ddb163a0e4 merge 2016-02-02 13:33:44 -08:00
Vijay Pai 2066443b7c Function name changed on merge.... 2016-02-02 11:48:12 -08:00
Vijay Pai b47b556d33 Merge branch 'master' into worker_quit 2016-02-02 10:36:12 -08:00
Vijay Pai 2ed337aab3 clang-format 2016-02-02 09:43:35 -08:00
Alistair Veitch 75d5c0f024 post merge 2016-02-02 09:43:02 -08:00
vjpai 21e5d2b2f1 Add a Quit RPC so that we can conveniently shut down the workers from the driver. 2016-02-02 09:36:36 -08:00
Vijay Pai daadcc8f74 at 2016-02-01 16:49:55 -08:00
Vijay Pai 33e51184fc Address reviewer comments regarding const and shortage of comments 2016-02-01 16:40:06 -08:00
Vijay Pai 0d7a070e7e Add core-limited scenario and protobuf-based QPS scenario 2016-02-01 14:10:47 -08:00
Vijay Pai 595674275b Copyright and clang-format 2016-02-01 13:28:55 -08:00
Vijay Pai 6b05639ab1 Make sure that client limit is valid 2016-02-01 13:01:34 -08:00
Vijay Pai 7d45cdb60b Enable properly working core limits on clients and servers,
and determine these dynamically if only one or the other is
specified but both are running on the same host
2016-02-01 13:00:19 -08:00
Vijay Pai c5eec2be89 Make dynamic sizing of async threads work again 2016-02-01 09:46:30 -08:00
Vijay Pai c64736d852 Clean-up core list usage and make it possible to reset the core list 2016-02-01 09:33:11 -08:00
Vijay Pai 03ba4d746a Merge branch 'master' into corelimit2 2016-02-01 08:17:27 -08:00
Vijay Pai 5919e81ff1 Remove host option from ServerConfig proto since it is error-prone and
may cause inter-language confusion.
2016-01-29 01:24:05 -08:00
Craig Tiller 6c3de35d3d Merge pull request #4775 from dgquintas/sync-async-plus-interfaces
Support mixing sync and async method in the same service + Separation of core from proto compiler output
2016-01-28 16:00:40 -08:00
Vijay Pai 269c4b98c5 Testing scenarios for various performance characteristics 2016-01-28 12:18:54 -08:00
David Garcia Quintas 6523391782 sanity fixes 2016-01-27 20:07:36 -08:00
David Garcia Quintas b4e51b52bd Merge branch 'master' of github.com:grpc/grpc into sync-async-plus-interfaces 2016-01-27 19:57:58 -08:00
David Garcia Quintas 5a9462339d copyrights 2016-01-27 19:22:14 -08:00
Vijay Pai 16e45702ac clang-format 2016-01-27 14:51:12 -08:00
Vijay Pai 1d71a0e084 Merge branch 'generic_qps' into dynamic_sizing2 2016-01-27 12:16:05 -08:00
Vijay Pai 36e7770101 Merge branch 'master' into generic_qps 2016-01-27 12:15:48 -08:00
Vijay Pai 7d8335f875 Don't log newlines 2016-01-27 12:00:41 -08:00
Vijay Pai 7a984f0e3a Copyright 2016-01-27 11:24:57 -08:00
Vijay Pai d02dd30a1f Also dynamic sizing for num_clients on performance tests 2016-01-27 11:23:34 -08:00
Vijay Pai 32baa5e622 Allow dynamic sizing of async client and server thread pools 2016-01-27 10:01:41 -08:00
vjpai a24e9d774c Sanity checks and asan fix 2016-01-27 09:45:29 -08:00
vjpai 0c31b60805 Sanity failures (copyright, clang-format) 2016-01-27 09:03:18 -08:00
vjpai 94aada9ee5 clang-format 2016-01-26 18:12:30 -08:00
vjpai 020c2f36ac Fix copyright 2016-01-26 18:11:22 -08:00
vjpai a091a23a7f No need to put \n at end of a log message 2016-01-26 18:10:42 -08:00
vjpai a00f998089 Actually create async generic server 2016-01-26 17:51:35 -08:00
Vijay Pai bdf4acbbfb Properly state client name 2016-01-26 15:15:26 -08:00
Vijay Pai 0f14209061 Improve logging for test 2016-01-26 14:20:07 -08:00
Vijay Pai 57ecf766ab clang-format 2016-01-26 12:42:48 -08:00
Vijay Pai 58da895a8c localhost -> wildcard address 2016-01-26 10:57:07 -08:00
David Garcia Quintas 6a48405ed0 pre sync_stream.cc creation. Does not compile 2016-01-25 19:12:37 -08:00
David Garcia Quintas 826505cc8f Merge branch 'master' of github.com:grpc/grpc into sync-async-plus-interfaces 2016-01-21 15:25:54 -08:00
vjpai f524844da9 Fix include guard 2016-01-19 15:34:14 -08:00
vjpai 41859d025b Added todo as a reminder to drive core selection automatically 2016-01-19 15:30:22 -08:00
vjpai 4f5146dac2 Change name from coresched to limit_cores 2016-01-19 15:28:52 -08:00
David Garcia Quintas 4a0f8ea535 Merge branch 'sync_async_mix' of https://github.com/yang-g/grpc into yang-g-sync_async_mix 2016-01-19 14:51:55 -08:00
vjpai c833c82c08 Merge branch 'master' into corelimit2 2016-01-19 13:37:33 -08:00
vjpai 861eb9f13a Fix copyrights for sanity 2016-01-19 13:37:27 -08:00
vjpai 2c42bb1d18 Copyright fixes for sanity 2016-01-19 13:02:42 -08:00
vjpai cd624d2eee Dealt with a nit 2016-01-19 11:40:10 -08:00
Vijay Pai d3ea2708cc Re-enable explicit specification of server port for qps worker. Also
add in a check that we don't try to use generic testing for sync or unary.
2016-01-19 10:59:42 -08:00
vjpai f6269a4dca Merge branch 'master' into corelimit2 2016-01-19 08:01:47 -08:00
vjpai caace811b4 Fix asan error caused by mismatch in alloc/dealloc between new[] and
regular delete...
2016-01-18 22:15:55 -08:00
yang-g 8053d2feb6 Merge remote-tracking branch 'upstream/master' into sync_async_mix 2016-01-15 08:53:15 -08:00
David Garcia Quintas 2bf574f814 Added back trailing newlines 2016-01-14 15:55:03 -08:00
yang-g b9a1377fab Merge remote-tracking branch 'upstream/master' into sync_async_mix 2016-01-14 09:50:48 -08:00
Craig Tiller 754bd26e28 clang-format code 2016-01-14 06:10:15 -08:00
murgatroid99 eeb02ba77a Update copyrights again 2016-01-13 20:43:33 -08:00
yang-g d42262e22e merge with head 2016-01-13 15:32:51 -08:00
Vijay Pai b9a8f1ba39 Merge branch 'master' into corelimit2 2016-01-13 13:29:41 -08:00
Vijay Pai 3448c27275 clang-format 2016-01-13 11:17:13 -08:00
Vijay Pai 0e66efdadd Make core limitation work for both client and server so that we can run tests on the same
machine if desired. The core_list flags to qps_driver are comma-separated lists of
core numbers.
2016-01-13 11:15:49 -08:00
yang-g dc548ed65d merge with head 2016-01-13 10:42:19 -08:00
Vijay Pai 5bd6f2e190 Merge branch 'master' into bbuf 2016-01-11 10:33:39 -08:00
Vijay Pai b30bc2aad6 Remove dead code and a thus unneeded change to C++ bbuf 2016-01-11 10:11:50 -08:00
Vijay Pai 78268212ba clang-format 2016-01-11 09:55:02 -08:00
Vijay Pai af2e1cf080 Fix bugs and include build files 2016-01-11 09:54:23 -08:00
vjpai 083dc62cf6 Generic test 2016-01-11 09:41:17 -08:00
Vijay Pai 9f991e252d More changes needed for generic support 2016-01-07 14:08:09 -08:00
Craig Tiller 15f383c6cc Exploratory refactoring for mixed sync/async methods on the same C++ service 2016-01-07 12:45:32 -08:00
Vijay Pai 31c0c7949f clang-format 2016-01-07 11:43:46 -08:00
vjpai de332dfcac Refactor server side to support generic tests. 2016-01-07 10:20:46 -08:00
Vijay Pai 18c0477528 Got rid of all compilation problems, now need to test 2016-01-04 09:52:10 -08:00
Vijay Pai e488668075 WIP 2015-12-30 11:56:19 -08:00
Craig Tiller 1b4e33029e Consolidate C++ proto files under src/proto
- make the directory structure match the package structure
- sanitize the package structure (test --> testing)
- add auto-detection of proto file dependencies
2015-12-17 16:35:00 -08:00
vjpai 594f0c43e0 Merge branch 'master' into bbuf 2015-11-30 15:53:49 -08:00
vjpai b6df94ad22 WIP 2015-11-30 15:52:50 -08:00
yang-g 3ff9727a37 merge with head 2015-11-20 17:01:57 -08:00
David G. Quintas 6d8063261b Merge pull request #4097 from ctiller/hpack_max_table_size
Support dynamic HPACK table resizing
2015-11-19 09:56:25 -08:00
Jan Tattermusch 846ae8d9c2 Merge pull request #4156 from jtattermusch/perf_testing_polishing
Performance proto polishing
2015-11-19 09:51:54 -08:00
Jan Tattermusch c5ebbd5b8f use new perf proto options in c++ 2015-11-18 17:17:34 -08:00
Craig Tiller ab5611da62 Merge github.com:grpc/grpc into hpack_max_table_size 2015-11-18 11:27:35 -08:00
Julien Boeuf 6049ebd8d2 More C++ fixes (the merge did not quite work...). 2015-11-17 16:53:52 -08:00
Julien Boeuf 9a437c2c46 Forgot to fix driver.cc somehow... 2015-11-17 16:38:52 -08:00
Julien Boeuf 675b5ce861 Merge branch 'master' of github.com:grpc/grpc into core_creds_api_change 2015-11-17 15:05:45 -08:00
Craig Tiller 3c53bb2f46 clang-format 2015-11-10 14:24:36 +00:00
vjpai fba20c987d Address some review comments about signal and restoring qps_test_with_poll
Make payloads respect the new defaults
2015-11-04 14:49:17 -08:00
vjpai 3affdddf5b Add secure testing to sweep 2015-11-04 13:13:25 -08:00
vjpai f8603adba1 Secure performance testing for C++ is in the hizzouse! 2015-11-04 12:49:33 -08:00
vjpai 454074369e Better reasonable default 2015-11-04 08:33:49 -08:00
vjpai 783c144afa Fix up single run test
Enable reasonable default if resp size not specified
2015-11-04 08:29:33 -08:00
Vijay Pai ce84670628 clang-format 2015-11-04 00:30:12 -08:00
vjpai 780a7f205d Add in security support, make payload protos configurable
Have not yet added tests with security support, coming soon
2015-11-04 00:19:09 -08:00
vjpai d08a738166 Cleanup some names
Remove some unused options and make server_threads relevant
Start stubbing out better qps/core calculations
2015-11-02 16:45:08 -08:00
vjpai aa39192d70 Cleanup directory and make minor changes 2015-11-02 14:46:04 -08:00
vjpai 72a6332138 QPS worker no longer needs to specify server port on command line. This is part
of the proto if desired, or just goes to pick_unused_port_or_die if not
specified
2015-10-29 02:23:11 -07:00
vjpai 119c103ab0 Split up into a new service proto, use proper service suffix, add a
reset option to the mark, create a closed loop config params (empty
message) for consistency with other tests.
2015-10-29 01:21:04 -07:00
vjpai 754751e3c6 Numerous proto changes to make things more sane and fix some outstanding issues 2015-10-28 09:16:22 -07:00
vjpai 52bfb2564f Split qpstest.proto into two parts - one for performance stats and
one for control.
Eliminate the use of our own SimpleRequest and SimpleResponse and
instead share the one from end2end testing
2015-10-21 07:50:49 -07:00
vjpai 0cc1341199 Move qpstest.proto to a common area (test/proto) instead of test/cpp/qps 2015-10-19 12:21:45 -07:00
Julien Boeuf 3bb61d8917 Merge branch 'master' of https://github.com/grpc/grpc into core_creds_api_change 2015-10-17 22:14:29 -07:00
Julien Boeuf e5adc0eb67 Fixing Cpp tests. 2015-10-12 14:09:13 -07:00
Craig Tiller 2b15f1e25a Merge github.com:grpc/grpc into latent-see 2015-10-09 17:07:56 -07:00
Craig Tiller 0ba432d445 Move profiling system to gpr 2015-10-09 16:57:11 -07:00
Craig Tiller 1f41b6b5ed Simplify adding annotations, annotate more things 2015-10-09 15:07:02 -07:00
Craig Tiller 86253ca1da Latency traces 2015-10-08 13:31:02 -07:00
Craig Tiller b17b7f4871 Add a timeout to benchmark test runs 2015-10-07 08:48:51 -07:00
Craig Tiller 71a0f9d3b0 Fix clang-format script 2015-09-28 17:22:01 -07:00
Craig Tiller 8cf0ed03d1 Fix mac build 2015-09-10 22:37:25 -07:00
Craig Tiller 138de60a1e Merge pull request #3174 from vjpai/shutitdown2
Put timeout on QPS test server shutdown
2015-09-10 21:56:37 -07:00
Nicolas "Pixel" Noble 59588c6162 Removing pessimizing moves.
Pass #2.
2015-09-03 02:29:30 +02:00
vjpai d514b21cc8 Put timeout on server shutdown 2015-08-31 16:27:35 -07:00
Craig Tiller 1ebb7c885e Hand-written changes 2015-08-31 15:53:36 -07:00
Julien Boeuf 5be92a316d Shuffling headers around. 2015-08-28 16:28:18 -07:00
yang-g 730055d962 implementation fix 2015-08-27 12:29:45 -07:00
yang-g 3e4bd9598b merge with head 2015-08-24 15:54:07 -07:00
Vijay Pai e8a7e30a75 Eliminate public thread-pool interface 2015-08-24 10:52:33 -07:00
yang-g 9e2f90cd06 headers reorg 2015-08-21 15:35:03 -07:00
yang-g 8c2be9f228 Remove ChannelInterface and replace it with Channel 2015-08-19 16:28:09 -07:00
Craig Tiller d6c98df792 clang-format all source 2015-08-18 09:33:44 -07:00
Vijay Pai 3ae11042fd clang-format 2015-08-11 22:43:14 -07:00
vjpai b1db869e1a Address concerns from review 2015-08-11 22:41:02 -07:00
Vijay Pai ad3e00c220 Stop using a variable-sized array since that's not standards-compliant 2015-08-07 17:21:08 +00:00
Vijay Pai 90e7369484 clang-format plus helpful comments 2015-08-05 19:15:36 -07:00
Vijay Pai eed63fa267 Remaining changes needed to get QPS test working on old compilers.
This change contains a lot of ugly changes, such as changing
std::vector to allocation by new, etc.
2015-08-05 23:08:34 +00:00
Vijay Pai bc78c2069c Eliminate use of this_thread::sleep_until 2015-07-31 11:24:06 -07:00
Vijay Pai 784005b4a2 Eliminate lambda used as CV predicate 2015-07-31 10:53:42 -07:00
Vijay Pai 458faa98ce Eliminate user of lambda in server definition 2015-07-31 10:30:13 -07:00
Vijay Pai 4d06e2eae9 Eliminate use of lambdas in ResourceUsage processing functions...
Introduce simple getters instead.
2015-07-31 10:20:42 -07:00
Vijay Pai ab1dba72dc clang-format 2015-07-31 09:09:09 -07:00
vjpai 09d0b0cf47 Remove lambdas from state machine functions 2015-07-31 08:39:54 -07:00
vjpai e88bb07895 Switch a push_back to emplace_back to avoid being interpreted
as a copy constructor
2015-07-31 08:39:31 -07:00
vjpai a9e08303d7 Remove lambda from client definition 2015-07-31 07:55:06 -07:00
vjpai 51b48176ca Merge branch 'master' into asklipion 2015-07-31 07:34:47 -07:00
Craig Tiller 94fad8119e Tune down number of channels for qps_test 2015-07-30 07:55:02 -07:00
vjpai 582c687b4c Remove use of C++11 randomization engines 2015-07-27 16:39:28 -07:00
Yang Gao 2a31304d7f Merge pull request #2647 from vjpai/deepend
Dynamic-sized thread pool
2015-07-24 23:08:27 -07:00
Vijay Pai d2a9b6da13 Isolate nullptr to grpc namespace when we must define it ourselves
Change the one non-namespace use of nullptr to NULL (used as an
argument to a C function anyway)
2015-07-25 00:56:33 +00:00
Vijay Pai 1f3e6c1ebe Start switching everything to dynamic pool 2015-07-23 16:18:21 -07:00
Craig Tiller 0dc5e6cf16 User agent string support 2015-07-18 20:39:34 -07:00
Vijay Pai f87a0984ab Merge pull request #2470 from ctiller/i-want-to-wait-free
Lock free requested call fulfillment path
2015-07-17 16:05:28 -07:00
Craig Tiller c9fef6f521 Merge github.com:grpc/grpc into no-worries-i-can-wait 2015-07-17 14:41:12 -07:00
Craig Tiller af26143b6f Merge github.com:grpc/grpc into i-want-to-wait-free 2015-07-17 14:36:45 -07:00
vjpai a2e1bb1577 Change name of thread_pool files to fixed_size_thread_pool when
appropriate
2015-07-15 16:49:49 -07:00
Vijay Pai 69f2410086 Make thread_pool.h a public header
Rename ThreadPool -> FixedSizeThreadPool to allow for later introduction
of DynamicSizeThreadPool
2015-07-15 12:33:37 -07:00
Craig Tiller ca83dc8109 Adjust oustanding request count to meet new server algorithm 2015-07-15 11:43:26 -07:00
Craig Tiller 677c50c92a Update C++ impl 2015-07-13 10:49:06 -07:00
Vijay Pai d1c9254029 Merge pull request #2289 from ctiller/footprints-on-the-sands-of-time
Introduce multiple clocks to GPR
2015-07-10 16:43:58 -07:00
Craig Tiller 2c3a35e5cf Make naming a little more consistent 2015-07-10 14:06:00 -07:00
Craig Tiller 547fed4e8b Merge github.com:grpc/grpc into footprints-on-the-sands-of-time
Conflicts:
	src/core/channel/client_setup.c
	src/core/surface/init.c
2015-07-07 13:52:53 -07:00
Yang Gao d426864934 Merge pull request #2279 from vjpai/openleaks
qps_test memory leak elimination: delete spare contexts lying around at the end of test
2015-07-06 13:34:25 -07:00
Craig Tiller a368bd26d1 Merge github.com:grpc/grpc into footprints-on-the-sands-of-time 2015-07-06 11:04:14 -07:00
Craig Tiller 20b5fe9282 Fixup C++ 2015-07-06 10:43:50 -07:00
Vijay Pai 775eaec770 Merge pull request #2151 from sidrakesh93/master
Changes required for reporting metrics to performance database server
2015-07-06 10:13:59 -07:00
Craig Tiller 27df2cf69c Pluck some low hanging concurrency fruit
Make the shutdown flag on servers be per thread to save contention on
the lock that must guard it.
2015-07-01 15:11:29 -07:00
Vijay Pai 13735d5d7e if->while 2015-07-01 14:00:08 -07:00
Vijay Pai 5606199585 Delete spare contexts lying around at the end of the test to avoid
showing up as memory leaks

Also reduce the rate of the openloop test - this may be an issue with
sanitizers particularly because of issue #2278
2015-07-01 13:39:48 -07:00
Vijay Pai e2980cd0b3 Eliminate data-race caused by specialization in vector<bool> 2015-07-01 09:38:20 -07:00
Siddharth Rakesh a90c81ea61 Removing this pointers 2015-06-30 20:29:35 -07:00
Siddharth Rakesh fd1a20a667 Changes introduced for passing hashed user id instead of access token 2015-06-30 16:38:32 -07:00
Siddharth Rakesh 872e8187c2 Adding required changes 2015-06-29 13:06:25 -07:00
Siddharth Rakesh 268e59063a Adding required changes 2015-06-29 12:20:43 -07:00
Vijay Pai d4bfa95d3c Merge pull request #2169 from ctiller/no-spam-for-you
Remove spammy line (this is obfuscating testing logs)
2015-06-29 10:26:48 -07:00
Craig Tiller f75fc12e3a Add a test that headers are properly in build.json
Clean up anything that failed
2015-06-25 06:58:00 -07:00
Siddharth Rakesh 7b34d3afa7 Merge branch 'master' of https://github.com/sidrakesh93/grpc 2015-06-23 16:35:18 -07:00
Siddharth Rakesh df77c580dc Added support for passing a tag with the test 2015-06-23 16:34:18 -07:00
Craig Tiller 0960875b06 Remove spammy line (this is obfuscating testing logs) 2015-06-22 14:32:31 -07:00
sidrakesh93 ca241639c6 Update perf_db_client.cc 2015-06-22 14:26:41 -07:00
Siddharth Rakesh a4de070c69 Further corrections to syntax 2015-06-22 13:05:26 -07:00
Siddharth Rakesh 60111c0df8 updated syntax based errors 2015-06-22 13:02:33 -07:00
Siddharth Rakesh 4364546668 Applied required modifications 2015-06-22 12:21:57 -07:00
Siddharth Rakesh f39e7c0a0f Merge branch 'master' of https://github.com/grpc/grpc 2015-06-22 11:36:30 -07:00
Siddharth Rakesh 373ad4d0d0 edited report 2015-06-22 11:36:17 -07:00
Vijay Pai 40c9481e4a Merge pull request #2136 from dgquintas/unconst-reporter
Removed const-ness from Reporter interface methods
2015-06-22 09:08:05 -07:00