Commit Graph

144 Commits

Author SHA1 Message Date
Craig Tiller 74a1d9a939 Increase log verbosity for benchmark driver 2016-08-22 08:33:02 -07:00
Craig Tiller ca04562286 Timing nuances 2016-08-09 08:38:03 -07:00
Vijay Pai 5fde20d9f0 clang-format 2016-07-13 19:25:59 -07:00
Vijay Pai ceb1a7d79f Add more information so that we can have a meaningful exit code 2016-07-07 11:06:04 -07:00
vjpai b0f15e8af3 Reduce assertions, use status codes, increase verbosity on errors 2016-07-06 13:57:01 -07:00
Craig Tiller c074408bd3 Merge github.com:grpc/grpc into consistent_client_count 2016-06-23 11:57:26 -07:00
Craig Tiller 5856dee7d6 Fix compile 2016-06-22 16:30:22 -07:00
Craig Tiller 88a3e93f0d Better distribution 2016-06-22 08:18:07 -07:00
Craig Tiller 7e5d46496b Better distribution 2016-06-22 08:17:27 -07:00
Vijay Pai b31a9a0900 Include <cinttypes> for PRIuPTR. Not clear why this is needed. 2016-06-16 07:50:20 +00:00
Yuchen Zeng 0ba114408e Fix gpr_log format mismatches in c++ tests 2016-06-10 15:15:44 -07:00
Craig Tiller d4aa7cf5a5 Fix negation 2016-05-31 13:59:25 -07:00
Craig Tiller 1adb13143f Add comment 2016-05-31 13:04:32 -07:00
Craig Tiller dbd03b5e2d Make client_channels be across all clients, not per-client 2016-05-31 13:00:33 -07:00
vjpai 711472f846 Remove unused gflags and gtest includes 2016-05-31 12:57:38 -07:00
Craig Tiller b6e4440880 Disable fail fast for qps driver 2016-04-28 08:21:52 -07:00
Jan Tattermusch e9a8d89dc2 fix formatting 2016-04-15 15:38:17 -07:00
Jan Tattermusch 33c161dffa populate ScenarioResult.summary in JSON report 2016-04-15 14:53:54 -07:00
Jan Tattermusch f2ba7fe037 integrate ScenarioResult proto into qps driver 2016-04-14 13:13:25 -07:00
Craig Tiller 6169d5f7b0 Update copyrights 2016-03-31 07:46:18 -07:00
Craig Tiller 9533d042d4 Fix includes 2016-03-25 17:11:06 -07:00
Vijay Pai 847baf6fe0 clang-format and fix a typo caused by saving 2016-03-14 17:23:50 -07:00
vjpai 63326281d7 1. Remove all deadlines from the RPCs and shutdown in this code.
These tests (especially unconstrained versions) can get very
   backlogged and may take a while to finish. We sometimes flake waiting
   for that. This is not hazardous (IMO), as the scripts that run these
   tests already have timeouts to make sure that these don't truly go on
   forever.

2. Make the time spent in the benchmark phase actually be
   benchmark_seconds rather than benchmark_seconds-warmup_seconds
   as it is currently.
2016-03-14 17:12:52 -07:00
vjpai 60a7e3336d Finish clients fully before finishing servers 2016-02-26 10:30:17 -08:00
Vijay Pai 02eda41d21 Do stream operations in a more idiomatic way: Write, WritesDone, Read until fail, Finish 2016-02-25 19:43:57 -08:00
Vijay Pai e40aefb829 Fix the timeout 2016-02-13 01:25:30 -08:00
Vijay Pai 8ca0faaf52 use timeouts with proper fixture multipliers rather than raw,
since tsan slows things down a lot and may complicate issues such
as shutdown.
2016-02-13 00:25:45 -08:00
Vijay Pai 2066443b7c Function name changed on merge.... 2016-02-02 11:48:12 -08:00
Vijay Pai b47b556d33 Merge branch 'master' into worker_quit 2016-02-02 10:36:12 -08:00
Vijay Pai 2ed337aab3 clang-format 2016-02-02 09:43:35 -08:00
vjpai 21e5d2b2f1 Add a Quit RPC so that we can conveniently shut down the workers from the driver. 2016-02-02 09:36:36 -08:00
Vijay Pai daadcc8f74 at 2016-02-01 16:49:55 -08:00
Vijay Pai 33e51184fc Address reviewer comments regarding const and shortage of comments 2016-02-01 16:40:06 -08:00
Vijay Pai 595674275b Copyright and clang-format 2016-02-01 13:28:55 -08:00
Vijay Pai 6b05639ab1 Make sure that client limit is valid 2016-02-01 13:01:34 -08:00
Vijay Pai 7d45cdb60b Enable properly working core limits on clients and servers,
and determine these dynamically if only one or the other is
specified but both are running on the same host
2016-02-01 13:00:19 -08:00
David Garcia Quintas b4e51b52bd Merge branch 'master' of github.com:grpc/grpc into sync-async-plus-interfaces 2016-01-27 19:57:58 -08:00
David Garcia Quintas 5a9462339d copyrights 2016-01-27 19:22:14 -08:00
Vijay Pai 1d71a0e084 Merge branch 'generic_qps' into dynamic_sizing2 2016-01-27 12:16:05 -08:00
Vijay Pai 7a984f0e3a Copyright 2016-01-27 11:24:57 -08:00
Vijay Pai d02dd30a1f Also dynamic sizing for num_clients on performance tests 2016-01-27 11:23:34 -08:00
vjpai 0c31b60805 Sanity failures (copyright, clang-format) 2016-01-27 09:03:18 -08:00
vjpai 94aada9ee5 clang-format 2016-01-26 18:12:30 -08:00
vjpai 020c2f36ac Fix copyright 2016-01-26 18:11:22 -08:00
Vijay Pai bdf4acbbfb Properly state client name 2016-01-26 15:15:26 -08:00
Vijay Pai 0f14209061 Improve logging for test 2016-01-26 14:20:07 -08:00
David Garcia Quintas 6a48405ed0 pre sync_stream.cc creation. Does not compile 2016-01-25 19:12:37 -08:00
Craig Tiller 1b4e33029e Consolidate C++ proto files under src/proto
- make the directory structure match the package structure
- sanitize the package structure (test --> testing)
- add auto-detection of proto file dependencies
2015-12-17 16:35:00 -08:00
Jan Tattermusch 846ae8d9c2 Merge pull request #4156 from jtattermusch/perf_testing_polishing
Performance proto polishing
2015-11-19 09:51:54 -08:00
Jan Tattermusch c5ebbd5b8f use new perf proto options in c++ 2015-11-18 17:17:34 -08:00
Julien Boeuf 6049ebd8d2 More C++ fixes (the merge did not quite work...). 2015-11-17 16:53:52 -08:00
Julien Boeuf 9a437c2c46 Forgot to fix driver.cc somehow... 2015-11-17 16:38:52 -08:00
Julien Boeuf 675b5ce861 Merge branch 'master' of github.com:grpc/grpc into core_creds_api_change 2015-11-17 15:05:45 -08:00
Vijay Pai ce84670628 clang-format 2015-11-04 00:30:12 -08:00
vjpai d08a738166 Cleanup some names
Remove some unused options and make server_threads relevant
Start stubbing out better qps/core calculations
2015-11-02 16:45:08 -08:00
vjpai 72a6332138 QPS worker no longer needs to specify server port on command line. This is part
of the proto if desired, or just goes to pick_unused_port_or_die if not
specified
2015-10-29 02:23:11 -07:00
vjpai 119c103ab0 Split up into a new service proto, use proper service suffix, add a
reset option to the mark, create a closed loop config params (empty
message) for consistency with other tests.
2015-10-29 01:21:04 -07:00
vjpai 52bfb2564f Split qpstest.proto into two parts - one for performance stats and
one for control.
Eliminate the use of our own SimpleRequest and SimpleResponse and
instead share the one from end2end testing
2015-10-21 07:50:49 -07:00
Julien Boeuf e5adc0eb67 Fixing Cpp tests. 2015-10-12 14:09:13 -07:00
Craig Tiller b17b7f4871 Add a timeout to benchmark test runs 2015-10-07 08:48:51 -07:00
Craig Tiller 71a0f9d3b0 Fix clang-format script 2015-09-28 17:22:01 -07:00
Nicolas "Pixel" Noble 59588c6162 Removing pessimizing moves.
Pass #2.
2015-09-03 02:29:30 +02:00
Craig Tiller 1ebb7c885e Hand-written changes 2015-08-31 15:53:36 -07:00
yang-g 730055d962 implementation fix 2015-08-27 12:29:45 -07:00
yang-g 9e2f90cd06 headers reorg 2015-08-21 15:35:03 -07:00
Vijay Pai 3ae11042fd clang-format 2015-08-11 22:43:14 -07:00
vjpai b1db869e1a Address concerns from review 2015-08-11 22:41:02 -07:00
Vijay Pai 90e7369484 clang-format plus helpful comments 2015-08-05 19:15:36 -07:00
Vijay Pai eed63fa267 Remaining changes needed to get QPS test working on old compilers.
This change contains a lot of ugly changes, such as changing
std::vector to allocation by new, etc.
2015-08-05 23:08:34 +00:00
Vijay Pai 4d06e2eae9 Eliminate use of lambdas in ResourceUsage processing functions...
Introduce simple getters instead.
2015-07-31 10:20:42 -07:00
Craig Tiller 677c50c92a Update C++ impl 2015-07-13 10:49:06 -07:00
Craig Tiller 20b5fe9282 Fixup C++ 2015-07-06 10:43:50 -07:00
Yang Gao c1a2c314fb Update the Status API 2015-06-16 10:59:46 -07:00
Craig Tiller 5c8737d171 clang-format qps code - it was getting out of hand 2015-05-21 11:42:17 -07:00
Vijay Pai 76e0fb1dc0 Merge pull request #1669 from dgquintas/benchmark_hosts_info
Added the client and server configurations to the bench results proto.
2015-05-21 11:36:41 -07:00
David Garcia Quintas 08116501cb Fix to work around the fact that Histogram isn't copyable. 2015-05-20 17:27:23 -07:00
David Garcia Quintas 6ba29ba3fb Added the client and server configurations to the bench results proto.
The added configurations also include the host of both parties. This
is useful for reporting.
2015-05-19 18:29:35 -07:00
Craig Tiller 882431fff5 Compile fix 2015-05-19 09:25:37 -07:00
Craig Tiller 49c3b01c3e Better RNG seeding portability 2015-05-19 08:18:02 -07:00
Craig Tiller f98e56c91b Cheesy attempt to get this working on Travis 2015-05-18 15:00:52 -07:00
Craig Tiller e9a6eb7332 Allow RunScenarios to spawn in-process workers
This allows us to get back to single binary tests where appropriate, which will help in-depth profiling efforts.
I've built this atop my smoke_test changes as they inspired me to get this done.
2015-04-09 15:51:41 -07:00
Craig Tiller b9de09f2ac Allow specifying warmup, benchmark times 2015-04-08 17:08:05 -07:00
Vijay Pai 82dd80abc6 Elminate range-based fors and work around some other limitations in older compilers 2015-03-24 10:36:08 -07:00
Craig Tiller 68de8e91cc Merge github.com:grpc/grpc into credit 2015-03-05 15:45:46 -08:00
Craig Tiller a182bf12b0 clang-format 2015-03-04 13:54:39 -08:00
Craig Tiller f282514389 Print resource utilization 2015-03-03 17:15:36 -08:00
Craig Tiller d701c5f5c3 Formatting 2015-03-03 16:05:04 -08:00
Craig Tiller 76877c3f66 Generate latencies in driver 2015-03-03 16:04:23 -08:00
Craig Tiller 10923c2fb5 Formatting 2015-03-03 14:24:49 -08:00
Craig Tiller 6af9ed0bf7 Rework QPS client/server
Now setup as a driver and N anonymous workers that may become clients or servers.
Will convert async soon.
2015-03-02 22:42:10 -08:00
Craig Tiller 26598a394a WIP 2015-03-02 16:16:00 -08:00
Craig Tiller 2d0f36c84b Driver to client/server kind of works 2015-02-23 23:16:17 -08:00
Craig Tiller 4ef7a29f31 Create server/client lists 2015-02-23 17:29:01 -08:00
Craig Tiller e48601934d Getting the driver pieces in place
Driver logic not implemented yet
2015-02-23 17:10:41 -08:00