Commit Graph

201 Commits

Author SHA1 Message Date
ncteisen 6a5e923a81 Only output crashes if they occur 2017-06-08 23:29:02 -07:00
ncteisen 0ff7384f6d Merge branch 'master' of https://github.com/grpc/grpc into faster-bm-diff 2017-06-08 08:15:03 -07:00
ncteisen 07639167fc 2 space indentation 2017-06-08 08:08:25 -07:00
Jan Tattermusch 7897ae9308 auto-fix most of licenses 2017-06-08 11:22:41 +02:00
ncteisen 251b025b89 Yapf code 2017-06-07 15:21:15 -07:00
ncteisen 0ac47d28cd Github comments 2017-06-07 15:19:24 -07:00
ncteisen 7cd7b7fc43 Differentiate between timeouts and crashes 2017-06-07 15:14:19 -07:00
ncteisen f1e19fdd31 Fix typos in README 2017-06-07 11:50:04 -07:00
ncteisen 2b96949d3d Yapf fmt 2017-06-01 21:59:46 -07:00
ncteisen bf1ee7b12f More filename stripping 2017-06-01 16:18:25 -07:00
ncteisen a278759ec9 Add flakiness data to PR comment 2017-06-01 15:32:08 -07:00
ncteisen 3f05c21f55 Add timeout and retries to fix flakes 2017-06-01 12:43:58 -07:00
ncteisen 3992a3a499 Yapf fmt code 2017-06-01 10:36:05 -07:00
ncteisen bea7c1954c Split bm runs by individual bm 2017-06-01 10:33:42 -07:00
ncteisen bb8cc8814b Merge branch 'master' of https://github.com/grpc/grpc into more-bm-diff 2017-06-01 09:49:58 -07:00
ncteisen 28b0828243 bm trickly bugfix 2017-05-26 11:06:33 -04:00
ncteisen df8c3eec39 Merge branch 'master' of https://github.com/grpc/grpc into more-bm-diff 2017-05-18 19:01:53 -07:00
ncteisen df31960992 Add unary fullstack trickle to bm json 2017-05-17 16:48:26 -07:00
ncteisen d21040bf1e Update readme 2017-05-12 00:46:43 -07:00
ncteisen 738be24db4 Py fmt 2017-05-10 16:22:54 -07:00
ncteisen 48d973a276 Add readme and flags 2017-05-10 16:22:54 -07:00
ncteisen 9aba7fef8d Fix ttest_ind crash 2017-05-10 16:22:54 -07:00
ncteisen 64637b7c8c restructure 2017-05-10 16:22:43 -07:00
ncteisen dc76c66521 Add driver for bm_*.py pipeline 2017-05-10 16:22:25 -07:00
ncteisen ab69ea3f9d Modulized the bm_*.py functions 2017-05-10 16:22:25 -07:00
Craig Tiller ff54f5b150 Merge github.com:grpc/grpc into trickle_stall 2017-04-26 10:38:15 -07:00
Craig Tiller e7c31edb55 Print before commenting to ensure theres A copy of the results somewhere 2017-04-26 08:57:22 -07:00
Craig Tiller c9c6aa7df0 Be resilient against failed runs 2017-04-25 08:44:56 -07:00
Craig Tiller 46436cbe31 Merge github.com:grpc/grpc into trickle_stall 2017-04-21 16:24:40 -07:00
Craig Tiller add943869a Diff now too 2017-04-21 15:43:55 -07:00
Craig Tiller ee880fd373 Merge github.com:grpc/grpc into count_now 2017-04-21 15:43:27 -07:00
Craig Tiller fe1a67c3d3 Merge github.com:grpc/grpc into trickle_stall 2017-04-20 12:39:26 -07:00
Craig Tiller f2ea1d19f5 Increase threshold probability for reporting differences 2017-04-20 10:48:57 -07:00
Craig Tiller 2b465f00e9 Get stats bmdiffed 2017-04-19 15:05:54 -07:00
Craig Tiller e530845d91 Also increase threshold for significant differences 2017-04-19 09:18:57 -07:00
Craig Tiller ad7f066b16 Allow >100% increases, add more jobs to reduce noise 2017-04-19 09:16:45 -07:00
Craig Tiller 25e3c6da76 Fix EINTR forever 2017-04-18 13:57:38 -07:00
Craig Tiller 349907b645 Handle EINTR on reading file 2017-04-14 13:00:47 -07:00
Craig Tiller 97e40da5a1 Less samples, more random 2017-04-14 09:04:07 -07:00
Craig Tiller d71ba8392a Tweak defaults 2017-04-14 08:36:11 -07:00
Craig Tiller bc442e1ff0 Declare jobs 2017-04-14 08:33:55 -07:00
Craig Tiller 0ebff8b213 Iterate properly 2017-04-14 08:32:38 -07:00
Craig Tiller 0553b9c75d Properly clean 2017-04-14 08:31:17 -07:00
Craig Tiller a00e51ccfe Fix dir names 2017-04-14 08:27:39 -07:00
Craig Tiller 233ad390fa Accelerate by running more jobs in parallel, and only building twice 2017-04-14 08:25:53 -07:00
Craig Tiller 964647729e Update bm_diff.py 2017-04-13 22:06:25 -07:00
Craig Tiller 59bf91c72e tweaks, fix bug 2017-04-13 08:43:51 -07:00
Craig Tiller 67dd855337 Combine multiple temporally disconnected runs 2017-04-12 16:42:30 -07:00
Craig Tiller 2d7d5be813 Increase threshold 2017-04-12 06:54:40 -07:00
Craig Tiller f597c7ccdd Tighter threshold 2017-04-11 14:39:32 -07:00
Craig Tiller 7281d19de3 fix 2017-04-05 15:04:55 -07:00
Craig Tiller bdeb857ab4 more samples 2017-04-05 14:12:53 -07:00
Craig Tiller b1c02cac82 exclude small absolute changes 2017-04-05 14:11:28 -07:00
Craig Tiller 32873d171b accelerate 2017-04-05 12:19:51 -07:00
Craig Tiller 37f80e8a8a Fix reuse bug? 2017-04-05 12:18:44 -07:00
Craig Tiller e5f1828175 Tweak parameters 2017-04-05 09:08:37 -07:00
Craig Tiller b1d3dcdb7d fix typo 2017-04-05 06:35:49 -07:00
Craig Tiller d6d2da1149 Handle nans 2017-04-05 06:34:07 -07:00
Craig Tiller e749e34f07 Provide bounds on speedup 2017-04-05 06:32:47 -07:00
Craig Tiller 125b04fced adding speedup 2017-04-04 21:31:44 -07:00
Craig Tiller a3589c5411 Starting speedup calculation 2017-04-04 21:09:08 -07:00
Craig Tiller 7e31385863 Remove timeout 2017-04-03 15:14:08 -07:00
Craig Tiller 942324235c s/new/old 2017-04-03 10:44:03 -07:00
Craig Tiller 2fbbcd1fd4 Missing import 2017-04-03 08:29:08 -07:00
Craig Tiller cc89f7801b Fix typo 2017-04-03 08:08:25 -07:00
Craig Tiller 691eefbe0f Parallel bm_diff 2017-04-03 08:06:32 -07:00
Craig Tiller f69317cf03 Increase reps to decrease noise 2017-04-02 16:03:43 -07:00
Craig Tiller 15df111178 Tighten signalling requirements 2017-03-31 15:50:43 -07:00
Craig Tiller 0329eaac40 Further reduce noise 2017-03-31 12:50:06 -07:00
Craig Tiller bfe8adf89a Further reduce noise 2017-03-31 12:45:51 -07:00
Craig Tiller 81d3ba8d27 Tighten constraints for bm_diff to trigger 2017-03-31 09:44:23 -07:00
Craig Tiller 9298a92f78 Fixes 2017-03-31 06:56:40 -07:00
Craig Tiller dc44c26856 Revert "Spam cleanup"
This reverts commit 1463d0e74d.
2017-03-31 06:56:33 -07:00
Craig Tiller 6b0afac475 Sensitivity 2017-03-31 06:56:27 -07:00
Craig Tiller a77023b3d2 Update bm_diff.py 2017-03-30 20:42:42 -07:00
Craig Tiller b5946a7546 Loosen constraints for reporting 2017-03-30 20:36:44 -07:00
Craig Tiller 1463d0e74d Spam cleanup 2017-03-30 13:40:57 -07:00
Craig Tiller c78c9158c0 Fix merge error 2017-03-30 13:29:02 -07:00
Craig Tiller 03bab0af2e Fix merge error 2017-03-30 13:24:59 -07:00
Craig Tiller d2461e522a Add debug 2017-03-30 13:20:17 -07:00
Craig Tiller 9a212df417 Add debug 2017-03-30 13:19:45 -07:00
Craig Tiller 04e5f65e2a Add debug 2017-03-30 12:47:08 -07:00
Craig Tiller 048825bda5 Merge branch 'bmdiff2.1.1' of github.com:ctiller/grpc into bmdiff2.1.1 2017-03-30 10:55:45 -07:00
Craig Tiller 6ceda3b715 Merge branch 'base16' into bmdiff2.1.1 2017-03-30 10:55:31 -07:00
Craig Tiller b88399932e Add new benchmark 2017-03-30 10:54:14 -07:00
Craig Tiller 852b7d9fde Add debug: somethings going wrong 2017-03-30 08:15:16 -07:00
Craig Tiller 23e6a8a678 Use medians, increase threshold 2017-03-30 07:24:01 -07:00
Craig Tiller 9b4a3cd984 Reduce repetitions: this started taking too long 2017-03-29 20:09:37 -07:00
Craig Tiller f5c8e85760 Merge branch 'bmdiff2.1.1' of github.com:ctiller/grpc into bmdiff2.1.1 2017-03-29 16:47:20 -07:00
Craig Tiller c2a52e36d8 Tighten constraints 2017-03-29 16:47:03 -07:00
Craig Tiller 31b2660408 newlines 2017-03-29 16:22:20 -07:00
Craig Tiller 123724f0a1 Add new benchmark 2017-03-29 16:16:59 -07:00
Craig Tiller 1e578f6227 Formatting 2017-03-29 14:03:46 -07:00
Craig Tiller 57a06bfd15 Always re-update submodules 2017-03-29 08:31:30 -07:00
Craig Tiller 6a17fddc69 Threshold % change also 2017-03-29 08:21:10 -07:00
Craig Tiller ebb7e82c73 Use python for commenting 2017-03-29 08:17:11 -07:00
Craig Tiller fda22624ba Fix building 2017-03-29 01:54:16 -07:00
Craig Tiller d1d055a1bf Fix building 2017-03-29 01:52:28 -07:00
Craig Tiller ba32fee3fc Speed up builds 2017-03-29 01:49:02 -07:00
Craig Tiller 26cb316227 fix typo 2017-03-28 19:31:20 -07:00