Commit Graph

170 Commits

Author SHA1 Message Date
Craig Tiller fe1a67c3d3 Merge github.com:grpc/grpc into trickle_stall 2017-04-20 12:39:26 -07:00
Craig Tiller f2ea1d19f5 Increase threshold probability for reporting differences 2017-04-20 10:48:57 -07:00
Craig Tiller 2b465f00e9 Get stats bmdiffed 2017-04-19 15:05:54 -07:00
Craig Tiller e530845d91 Also increase threshold for significant differences 2017-04-19 09:18:57 -07:00
Craig Tiller ad7f066b16 Allow >100% increases, add more jobs to reduce noise 2017-04-19 09:16:45 -07:00
Craig Tiller 25e3c6da76 Fix EINTR forever 2017-04-18 13:57:38 -07:00
Craig Tiller 349907b645 Handle EINTR on reading file 2017-04-14 13:00:47 -07:00
Craig Tiller 97e40da5a1 Less samples, more random 2017-04-14 09:04:07 -07:00
Craig Tiller d71ba8392a Tweak defaults 2017-04-14 08:36:11 -07:00
Craig Tiller bc442e1ff0 Declare jobs 2017-04-14 08:33:55 -07:00
Craig Tiller 0ebff8b213 Iterate properly 2017-04-14 08:32:38 -07:00
Craig Tiller 0553b9c75d Properly clean 2017-04-14 08:31:17 -07:00
Craig Tiller a00e51ccfe Fix dir names 2017-04-14 08:27:39 -07:00
Craig Tiller 233ad390fa Accelerate by running more jobs in parallel, and only building twice 2017-04-14 08:25:53 -07:00
Craig Tiller 964647729e Update bm_diff.py 2017-04-13 22:06:25 -07:00
Craig Tiller 59bf91c72e tweaks, fix bug 2017-04-13 08:43:51 -07:00
Craig Tiller 67dd855337 Combine multiple temporally disconnected runs 2017-04-12 16:42:30 -07:00
Craig Tiller 2d7d5be813 Increase threshold 2017-04-12 06:54:40 -07:00
Craig Tiller f597c7ccdd Tighter threshold 2017-04-11 14:39:32 -07:00
Craig Tiller 7281d19de3 fix 2017-04-05 15:04:55 -07:00
Craig Tiller bdeb857ab4 more samples 2017-04-05 14:12:53 -07:00
Craig Tiller b1c02cac82 exclude small absolute changes 2017-04-05 14:11:28 -07:00
Craig Tiller 32873d171b accelerate 2017-04-05 12:19:51 -07:00
Craig Tiller 37f80e8a8a Fix reuse bug? 2017-04-05 12:18:44 -07:00
Craig Tiller e5f1828175 Tweak parameters 2017-04-05 09:08:37 -07:00
Craig Tiller b1d3dcdb7d fix typo 2017-04-05 06:35:49 -07:00
Craig Tiller d6d2da1149 Handle nans 2017-04-05 06:34:07 -07:00
Craig Tiller e749e34f07 Provide bounds on speedup 2017-04-05 06:32:47 -07:00
Craig Tiller 125b04fced adding speedup 2017-04-04 21:31:44 -07:00
Craig Tiller a3589c5411 Starting speedup calculation 2017-04-04 21:09:08 -07:00
Craig Tiller 7e31385863 Remove timeout 2017-04-03 15:14:08 -07:00
Craig Tiller 942324235c s/new/old 2017-04-03 10:44:03 -07:00
Craig Tiller 2fbbcd1fd4 Missing import 2017-04-03 08:29:08 -07:00
Craig Tiller cc89f7801b Fix typo 2017-04-03 08:08:25 -07:00
Craig Tiller 691eefbe0f Parallel bm_diff 2017-04-03 08:06:32 -07:00
Craig Tiller f69317cf03 Increase reps to decrease noise 2017-04-02 16:03:43 -07:00
Craig Tiller 15df111178 Tighten signalling requirements 2017-03-31 15:50:43 -07:00
Craig Tiller 0329eaac40 Further reduce noise 2017-03-31 12:50:06 -07:00
Craig Tiller bfe8adf89a Further reduce noise 2017-03-31 12:45:51 -07:00
Craig Tiller 81d3ba8d27 Tighten constraints for bm_diff to trigger 2017-03-31 09:44:23 -07:00
Craig Tiller 9298a92f78 Fixes 2017-03-31 06:56:40 -07:00
Craig Tiller dc44c26856 Revert "Spam cleanup"
This reverts commit 1463d0e74d.
2017-03-31 06:56:33 -07:00
Craig Tiller 6b0afac475 Sensitivity 2017-03-31 06:56:27 -07:00
Craig Tiller a77023b3d2 Update bm_diff.py 2017-03-30 20:42:42 -07:00
Craig Tiller b5946a7546 Loosen constraints for reporting 2017-03-30 20:36:44 -07:00
Craig Tiller 1463d0e74d Spam cleanup 2017-03-30 13:40:57 -07:00
Craig Tiller c78c9158c0 Fix merge error 2017-03-30 13:29:02 -07:00
Craig Tiller 03bab0af2e Fix merge error 2017-03-30 13:24:59 -07:00
Craig Tiller d2461e522a Add debug 2017-03-30 13:20:17 -07:00
Craig Tiller 9a212df417 Add debug 2017-03-30 13:19:45 -07:00
Craig Tiller 04e5f65e2a Add debug 2017-03-30 12:47:08 -07:00
Craig Tiller 048825bda5 Merge branch 'bmdiff2.1.1' of github.com:ctiller/grpc into bmdiff2.1.1 2017-03-30 10:55:45 -07:00
Craig Tiller 6ceda3b715 Merge branch 'base16' into bmdiff2.1.1 2017-03-30 10:55:31 -07:00
Craig Tiller b88399932e Add new benchmark 2017-03-30 10:54:14 -07:00
Craig Tiller 852b7d9fde Add debug: somethings going wrong 2017-03-30 08:15:16 -07:00
Craig Tiller 23e6a8a678 Use medians, increase threshold 2017-03-30 07:24:01 -07:00
Craig Tiller 9b4a3cd984 Reduce repetitions: this started taking too long 2017-03-29 20:09:37 -07:00
Craig Tiller f5c8e85760 Merge branch 'bmdiff2.1.1' of github.com:ctiller/grpc into bmdiff2.1.1 2017-03-29 16:47:20 -07:00
Craig Tiller c2a52e36d8 Tighten constraints 2017-03-29 16:47:03 -07:00
Craig Tiller 31b2660408 newlines 2017-03-29 16:22:20 -07:00
Craig Tiller 123724f0a1 Add new benchmark 2017-03-29 16:16:59 -07:00
Craig Tiller 1e578f6227 Formatting 2017-03-29 14:03:46 -07:00
Craig Tiller 57a06bfd15 Always re-update submodules 2017-03-29 08:31:30 -07:00
Craig Tiller 6a17fddc69 Threshold % change also 2017-03-29 08:21:10 -07:00
Craig Tiller ebb7e82c73 Use python for commenting 2017-03-29 08:17:11 -07:00
Craig Tiller fda22624ba Fix building 2017-03-29 01:54:16 -07:00
Craig Tiller d1d055a1bf Fix building 2017-03-29 01:52:28 -07:00
Craig Tiller ba32fee3fc Speed up builds 2017-03-29 01:49:02 -07:00
Craig Tiller 26cb316227 fix typo 2017-03-28 19:31:20 -07:00
Craig Tiller 409a8da3ed syntax 2017-03-28 08:41:16 -07:00
Craig Tiller 50b7fc9b24 More discriminating 2017-03-28 08:28:32 -07:00
Craig Tiller 06ac1c7086 Merge github.com:grpc/grpc into bmdiff2.1.1 2017-03-28 08:25:35 -07:00
Craig Tiller ed2c292f44 Bugfix15 2017-03-27 23:23:45 -07:00
Craig Tiller a87b138187 Bugfix14 2017-03-27 23:06:10 -07:00
Craig Tiller 4efb5e16dc Bugfix13 2017-03-27 22:37:00 -07:00
Craig Tiller cc7d9873f7 Bugfix12 2017-03-27 22:29:15 -07:00
Craig Tiller 4274925f83 Bugfix11 2017-03-27 22:20:37 -07:00
Craig Tiller f0e7739acc Bugfix10 2017-03-27 22:11:57 -07:00
Craig Tiller b9d71a2a0e Bugfix9 2017-03-27 22:01:10 -07:00
Craig Tiller 8aeb8986ea Bugfix8 2017-03-27 21:53:04 -07:00
Craig Tiller d9de6b302f Bugfix7 2017-03-27 21:45:10 -07:00
Craig Tiller c523f5df3e Bugfix6 2017-03-27 21:37:19 -07:00
Craig Tiller 6e40ea0b65 Bugfix5 2017-03-27 21:28:22 -07:00
Craig Tiller a0af68d1e1 Bugfix4 2017-03-27 21:27:37 -07:00
Craig Tiller 039f4dc632 Bugfix3 2017-03-27 21:27:16 -07:00
Craig Tiller ec8dee29e7 Bugfix2 2017-03-27 21:26:47 -07:00
Craig Tiller 00003fedda Bugfix1 2017-03-27 21:26:11 -07:00
Craig Tiller d23826e8b9 A more useful bm_diff? 2017-03-27 21:25:15 -07:00
Craig Tiller 9fb3131dba Enroll bm_chttp2_transport into bigquery pipeline 2017-03-22 09:09:16 -07:00
Craig Tiller e1523e95c1 Track calls to gpr_now() 2017-03-14 21:10:42 -07:00
Craig Tiller 37bbbd770f Merge pull request #9984 from ctiller/poll-wakeup
Add some pollset benchmarks
2017-03-13 13:38:48 -07:00
Craig Tiller bbfb25bf70 Sanitize before bigquery upload 2017-03-10 17:24:45 -08:00
Noah Eisen 56cea8f2ee Merge pull request #10098 from ncteisen/whats-the-diff-between
Enhance bm_diff
2017-03-10 14:30:18 -08:00
Craig Tiller 6a4c1a37cc Add benchmark to list 2017-03-10 14:18:00 -08:00
ncteisen ff023ef7e3 Fix bm_diff to handle 0s 2017-03-10 13:49:02 -08:00
Craig Tiller 3488780949 Handle floats in bm_json 2017-03-10 13:39:01 -08:00
Craig Tiller e736b705cc Add Zalloc to bq conversion table 2017-03-10 09:52:25 -08:00
Matt Kwong f90d4c8372 Add copyright and license to bm_diff.py 2017-03-09 16:35:21 -08:00
Craig Tiller 47c56a677e A better benchmark diff script 2017-03-08 13:45:53 -08:00
Craig Tiller 5adc93e0ba Add more interesting metrics 2017-03-08 13:17:53 -08:00