251b025b89
Yapf code
2017-06-07 15:21:15 -07:00
0ac47d28cd
Github comments
2017-06-07 15:19:24 -07:00
7cd7b7fc43
Differentiate between timeouts and crashes
2017-06-07 15:14:19 -07:00
f1e19fdd31
Fix typos in README
2017-06-07 11:50:04 -07:00
2b96949d3d
Yapf fmt
2017-06-01 21:59:46 -07:00
bf1ee7b12f
More filename stripping
2017-06-01 16:18:25 -07:00
a278759ec9
Add flakiness data to PR comment
2017-06-01 15:32:08 -07:00
3f05c21f55
Add timeout and retries to fix flakes
2017-06-01 12:43:58 -07:00
3992a3a499
Yapf fmt code
2017-06-01 10:36:05 -07:00
bea7c1954c
Split bm runs by individual bm
2017-06-01 10:33:42 -07:00
bb8cc8814b
Merge branch 'master' of https://github.com/grpc/grpc into more-bm-diff
2017-06-01 09:49:58 -07:00
28b0828243
bm trickly bugfix
2017-05-26 11:06:33 -04:00
df8c3eec39
Merge branch 'master' of https://github.com/grpc/grpc into more-bm-diff
2017-05-18 19:01:53 -07:00
df31960992
Add unary fullstack trickle to bm json
2017-05-17 16:48:26 -07:00
d21040bf1e
Update readme
2017-05-12 00:46:43 -07:00
738be24db4
Py fmt
2017-05-10 16:22:54 -07:00
48d973a276
Add readme and flags
2017-05-10 16:22:54 -07:00
9aba7fef8d
Fix ttest_ind crash
2017-05-10 16:22:54 -07:00
64637b7c8c
restructure
2017-05-10 16:22:43 -07:00
dc76c66521
Add driver for bm_*.py pipeline
2017-05-10 16:22:25 -07:00
ab69ea3f9d
Modulized the bm_*.py functions
2017-05-10 16:22:25 -07:00
ff54f5b150
Merge github.com:grpc/grpc into trickle_stall
2017-04-26 10:38:15 -07:00
e7c31edb55
Print before commenting to ensure theres A copy of the results somewhere
2017-04-26 08:57:22 -07:00
c9c6aa7df0
Be resilient against failed runs
2017-04-25 08:44:56 -07:00
46436cbe31
Merge github.com:grpc/grpc into trickle_stall
2017-04-21 16:24:40 -07:00
add943869a
Diff now too
2017-04-21 15:43:55 -07:00
ee880fd373
Merge github.com:grpc/grpc into count_now
2017-04-21 15:43:27 -07:00
fe1a67c3d3
Merge github.com:grpc/grpc into trickle_stall
2017-04-20 12:39:26 -07:00
f2ea1d19f5
Increase threshold probability for reporting differences
2017-04-20 10:48:57 -07:00
2b465f00e9
Get stats bmdiffed
2017-04-19 15:05:54 -07:00
e530845d91
Also increase threshold for significant differences
2017-04-19 09:18:57 -07:00
ad7f066b16
Allow >100% increases, add more jobs to reduce noise
2017-04-19 09:16:45 -07:00
25e3c6da76
Fix EINTR forever
2017-04-18 13:57:38 -07:00
349907b645
Handle EINTR on reading file
2017-04-14 13:00:47 -07:00
97e40da5a1
Less samples, more random
2017-04-14 09:04:07 -07:00
d71ba8392a
Tweak defaults
2017-04-14 08:36:11 -07:00
bc442e1ff0
Declare jobs
2017-04-14 08:33:55 -07:00
0ebff8b213
Iterate properly
2017-04-14 08:32:38 -07:00
0553b9c75d
Properly clean
2017-04-14 08:31:17 -07:00
a00e51ccfe
Fix dir names
2017-04-14 08:27:39 -07:00
233ad390fa
Accelerate by running more jobs in parallel, and only building twice
2017-04-14 08:25:53 -07:00
964647729e
Update bm_diff.py
2017-04-13 22:06:25 -07:00
59bf91c72e
tweaks, fix bug
2017-04-13 08:43:51 -07:00
67dd855337
Combine multiple temporally disconnected runs
2017-04-12 16:42:30 -07:00
2d7d5be813
Increase threshold
2017-04-12 06:54:40 -07:00
f597c7ccdd
Tighter threshold
2017-04-11 14:39:32 -07:00
7281d19de3
fix
2017-04-05 15:04:55 -07:00
bdeb857ab4
more samples
2017-04-05 14:12:53 -07:00
b1c02cac82
exclude small absolute changes
2017-04-05 14:11:28 -07:00
32873d171b
accelerate
2017-04-05 12:19:51 -07:00
37f80e8a8a
Fix reuse bug?
2017-04-05 12:18:44 -07:00
e5f1828175
Tweak parameters
2017-04-05 09:08:37 -07:00
2ce0bfa8b4
Merge github.com:grpc/grpc into foo
2017-04-05 09:04:40 -07:00
b1d3dcdb7d
fix typo
2017-04-05 06:35:49 -07:00
d6d2da1149
Handle nans
2017-04-05 06:34:07 -07:00
e749e34f07
Provide bounds on speedup
2017-04-05 06:32:47 -07:00
125b04fced
adding speedup
2017-04-04 21:31:44 -07:00
a3589c5411
Starting speedup calculation
2017-04-04 21:09:08 -07:00
7e31385863
Remove timeout
2017-04-03 15:14:08 -07:00
942324235c
s/new/old
2017-04-03 10:44:03 -07:00
2fbbcd1fd4
Missing import
2017-04-03 08:29:08 -07:00
cc89f7801b
Fix typo
2017-04-03 08:08:25 -07:00
691eefbe0f
Parallel bm_diff
2017-04-03 08:06:32 -07:00
f69317cf03
Increase reps to decrease noise
2017-04-02 16:03:43 -07:00
d682c770c6
Merge github.com:grpc/grpc into daily_and_hourly
2017-03-31 16:08:31 -07:00
0592526994
Split performance profile job in two
...
... one that runs hourly and uploads to bigquery (for regression
detection)
... and one that will run daily and not upload to bigquery (for
flamegraph generation)
2017-03-31 16:05:37 -07:00
15df111178
Tighten signalling requirements
2017-03-31 15:50:43 -07:00
0329eaac40
Further reduce noise
2017-03-31 12:50:06 -07:00
bfe8adf89a
Further reduce noise
2017-03-31 12:45:51 -07:00
81d3ba8d27
Tighten constraints for bm_diff to trigger
2017-03-31 09:44:23 -07:00
9298a92f78
Fixes
2017-03-31 06:56:40 -07:00
dc44c26856
Revert "Spam cleanup"
...
This reverts commit 1463d0e74d
2017-03-31 06:56:33 -07:00
6b0afac475
Sensitivity
2017-03-31 06:56:27 -07:00
a77023b3d2
Update bm_diff.py
2017-03-30 20:42:42 -07:00
b5946a7546
Loosen constraints for reporting
2017-03-30 20:36:44 -07:00
1463d0e74d
Spam cleanup
2017-03-30 13:40:57 -07:00
c78c9158c0
Fix merge error
2017-03-30 13:29:02 -07:00
03bab0af2e
Fix merge error
2017-03-30 13:24:59 -07:00
d2461e522a
Add debug
2017-03-30 13:20:17 -07:00
9a212df417
Add debug
2017-03-30 13:19:45 -07:00
04e5f65e2a
Add debug
2017-03-30 12:47:08 -07:00
048825bda5
Merge branch 'bmdiff2.1.1' of github.com:ctiller/grpc into bmdiff2.1.1
2017-03-30 10:55:45 -07:00
6ceda3b715
Merge branch 'base16' into bmdiff2.1.1
2017-03-30 10:55:31 -07:00
b88399932e
Add new benchmark
2017-03-30 10:54:14 -07:00
852b7d9fde
Add debug: somethings going wrong
2017-03-30 08:15:16 -07:00
23e6a8a678
Use medians, increase threshold
2017-03-30 07:24:01 -07:00
9b4a3cd984
Reduce repetitions: this started taking too long
2017-03-29 20:09:37 -07:00
f5c8e85760
Merge branch 'bmdiff2.1.1' of github.com:ctiller/grpc into bmdiff2.1.1
2017-03-29 16:47:20 -07:00
c2a52e36d8
Tighten constraints
2017-03-29 16:47:03 -07:00
31b2660408
newlines
2017-03-29 16:22:20 -07:00
123724f0a1
Add new benchmark
2017-03-29 16:16:59 -07:00
1e578f6227
Formatting
2017-03-29 14:03:46 -07:00
57a06bfd15
Always re-update submodules
2017-03-29 08:31:30 -07:00
6a17fddc69
Threshold % change also
2017-03-29 08:21:10 -07:00
ebb7e82c73
Use python for commenting
2017-03-29 08:17:11 -07:00
fda22624ba
Fix building
2017-03-29 01:54:16 -07:00
d1d055a1bf
Fix building
2017-03-29 01:52:28 -07:00
ba32fee3fc
Speed up builds
2017-03-29 01:49:02 -07:00
26cb316227
fix typo
2017-03-28 19:31:20 -07:00
409a8da3ed
syntax
2017-03-28 08:41:16 -07:00
ncteisen