Meng Xu
ef0bf2728e
Merge branch 'release-6.3' into mengxu/ha-code
...
Resolve Conflicts:
fdbserver/LogRouter.actor.cpp: Only conflicts at comments
2021-02-19 21:47:09 -08:00
Hao Fu
971b1aa1e6
Add txnRejectedForQueuedTooLong in ProxyStats
...
Added transactions.rejected_for_queued_too_long for bookkeeping the
number of transactions rejected by commit proxy because its queuing
time exceeds MVCC window.
2021-02-17 21:40:46 -08:00
Meng Xu
9122be4d81
Add comments to HA code and loadBalance code
2021-02-10 13:51:36 -08:00
Jingyu Zhou
a167016378
Resolver merge conflicts
2020-12-23 14:33:30 -08:00
Jingyu Zhou
bbb56e4089
Merge branch 'release-6.2' of https://github.com/apple/foundationdb into release-6.3
2020-12-23 14:26:59 -08:00
Xin Dong
35e8bf3ec7
Change from logging point value to logging histogram.
2020-12-18 16:33:46 -08:00
Xin Dong
15ac27ef94
Added a metric into ProxyMetrics to expose current commit batching window, which can be used as an indicator of the load on the proxy.
2020-12-16 11:16:13 -08:00
Russell Sears
4cb821cd63
Merge remote-tracking branch 'upstream/release-6.2' into merge-6.2-to-6.3
2020-12-09 15:47:44 -08:00
Jingyu Zhou
c68b62f89b
Update txnCommitOut
2020-12-08 16:57:59 -08:00
Jingyu Zhou
bf59ab684e
Revert change to forceRecovery
2020-12-04 16:36:34 -08:00
Jingyu Zhou
5ad0878254
Update fdbserver/MasterProxyServer.actor.cpp
...
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2020-12-04 14:27:49 -08:00
Jingyu Zhou
beccd6e3c2
Do not reject blind writes, i.e., empty read conflict range
2020-12-03 11:02:41 -08:00
Jingyu Zhou
52d238967f
Allow backup's "ApplyMutations" to bypass rejection
...
These mutations should always commit.
2020-11-30 21:06:56 -08:00
Jingyu Zhou
3d9ac0b050
Address review comments
2020-11-30 09:29:18 -08:00
Jingyu Zhou
6bf1e5f3f9
Update release notes
2020-11-29 14:34:25 -08:00
Jingyu Zhou
589ee01979
Fix backup workload w.r.t. proxy rejection
2020-11-29 09:45:55 -08:00
Jingyu Zhou
df5293e2be
Add a knob PROXY_REJECT_BATCH_QUEUED_TOO_LONG
...
Disable the proxy rejection feature for backup workload, because of the
ApplyMutationsError.
2020-11-28 21:32:41 -08:00
Jingyu Zhou
5cb0b138be
Don't reject transactions for the recovery transaction
...
Otherwise, the recovery just keeps repeating.
2020-11-27 09:49:29 -08:00
Jingyu Zhou
78c82dc891
Skip transactions that queued for a long time
2020-11-25 23:05:26 -08:00
Andrew Noyes
dc2bac5670
Resolve conflicts
2020-11-24 19:09:42 +00:00
Andrew Noyes
1f541f02be
Merge branch 'anoyes/merge-6.2-to-6.3' into anoyes/release-6.3-merge
...
Merge, leaving conflict markers for now
2020-11-24 16:55:34 +00:00
David Youngworth
d0391db862
Merge branch 'release-6.2' into release-6.3
2020-11-16 10:15:23 -08:00
Xin Dong
8343c78bf0
Merge pull request #3960 from dongxinEric/misc/expose-proxy-local-rate-info
...
Expose local transaction rate and limit info on commit proxies.
2020-11-12 15:23:50 -08:00
Xin Dong
0b8e91b9c0
Do not count system priority and default priority txns together.
2020-11-11 14:01:01 -08:00
Xin Dong
6cea86b795
Address review comments
2020-11-10 16:05:17 -08:00
Vishesh Yadav
7b28de8a41
Add IDs to ConnectionReset TraceEvents
2020-11-04 14:06:49 -08:00
Vishesh Yadav
22b16302c3
Make ConnectionReset logs easier to query #3977
...
All TraceLogs that are related to ConnectionReset should be prefixed with
ConnectionReset. This should make it easy to query and aggregate by address and
role.
2020-11-02 15:10:51 -08:00
Xin Dong
77825a4784
Fix typo.
2020-10-29 14:27:31 -07:00
Xin Dong
fbe421c6cb
Added time-in-queue measurement for GRV requests. Added metrics to show each time when a read version is hand out, how much of the queue, percentage-wise, is served.
2020-10-29 14:22:45 -07:00
Xin Dong
36558d1450
Move to be part of proxy metrics
2020-10-26 16:25:56 -07:00
Xin Dong
2bccb050de
Expose local transaction rate and limit info on commit proxies.
2020-10-23 17:32:27 -07:00
Chaoguang Lin
8d937a56f2
Throw operation_failed() if dd not found when calling ddMetricsRequestServer
...
Remove time_out error in DDMetricsList rpc
Add retry logic for dd special key when dd not found
Update FuzzApiCorrectness test
2020-10-21 15:28:03 -07:00
Jingyu Zhou
8f17a1a5d6
Merge branch 'release-6.2' into release-6.3
2020-10-16 15:25:39 -07:00
Evan Tschannen
1378ecba4d
If a proxy is sufficiently far behind, reset network connections to attempt to fix the problem
2020-10-11 23:06:26 -07:00
Evan Tschannen
efe50b68e6
fix compile error
2020-10-05 14:16:52 -07:00
Evan Tschannen
7ba06a4434
fix: min and max compute estimate logging on the proxy was always zero
...
added comments and fixed formatting
2020-10-05 12:35:10 -07:00
Evan Tschannen
5807b1ec3d
changed the recent requests to be the per second amount; increased precision of cpu estimate
2020-10-04 19:31:40 -07:00
Evan Tschannen
f546034366
do not prevent computePerOperation from being updated for small computeDurations. Added logging for the compute per operation. Protect against erroneously large compute estimates
2020-10-04 19:19:05 -07:00
Evan Tschannen
614c8bc895
Get read versions requests must be load balanced on the number of requests because ratekeeper gives out an equal budget to each proxy
2020-10-04 16:20:24 -07:00
Evan Tschannen
5c97461d18
Merge pull request #3653 from etschannen/feature-proxy-busy-loadbalance
...
Changed proxy load balancing to balance on CPU usage
2020-08-31 10:39:08 -07:00
Evan Tschannen
29eec30183
Merge branch 'release-6.2' into release-6.3
...
# Conflicts:
# CMakeLists.txt
# build/Dockerfile
# build/Dockerfile.devel
# documentation/sphinx/source/downloads.rst
# fdbserver/Knobs.cpp
# fdbserver/LogSystem.h
# fdbserver/MasterProxyServer.actor.cpp
# fdbserver/TagPartitionedLogSystem.actor.cpp
# fdbserver/WaitFailure.actor.cpp
# fdbserver/fdbserver.vcxproj
# fdbserver/fdbserver.vcxproj.filters
# packaging/msi/FDBInstaller.wxs
2020-08-31 01:10:29 -07:00
Evan Tschannen
f6f9aea09e
fix: runLoopBusyness was always zero
2020-08-28 09:29:54 -07:00
A.J. Beamon
9dd4589d61
Fix merge issue that resulted in commit and GV latency band info not being published.
2020-08-20 11:49:30 -07:00
Andrew Noyes
30c086ed96
Improve comment
...
Also use push_back. The lifetime of databaseLockedKey and
databaseLockedKeyEnd will outlive trRequest.arena, since they're
literals.
2020-08-20 18:05:03 +00:00
Andrew Noyes
9cf3041393
Add read conflict for metadata txs that aren't lock-aware
2020-08-20 02:52:37 +00:00
Evan Tschannen
539366156c
more fixes
2020-08-12 17:26:20 -07:00
Evan Tschannen
7c84e04028
fixed compiler errors
2020-08-12 17:22:37 -07:00
Evan Tschannen
c72068d6b5
clients load balance across proxies based on process busyness instead of number of requests
2020-08-12 17:17:21 -07:00
Andrew Noyes
d2cf700bd4
Fix compiler warnings
2020-07-28 18:30:26 +00:00
Evan Tschannen
fc49f432c6
Merge pull request #3437 from ajbeamon/auto-tag-throttling-fixes
...
Various fixes to tag throttling
2020-07-13 10:52:46 -07:00