Commit Graph

349 Commits

Author SHA1 Message Date
Meng Xu ef0bf2728e Merge branch 'release-6.3' into mengxu/ha-code
Resolve Conflicts:
	fdbserver/LogRouter.actor.cpp: Only conflicts at comments
2021-02-19 21:47:09 -08:00
Hao Fu 971b1aa1e6 Add txnRejectedForQueuedTooLong in ProxyStats
Added transactions.rejected_for_queued_too_long for bookkeeping the
number of transactions rejected by commit proxy because its queuing
time exceeds MVCC window.
2021-02-17 21:40:46 -08:00
Meng Xu 9122be4d81 Add comments to HA code and loadBalance code 2021-02-10 13:51:36 -08:00
Jingyu Zhou a167016378 Resolver merge conflicts 2020-12-23 14:33:30 -08:00
Jingyu Zhou bbb56e4089 Merge branch 'release-6.2' of https://github.com/apple/foundationdb into release-6.3 2020-12-23 14:26:59 -08:00
Xin Dong 35e8bf3ec7 Change from logging point value to logging histogram. 2020-12-18 16:33:46 -08:00
Xin Dong 15ac27ef94 Added a metric into ProxyMetrics to expose current commit batching window, which can be used as an indicator of the load on the proxy. 2020-12-16 11:16:13 -08:00
Russell Sears 4cb821cd63 Merge remote-tracking branch 'upstream/release-6.2' into merge-6.2-to-6.3 2020-12-09 15:47:44 -08:00
Jingyu Zhou c68b62f89b Update txnCommitOut 2020-12-08 16:57:59 -08:00
Jingyu Zhou bf59ab684e Revert change to forceRecovery 2020-12-04 16:36:34 -08:00
Jingyu Zhou 5ad0878254
Update fdbserver/MasterProxyServer.actor.cpp
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2020-12-04 14:27:49 -08:00
Jingyu Zhou beccd6e3c2 Do not reject blind writes, i.e., empty read conflict range 2020-12-03 11:02:41 -08:00
Jingyu Zhou 52d238967f Allow backup's "ApplyMutations" to bypass rejection
These mutations should always commit.
2020-11-30 21:06:56 -08:00
Jingyu Zhou 3d9ac0b050 Address review comments 2020-11-30 09:29:18 -08:00
Jingyu Zhou 6bf1e5f3f9 Update release notes 2020-11-29 14:34:25 -08:00
Jingyu Zhou 589ee01979 Fix backup workload w.r.t. proxy rejection 2020-11-29 09:45:55 -08:00
Jingyu Zhou df5293e2be Add a knob PROXY_REJECT_BATCH_QUEUED_TOO_LONG
Disable the proxy rejection feature for backup workload, because of the
ApplyMutationsError.
2020-11-28 21:32:41 -08:00
Jingyu Zhou 5cb0b138be Don't reject transactions for the recovery transaction
Otherwise, the recovery just keeps repeating.
2020-11-27 09:49:29 -08:00
Jingyu Zhou 78c82dc891 Skip transactions that queued for a long time 2020-11-25 23:05:26 -08:00
Andrew Noyes dc2bac5670 Resolve conflicts 2020-11-24 19:09:42 +00:00
Andrew Noyes 1f541f02be Merge branch 'anoyes/merge-6.2-to-6.3' into anoyes/release-6.3-merge
Merge, leaving conflict markers for now
2020-11-24 16:55:34 +00:00
David Youngworth d0391db862 Merge branch 'release-6.2' into release-6.3 2020-11-16 10:15:23 -08:00
Xin Dong 8343c78bf0
Merge pull request #3960 from dongxinEric/misc/expose-proxy-local-rate-info
Expose local transaction rate and limit info on commit proxies.
2020-11-12 15:23:50 -08:00
Xin Dong 0b8e91b9c0 Do not count system priority and default priority txns together. 2020-11-11 14:01:01 -08:00
Xin Dong 6cea86b795 Address review comments 2020-11-10 16:05:17 -08:00
Vishesh Yadav 7b28de8a41 Add IDs to ConnectionReset TraceEvents 2020-11-04 14:06:49 -08:00
Vishesh Yadav 22b16302c3 Make ConnectionReset logs easier to query #3977
All TraceLogs that are related to ConnectionReset should be prefixed with
ConnectionReset. This should make it easy to query and aggregate by address and
role.
2020-11-02 15:10:51 -08:00
Xin Dong 77825a4784 Fix typo. 2020-10-29 14:27:31 -07:00
Xin Dong fbe421c6cb Added time-in-queue measurement for GRV requests. Added metrics to show each time when a read version is hand out, how much of the queue, percentage-wise, is served. 2020-10-29 14:22:45 -07:00
Xin Dong 36558d1450 Move to be part of proxy metrics 2020-10-26 16:25:56 -07:00
Xin Dong 2bccb050de Expose local transaction rate and limit info on commit proxies. 2020-10-23 17:32:27 -07:00
Chaoguang Lin 8d937a56f2 Throw operation_failed() if dd not found when calling ddMetricsRequestServer
Remove time_out error in DDMetricsList rpc
Add retry logic for dd special key when dd not found
Update FuzzApiCorrectness test
2020-10-21 15:28:03 -07:00
Jingyu Zhou 8f17a1a5d6 Merge branch 'release-6.2' into release-6.3 2020-10-16 15:25:39 -07:00
Evan Tschannen 1378ecba4d If a proxy is sufficiently far behind, reset network connections to attempt to fix the problem 2020-10-11 23:06:26 -07:00
Evan Tschannen efe50b68e6 fix compile error 2020-10-05 14:16:52 -07:00
Evan Tschannen 7ba06a4434 fix: min and max compute estimate logging on the proxy was always zero
added comments and fixed formatting
2020-10-05 12:35:10 -07:00
Evan Tschannen 5807b1ec3d changed the recent requests to be the per second amount; increased precision of cpu estimate 2020-10-04 19:31:40 -07:00
Evan Tschannen f546034366 do not prevent computePerOperation from being updated for small computeDurations. Added logging for the compute per operation. Protect against erroneously large compute estimates 2020-10-04 19:19:05 -07:00
Evan Tschannen 614c8bc895 Get read versions requests must be load balanced on the number of requests because ratekeeper gives out an equal budget to each proxy 2020-10-04 16:20:24 -07:00
Evan Tschannen 5c97461d18
Merge pull request #3653 from etschannen/feature-proxy-busy-loadbalance
Changed proxy load balancing to balance on CPU usage
2020-08-31 10:39:08 -07:00
Evan Tschannen 29eec30183 Merge branch 'release-6.2' into release-6.3
# Conflicts:
#	CMakeLists.txt
#	build/Dockerfile
#	build/Dockerfile.devel
#	documentation/sphinx/source/downloads.rst
#	fdbserver/Knobs.cpp
#	fdbserver/LogSystem.h
#	fdbserver/MasterProxyServer.actor.cpp
#	fdbserver/TagPartitionedLogSystem.actor.cpp
#	fdbserver/WaitFailure.actor.cpp
#	fdbserver/fdbserver.vcxproj
#	fdbserver/fdbserver.vcxproj.filters
#	packaging/msi/FDBInstaller.wxs
2020-08-31 01:10:29 -07:00
Evan Tschannen f6f9aea09e fix: runLoopBusyness was always zero 2020-08-28 09:29:54 -07:00
A.J. Beamon 9dd4589d61 Fix merge issue that resulted in commit and GV latency band info not being published. 2020-08-20 11:49:30 -07:00
Andrew Noyes 30c086ed96 Improve comment
Also use push_back. The lifetime of databaseLockedKey and
databaseLockedKeyEnd will outlive trRequest.arena, since they're
literals.
2020-08-20 18:05:03 +00:00
Andrew Noyes 9cf3041393 Add read conflict for metadata txs that aren't lock-aware 2020-08-20 02:52:37 +00:00
Evan Tschannen 539366156c more fixes 2020-08-12 17:26:20 -07:00
Evan Tschannen 7c84e04028 fixed compiler errors 2020-08-12 17:22:37 -07:00
Evan Tschannen c72068d6b5 clients load balance across proxies based on process busyness instead of number of requests 2020-08-12 17:17:21 -07:00
Andrew Noyes d2cf700bd4 Fix compiler warnings 2020-07-28 18:30:26 +00:00
Evan Tschannen fc49f432c6
Merge pull request #3437 from ajbeamon/auto-tag-throttling-fixes
Various fixes to tag throttling
2020-07-13 10:52:46 -07:00