Commit Graph

523 Commits

Author SHA1 Message Date
A.J. Beamon 66fa403c86 Merge branch 'release-6.2' into merge-release-6.2-into-release-6.3
# Conflicts:
#	CMakeLists.txt
#	documentation/sphinx/source/downloads.rst
#	fdbserver/Knobs.cpp
#	packaging/msi/FDBInstaller.wxs
#	versions.target
2021-02-09 08:55:24 -08:00
A.J. Beamon 67e783acf8 Merge branch 'release-6.2' into merge-release-6.2-into-release-6.3
# Conflicts:
#	cmake/CompileBoost.cmake
#	cmake/FDBComponents.cmake
#	fdbrpc/AsyncFileCached.actor.h
#	fdbrpc/simulator.h
#	fdbserver/KeyValueStoreSQLite.actor.cpp
#	fdbserver/Knobs.cpp
#	fdbserver/Knobs.h
#	fdbserver/storageserver.actor.cpp
#	flow/Knobs.h
#	flow/network.h
2021-02-08 09:20:28 -08:00
Evan Tschannen c326c263a8 Updated knobs to enable low priority reads when durability lag is larger than 200 seconds 2021-02-07 22:58:11 -08:00
A.J. Beamon 5e80e16802
Revert "CDs reject requests from external cluster or requests need to be forwarded based on an old forward request." 2021-02-05 13:05:33 -08:00
Evan Tschannen 8091d8179d
Merge pull request #4252 from dongxinEric/feature/4251/cds-reject-requests-from-other-cluster
CDs reject requests from external cluster or requests need to be forwarded based on an old forward request.
2021-02-04 17:33:07 -08:00
Xin Dong 549e51f7d6 Fix usage of the new knob value. 2021-02-04 12:43:08 -08:00
Meng Xu 1db4b73215
Merge pull request #4243 from sfc-gh-etschannen/feature-storage-io-timeout
throw an io_timeout if it takes more than 2 minutes to commit on the storage server
2021-02-03 18:10:16 -08:00
Meng Xu 675e567305
Merge pull request #4218 from sfc-gh-etschannen/feature-low-priority-reads-6.2
Reduce read priority when durability lag is high
2021-02-03 18:09:39 -08:00
Evan Tschannen 068647ba1b updated naming and comments 2021-02-03 14:24:39 -08:00
Evan Tschannen a0a71ff7f9 simplified the algorithm based on testing 2021-02-02 17:53:07 -08:00
Chaoguang Lin 769a3148ba Format code 2021-02-02 14:36:49 -08:00
Steve Atherton 45262f6702
Fix comment. 2021-02-02 14:26:39 -08:00
Chaoguang Lin f6342376ab Update the knob name 2021-02-02 13:31:00 -08:00
Chaoguang Lin 593165679a Remove unnecessary header 2021-02-02 12:42:46 -08:00
Chaoguang Lin 17671604c0 Add option to define I/O size 2021-02-02 12:39:05 -08:00
Russell Sears 84bb5412f8
Merge pull request #4201 from Daniel-B-Smith/rocksdb-prefix
Add knobs for prefix bloom filters and larger block cache
2021-02-01 15:29:28 -08:00
Xin Dong 1cc8c1d8ec Guard CD's cross cluster check behind a KNOB controlled flag and disable it by default. 2021-02-01 14:39:30 -08:00
Daniel Smith de700b83f2 Review fixes 2021-02-01 21:58:39 +00:00
Xin Dong 4e81b9275b Allow the user to diable forward expiry check by setting the threshold to -1 2021-02-01 10:50:04 -08:00
Steve Atherton e56fe02a25 Merge branch 'add-throttling-on-AsyncfileCached' of github.com:sfc-gh-clin/foundationdb into afcache-write-limit 2021-01-30 18:11:54 -08:00
Xin Dong 9f837a3b84 Coordinators will not serve following requests after this change:
- A request that needs to be forwarded after the forward was set for a long(configured via Knobs) time.
- A request that has a different connection string than the CD's local connection string.

Simulation has been made to work with this change.
2021-01-29 13:24:45 -08:00
Evan Tschannen 3e2a0a5264 throw an io_timeout if it takes more than 2 minutes to commit on the storage server 2021-01-27 11:50:42 -08:00
Evan Tschannen 50f506f9a1 reduce read priority when durability lag is high 2021-01-20 16:16:50 -08:00
Steve Atherton 523a8c08db Merge branch 'add-throttling-on-AsyncfileCached' of github.com:sfc-gh-clin/foundationdb into afcache-write-limit
# Conflicts:
#	flow/Knobs.h
2021-01-17 05:30:55 -08:00
Daniel Smith ecf5c2b591 Add knobs for prefix bloom filters and larger block cache 2021-01-11 21:38:34 +00:00
Russell Sears 4cb821cd63 Merge remote-tracking branch 'upstream/release-6.2' into merge-6.2-to-6.3 2020-12-09 15:47:44 -08:00
Chaoguang Lin 9156d38216 Add knob SQLITE_READER_THREADS to control the number of read threads 2020-12-09 12:09:07 -08:00
A.J. Beamon fa4d87f432
Merge pull request #4112 from sfc-gh-tclinkenbeard/6.3-fix-tlog-pop-slow-task
Yield while processing ignored pop requests on tlog
2020-12-04 09:20:36 -08:00
sfc-gh-tclinkenbeard 7e815ebb68 Added TLOG_POP_BATCH_SIZE knob 2020-12-03 11:56:55 -08:00
Jingyu Zhou df5293e2be Add a knob PROXY_REJECT_BATCH_QUEUED_TOO_LONG
Disable the proxy rejection feature for backup workload, because of the
ApplyMutationsError.
2020-11-28 21:32:41 -08:00
Andrew Noyes dc2bac5670 Resolve conflicts 2020-11-24 19:09:42 +00:00
Andrew Noyes 1f541f02be Merge branch 'anoyes/merge-6.2-to-6.3' into anoyes/release-6.3-merge
Merge, leaving conflict markers for now
2020-11-24 16:55:34 +00:00
Russell Sears fc8b57189e
Merge pull request #3969 from Daniel-B-Smith/rocksdb-unsafe-fsync
RocksDB grab bag
2020-11-18 10:09:24 -08:00
David Youngworth d0391db862 Merge branch 'release-6.2' into release-6.3 2020-11-16 10:15:23 -08:00
Xiaoge Su 3a6948c199 Report histogram periodically 2020-11-12 17:04:33 -08:00
Xiaoge Su acbd4c1f39 Extract FETCH_KEYS_TOO_LONG_TIME_CRITERIA to Knob 2020-11-12 13:01:41 -08:00
Xiaoge Su da31eb3d89 Periodically report the fetchKeys status 2020-11-09 15:24:05 -08:00
Daniel Smith 5825af272f Fix whitespace 2020-11-04 22:06:30 +00:00
Steve Atherton 99c1880a83 Merge commit 'f9581de2005e6b085776e81b9fcaa16442b32589' into merge-6.2-to-6.3
# Conflicts:
#	fdbserver/Knobs.cpp
#	fdbserver/Knobs.h
2020-10-27 12:21:26 -07:00
Xin Dong 0bc51bb780 Resolve review comments 2020-10-26 16:44:50 -07:00
Xin Dong c037bfd001 Added detailed logging when there is no servers left in a server team, because that may indicate a data loss incident. 2020-10-26 16:44:07 -07:00
Daniel Smith 44dc1303bb Merge remote-tracking branch 'upstream/release-6.3' into rocksdb-unsafe-fsync 2020-10-26 19:24:33 +00:00
Meng Xu b0d78ecf37
Merge pull request #3912 from dongxinEric/misc/log-detailed-teams-info-in-dd
Added a way to print detailed information about team collection for d…
2020-10-24 19:06:10 -07:00
Xin Dong f757cae786 Address review comments 2020-10-23 14:01:53 -07:00
Xin Dong 8d0aa02a63 Do not periodically print detailed DD teams info 2020-10-16 16:11:14 -07:00
Jingyu Zhou 8f17a1a5d6 Merge branch 'release-6.2' into release-6.3 2020-10-16 15:25:39 -07:00
Xin Dong 92e31dd338 Address review comments 2020-10-15 15:25:00 -07:00
Xin Dong 1d43729cc9 Added a way to print detailed information about team collection for debugging. 2020-10-15 10:01:56 -07:00
Daniel Smith a99b68a7e3 Add knob for tuning number of RocksDB read threads 2020-10-14 22:07:46 +00:00
Evan Tschannen 1378ecba4d If a proxy is sufficiently far behind, reset network connections to attempt to fix the problem 2020-10-11 23:06:26 -07:00