Commit Graph

5188 Commits

Author SHA1 Message Date
Xiaoxi Wang e94de126de merge with master 2020-08-14 01:59:09 +00:00
Meng Xu ced4f8c49f fix: getReadHotRanges should be const function 2020-08-12 22:18:28 -07:00
Meng Xu 002cca5e58 Merge branch 'master' into tmp/merge-PR
Conflicts:
	fdbclient/NativeAPI.actor.cpp
	fdbserver/StorageMetrics.actor.h
2020-08-12 20:08:13 -07:00
Xiaoxi Wang 8f1deaa47e Merge branch 'master' of https://github.com/apple/foundationdb 2020-08-12 23:32:23 +00:00
Xin Dong e13e7c5725
Update fdbserver/workloads/ReadHotDetection.actor.cpp
Co-authored-by: Jingyu Zhou <jingyuzhou@gmail.com>
2020-08-12 15:48:01 -07:00
Xin Dong b17667323e Resolve review comments 2020-08-12 15:15:25 -07:00
Xin Dong 3ac6996844 Increased some knobs to throttle the spammy read hot logging. Also added more details inside the read hot log to make it useful 2020-08-12 14:27:34 -07:00
Xiaoxi Wang f3ecf14601 change midShardSize type and other details 2020-08-12 17:49:12 +00:00
Meng Xu 0d0efcfce7 FR:Fix incorrect ASSERT:batchIndex starts at 1 instead of 0 2020-08-12 10:36:31 -07:00
Evan Tschannen 2f52c5f79b Merge branch 'release-6.3'
# Conflicts:
#	fdbserver/RestoreLoader.actor.cpp
2020-08-11 22:45:43 -07:00
Xiaoge Su 4268f3c900 fixup! Fix the bug introduced in commit a7cff484bc 2020-08-11 18:21:10 -07:00
Xiaoxi Wang 0cceda9908 solve distributor present bug 2020-08-11 21:54:52 +00:00
Xiaoxi Wang 7ee6ca342e merge with master 2020-08-11 01:01:15 +00:00
Xiaoxi Wang c0b7ac0b7d try to throttle write tag and read tag seperatedly 2020-08-10 23:43:58 +00:00
Xiaoxi Wang cae6f04070 sample on cost instead of bytes 2020-08-10 22:30:06 +00:00
Meng Xu c5c6906a3d
Merge pull request #3600 from xumengpanda/mengxu/fr-fix-large-pkg-PR
Fast Restore: Fix the sampling packet size at sampling phase
2020-08-10 13:53:24 -07:00
Xiaoxi Wang 696e77c94e query midShardSize from proxy 2020-08-10 20:13:44 +00:00
Young Liu c4d2d66de7 Merge master branch and resolve conflicts 2020-08-07 18:04:00 -07:00
Meng Xu c89a62b935 FR:SampleBackup:Assert req.batchIndex < controller batch size 2020-08-07 16:52:07 -07:00
Meng Xu c27542d4e9 FR:SampleBackup:Send reply when receive duplicate msg 2020-08-07 16:50:36 -07:00
Xiaoxi Wang df9149fea4 ignore transaction tag of immediate transactions 2020-08-07 23:36:17 +00:00
Meng Xu fccebd9b80 FR:Use ByteSampleInfo to accurately sample backup 2020-08-06 20:45:46 -07:00
Xiaoge Su b9f41f3975 Rename CommitBatch::Context to CommitBatch::CommitBatchContext 2020-08-06 11:40:40 -07:00
Xiaoge Su d8bb36c4c8 Refactor applyMetadataMutations to accept less args 2020-08-06 11:40:40 -07:00
Xiaoge Su ed1bbdb8a7 fixup! Update code per review 2020-08-06 11:40:40 -07:00
Xiaoge Su 377f0695b0 Refactor postResolution 2020-08-06 11:40:40 -07:00
Xiaoge Su 9f8244f2dd Add a shortcut for applyMetadataMutations 2020-08-06 11:40:40 -07:00
Xiaoge Su 376aff079c Extract Step 4 and 5 from commitBatch 2020-08-06 11:40:40 -07:00
Xiaoge Su a7cff484bc Extract Step 3 from commitBatch 2020-08-06 11:40:40 -07:00
Xiaoge Su ccb103caf1 Extract Step 1 and 2 from commitBatch 2020-08-06 11:40:40 -07:00
Meng Xu 87bde08695 FR:fix:sending samples may have broken promise error
The error should not skip the ack reply from loader to controller, saying
the file has been loaded.
Otherwise, restore controller can get stuck at waiting for the ack reply.
2020-08-06 10:41:18 -07:00
Xiaoxi Wang ba66b1f668 trivial changes 2020-08-06 14:53:26 +00:00
Young Liu 2e41391690 Merge master branch 2020-08-06 00:11:00 -07:00
Meng Xu fe5902994c
Merge pull request #3605 from apple/release-6.3
Merge Release 6.3 to master
2020-08-05 23:37:44 -07:00
Chaoguang Lin 8defd8ff8d reset transaction at the end of the test 2020-08-05 13:25:21 -07:00
Chaoguang Lin b00b1bb30f Add a test for management api options 2020-08-05 13:20:12 -07:00
Evan Tschannen ca5705b5ea
Merge pull request #3576 from Daniel-B-Smith/rocksdb-fixes
RocksDB fixes
2020-08-05 11:32:22 -07:00
Meng Xu 859c3145e2 FR:Fix samples not send reply and false positive failures 2020-08-05 11:32:04 -07:00
Xiaoxi Wang 9640ba42d3 merge master 2020-08-05 16:23:10 +00:00
Meng Xu 309f383be3 FR:Report error if controller throws error 2020-08-04 23:08:41 -07:00
Meng Xu 879998d01b FR:fix compilation error 2020-08-04 23:04:38 -07:00
Meng Xu 7992cef025 FR:Fix sample network pkg can be too big 2020-08-04 22:35:21 -07:00
Xiaoxi Wang 13307679c5 use median shard size" 2020-08-05 03:57:25 +00:00
MintYiqingchen d21e9766fe fix #3512 merge problem 2020-08-05 01:35:32 +00:00
Xiaoxi Wang 4997754cf8 fix format in monitorDDMetricsChanges 2020-08-04 04:14:11 +00:00
Xiaoxi Wang 484a75dd7b compare read and write tag together 2020-08-04 00:02:41 +00:00
Xiaoxi Wang 52073738c0 fix bugs; change some KNOB values 2020-08-03 22:18:34 +00:00
Meng Xu e9adec421d FR:Add controller interface and send to roles 2020-08-03 15:06:15 -07:00
Meng Xu f071d81ad0 Report warning on FastRestoreApplierClearRangeMutationsStart if delayTime is too large 2020-08-03 14:08:31 -07:00
Xiaoxi Wang b903e60cb7 fix monitorDDMetricsChanges bugs 2020-08-03 17:12:36 +00:00