72ff00a5ce
change TeamSelect variables names, and update comment
2023-03-29 13:46:04 -07:00
4f4f201138
delete TeamSelect::AvoidMovement, this PR is merely for refactor
2023-03-21 20:46:56 -07:00
93ef3e990e
add the underscore to TeamSelect::value, and move out 'TeamSelect::INVALID'
2023-03-21 15:48:33 -07:00
bad4ee745b
Merge remote-tracking branch 'upstream/main' into refactor-GetTeamRequest
2023-03-21 14:57:28 -07:00
6f687ece4d
change struct to class, add comment for DD Components class
2023-03-21 10:10:54 -07:00
303248b0b7
solve conflicts with MovingWindow PR #9591
2023-03-20 16:06:38 -07:00
dea76f62cf
merge upstream/main without completely clean up conflicts
2023-03-20 16:01:00 -07:00
a258d775c3
Merge pull request #9710 from sfc-gh-etschannen/feature-custom-dd
...
Added the ability to manually create a shard and also increase its replication factor
2023-03-20 15:35:10 -07:00
d2c1b3124e
add a field to show average data movement bytes in MovingData trace ( #9591 )
...
* add a field to show average data movement bytes in MovingData trace
* change variable type
* Make changes to variable/function naming and add more comments
* move rolling window struct to a new file; deal with corner case: dd startup, elements are full
* format
* simplify codes
* modify file/struct name, universal to moving window
* fix typo
* add a new Knob to control MovingWindow::Deque size
* make the general use of dequeSize limit
* format
* format, use space rather than tab
2023-03-20 14:33:32 -07:00
4615926d3f
merge upstream/main and solve conflicts
2023-03-17 21:27:19 -07:00
5f4e3a95c5
change run function use reference parameter rather than pointer
2023-03-17 20:59:18 -07:00
73767501d4
Merge branch 'main' into feature-custom-dd
...
# Conflicts:
# fdbserver/tester.actor.cpp
2023-03-17 10:33:38 -07:00
0f5e75b34b
Added newDataMoveId(). ( #9647 )
...
* Added newDataMoveId().
* Added `ENABLE_DD_PHYSICAL_SHARD_MOVE`
* fmt.
* Replace `teamId` with `shardId`.
2023-03-16 18:06:06 -07:00
ac54962533
code cleanup
2023-03-16 09:47:21 -07:00
8d9e905258
refactor GetTeamRequest
2023-03-15 14:47:34 -07:00
aaf7b9b32b
Added the ability to manually create a shard and also increase its replication factor
2023-03-15 11:26:15 -07:00
0c718f7a04
Fixing double-completing of destination servers in busy map ( #9629 )
2023-03-09 09:43:45 -06:00
26ffcf6b4a
add knob for min read rebalance shard bandwidth
2023-03-02 11:26:27 -08:00
613391f40f
Make DDQueue and DDShardTracker reference counted
2023-02-27 22:36:31 -08:00
7e14324cc1
remove dataDistributionQueue actor and replace it with class DDQueue
2023-02-23 17:15:33 -08:00
9cda7ebe5a
encapsulate DDQueue constructor params into DDQueueInitParams
2023-02-23 15:38:48 -08:00
cdfaf7d4e0
move DDRelocationQueue to header file
2023-02-23 13:12:38 -08:00
985bbe66d4
Add support for flatMap in optional and erroror. Allow calling map with a lambda without specifying the return type template parameter.
2022-12-15 15:32:02 -08:00
68f14f017c
Fix clang 15 compiler warnings
2022-12-08 13:59:37 -08:00
86d6106dc1
format source code after switch to clang 15
2022-12-08 17:26:45 +00:00
7e55522cb0
Fix simulation failure with the new MoveKeysParams
2022-11-29 13:29:02 -08:00
3c9130e6d1
Make startMoveShards take a list of key ranges
2022-11-29 13:29:02 -08:00
f6612ebd00
When selecting physical shard and it is not available for the remote team, retry selecting a new dst physical shard
2022-11-17 15:44:17 -08:00
3a5cf32f0b
Trying to re-use existing physical shard during data movement
2022-11-16 16:36:00 -08:00
c09092921b
Revert debugging info and apply clang-format
2022-11-15 09:41:21 -08:00
18b07368ed
Add more detailed reasons for physical shard creation
2022-11-15 09:41:21 -08:00
f25577f4c2
Apply clang-format
2022-11-11 17:21:32 -08:00
b90aecad2f
Update shard move flag name
2022-11-11 17:21:32 -08:00
30af886389
Clean up DD remote team selection in physical shard move
2022-11-11 17:21:32 -08:00
0140991d15
Rename NewPhysicalShardReason to RetryFindDstReason
2022-10-24 15:18:20 -07:00
fc9295ab66
Address comments
2022-10-24 15:18:20 -07:00
22047385c4
Count the detailed reason for new physical shard creation during data move
2022-10-24 15:18:20 -07:00
ada51ff12b
Add a counter to track physical shard creation throuogh moves
2022-10-21 10:22:42 -07:00
ea1325a552
Merge pull request #8319 from sfc-gh-tclinkenbeard/add-rare-code-probe-annotation
...
Add `rare` code probe decoration
2022-10-07 09:39:00 -06:00
df9b21169d
change shared_ptr to Reference
2022-09-27 11:22:47 -07:00
985958c260
Add rare code probe decoration
2022-09-25 15:28:32 -07:00
1194774d54
rename dbProcessor to db; rename getDb() to context()
2022-09-23 15:35:39 -07:00
11a6cba2c6
rename dbProcessor to db; readability improvement
2022-09-22 17:11:07 -07:00
aaed0c8b7e
Actor to DDQueue methods
2022-09-21 17:57:40 -07:00
5500ec8126
replace BgDDMountainChopper and BgDDValleyFiller with BgDDLoadRebalance
2022-09-21 15:11:04 -07:00
9358aea097
fix busy loop with correct error handling in valley filler
2022-09-21 14:58:34 -07:00
f9e0230b86
DDQueue constructor with ITxnProcessor
2022-09-21 10:56:22 -07:00
82adc1e856
Make g_simulator a pointer
2022-09-15 09:00:33 -07:00
949b1c1af9
Add MoveKeysParams struct; use txnProcessor->moveKeys()
2022-09-12 15:40:18 -07:00
7932840eaf
Prevent GetTopKMetricsRequest.topK < 1
2022-09-02 12:20:24 -07:00
zhongxing.zhang