Commit Graph

170 Commits

Author SHA1 Message Date
A.J. Beamon 469e77158f Add metacluster support for tenant locking 2023-02-27 16:53:13 -08:00
A.J. Beamon 8c3ee768a2 Add an option to allow exceeding the tenant group capacity limit when changing tenant configuration 2023-02-24 21:01:36 -08:00
Nim Wijetunga c8b7cff10c fix api test 2023-02-24 15:26:59 -08:00
Nim Wijetunga eca98afcb0 metacluster check tenant mode 2023-02-24 13:59:54 -08:00
A.J. Beamon 2b25cfef8b Merge branch 'main' into metacluster-concurrent-restore-testing 2023-02-23 16:06:47 -08:00
Jon Fu 33f8e90f9f
Split tenant group metadata (#9446)
* initial commit to split tenant group metadata

* attempt to fix merge errors

* fix compile errors and adjust existing tests

* fix infinite loop and extra ACTOR tag

* direct assignment instead of store

* direct assign instead of store (missed a few)
2023-02-23 18:11:49 -05:00
A.J. Beamon 3ac7e17b79 Fix create tenant usage in tenant management workload 2023-02-23 15:08:52 -08:00
A.J. Beamon 06fe00544a Remove TenantMapEntry <-> MetaclusterTenantMapEntry conversion constructors and use named functions instead 2023-02-23 13:28:10 -08:00
A.J. Beamon 87cb21be06
Merge pull request #9310 from sfc-gh-mpilman/features/tenant-lock2
Tenant Lock
2023-02-22 15:18:14 -08:00
Markus Pilman 8695fc15fc Merge remote-tracking branch 'origin/main' into features/tenant-lock2 2023-02-22 13:12:23 -07:00
A.J. Beamon 935cd70600 Use MetaclusterData and TenantData in the MetaclusterConsistencyCheck and TenantConsistencyCheck 2023-02-22 11:04:42 -08:00
Markus Pilman 15d8548c0e Merge remote-tracking branch 'origin/main' into features/tenant-lock2
# Conflicts:
#	fdbserver/ApplyMetadataMutation.cpp
#	fdbserver/storageserver.actor.cpp
2023-02-21 13:39:35 -07:00
Jon Fu 2d74d10a91 use MetaclusterAPI namespace over TenantAPI for TenantState 2023-02-21 11:33:36 -08:00
Jon Fu c0b332501b update code to match style 2023-02-21 11:17:25 -08:00
Jon Fu 9e01cffef0 fix some merge conflicts and address review comments 2023-02-21 10:29:36 -08:00
Jon Fu 762cbcdc5d unconditionally set restore id 2023-02-17 14:41:41 -08:00
Jon Fu edb7a51b7e Revert "let client supply restore id"
This reverts commit 5fe32b8503.
2023-02-17 14:37:22 -08:00
Jon Fu 5fe32b8503 let client supply restore id 2023-02-17 14:01:58 -08:00
Jon Fu 53fc43a3a6 Merge branch 'main' of github.com:apple/foundationdb into split-tenant-metadata 2023-02-16 14:46:03 -08:00
Yanqin Jin c3d6ae0213
Throw invalid_tenant_configuration when changing assigned cluster (#9350)
Since we currently do not support tenant movement, we should as well explicitly disallow changing the assigned
cluster of a tenant during configuration by throwing `invalid_tenant_configuration` for now.

Test plan:
- add coverage for changing assigned cluster during tenant configuration
- fdbcli
- simulation tests
2023-02-16 14:20:59 -08:00
Jon Fu 036078234e fix some leftover issues from branch merge 2023-02-16 12:54:45 -08:00
Jon Fu ab15478ef9 Merge branch 'main' of github.com:apple/foundationdb into split-tenant-metadata 2023-02-16 10:04:07 -08:00
Jon Fu 1af6d8ff92 fix various correctness issues and listTenant test 2023-02-15 15:01:17 -08:00
Jingyu Zhou a5ca96ddf6
Merge pull request #9342 from sfc-gh-ajbeamon/metacluster-mgmt-restore
Metacluster restore support
2023-02-14 20:41:20 -08:00
Xiaoxi Wang 53f105eec5 fix anyExisted when beginTenant==endTenant 2023-02-14 09:07:09 -08:00
Jon Fu ad210072c0 address code review 2023-02-13 13:29:19 -08:00
A.J. Beamon 98407809d9 Merge branch 'main' into metacluster-mgmt-restore
# Conflicts:
#	fdbcli/MetaclusterCommands.actor.cpp
#	fdbclient/Metacluster.cpp
#	fdbclient/include/fdbclient/MetaclusterManagement.actor.h
#	fdbserver/workloads/MetaclusterManagementWorkload.actor.cpp
#	tests/CMakeLists.txt
2023-02-13 12:30:33 -08:00
Markus Pilman 3017e15448 Merge remote-tracking branch 'origin/main' into features/tenant-lock2
# Conflicts:
#	fdbclient/include/fdbclient/TenantManagement.actor.h
#	fdbserver/storageserver.actor.cpp
#	fdbserver/workloads/TenantManagementWorkload.actor.cpp
2023-02-13 11:43:07 +01:00
Nim Wijetunga 9e5c61e127 address pr comments 2023-02-10 15:56:41 -08:00
Nim Wijetunga de9eef72ff address pr comments 2023-02-10 13:49:15 -08:00
Jon Fu 1c0e784a7a attempt to fix broken test workloads 2023-02-10 11:01:59 -08:00
A.J. Beamon 13eee09ce8 Merge branch 'main' into metacluster-mgmt-restore 2023-02-10 10:58:01 -08:00
Nim Wijetunga 8a3f3ea674 clean up code 2023-02-10 01:01:16 -08:00
Nim Wijetunga dd57e85064 remove traces 2023-02-09 23:05:43 -08:00
Nim Wijetunga fed650894d working version 2023-02-09 21:10:40 -08:00
Nim Wijetunga b7ef50d1f8 inital commit 2023-02-09 14:32:29 -08:00
Jon Fu d981d5e9c2 initial commit to separate metadata 2023-02-08 10:44:26 -08:00
Jon Fu c8e12a7921
Add tenant watches to storage server (#9284)
* add tenant watches to storage server

* combine watches and throw different error after first loop

* try to change SS tenantmap to avoid tenantname altogether

* update code style to be consistent

* add new operation in tenant management test

* address code review changes

* add more to tenant workload and fix id parse bug

* account for TenantRef in TenantData when renaming

* code review comments

* change test assertion
2023-02-07 17:08:51 -05:00
Markus Pilman f321933bc9 Minor bug fix 2023-02-06 17:34:46 +01:00
A.J. Beamon 6665eb6654 Update cluster recovery for tenant ID changes 2023-01-31 16:06:45 -08:00
Xiaoxi Wang 851b6e7e56 rename APIs 2023-01-31 11:16:17 -08:00
A.J. Beamon fd13bc04c8 Update the tenant maps to be keyed by ID 2023-01-23 14:09:12 -08:00
A.J. Beamon e1d48d28bf Remove tenant name from the TenantInfo object 2023-01-13 08:58:15 -08:00
Xiaoxi Wang c5dd447a8c set watchTenantCheck within deleteTenant 2023-01-12 15:18:31 -08:00
Xiaoxi Wang f0fd84e9f1 merge upstream/main; solve conflicts 2023-01-12 13:49:19 -08:00
Xiaoxi Wang 1b255dd2b6 fix the no tenant check failure 2023-01-12 12:05:55 -08:00
Xiaoxi Wang 229565c791 check SetVersionstampedKey offset 2023-01-10 23:58:51 -08:00
Xiaoxi Wang 3bcb55dccb
Apply suggestions from code review
Co-authored-by: A.J. Beamon <aj.beamon@snowflake.com>
2023-01-10 16:57:54 -08:00
Xiaoxi Wang 50217e7172 update workload checking because watch retry 2023-01-09 13:35:21 -08:00
Xiaoxi Wang 72597f7db6 format code; refactor tenant management workload setup; use fmt::print 2023-01-07 19:43:10 -08:00