Commit Graph

84 Commits

Author SHA1 Message Date
Meng Xu 90861ead6a Reenable all tests in BackupAndParallelRestoreWithAtomicOp 2020-06-23 08:29:31 -07:00
Meng Xu b122575dda BackupAndParallelRestoreWithAtomicOp:Turn on debug options 2020-06-22 16:53:43 -07:00
Meng Xu 16898408ae FastRestore:Rename tests for new backup by adding NewBackup keyword 2020-04-01 21:31:54 -07:00
Meng Xu 1eea388278 Add unit test for splitMutation test file
Comment out debug trace as well.
2020-04-01 21:27:18 -07:00
Meng Xu 321b1b6ee7 Add RunRestoreWorkerWorkload into Parallel Restore WriteDuringReadAtomicRestore tests 2020-03-31 18:48:29 -07:00
Meng Xu a1d2779f04 Add ParallelRestoreWriteDuringReadAtomicRestore.txt
Test for fast restore with new backup.
2020-03-31 18:25:17 -07:00
Meng Xu 0fa3bfa6f3 Increase timeout threshold for ParallelRestoreOldBackupWriteDuringReadAtomicRestore.txt 2020-03-31 18:21:36 -07:00
Meng Xu faab8a0d19 Add ParallelRestoreOldBackupApiCorrectnessAtomicRestore.txt
Add tests/ParallelRestoreApiCorrectnessAtomicRestore.txt back which
was mistakenly deleted in the previous commit.
2020-03-30 21:59:47 -07:00
Meng Xu 73345a7ebd Add new tests for parallel restore
Add two tests for parallel restore with old backup data
ParallelRestoreApiCorrectnessAtomicRestore.txt
ParallelRestoreOldBackupWriteDuringReadAtomicRestore.txt
2020-03-30 21:53:26 -07:00
Meng Xu 6e60c62d7b Add ParallelRestoreCorrectnessAtomicOp.txt 2020-03-28 16:00:51 -07:00
Meng Xu f7233bade7 Rename ParallelRestoreCorrectnessAtomicOpTinyData.txt by removing TinyData 2020-03-27 13:08:59 -07:00
Meng Xu 5c6752fb24 Add tests for new restore with old backup 2020-03-27 13:07:38 -07:00
Meng Xu 97f8e46388 Sanity check subversion for log mutations 2020-03-27 13:07:08 -07:00
Jingyu Zhou 96a7b4b459 Disable ParallelRestoreApiCorrectnessAtomicRestore test 2020-03-26 14:59:50 -07:00
Jingyu Zhou cffcac92ad Disable partitioned log for atomic restore workload
This will be reenabled after fixing test failures related to it.
2020-03-26 13:07:40 -07:00
Meng Xu 6a8d6ddb8e Introduce ParallelRestoreApiCorrectnessAtomicRestore.txt test
This covers ApiCorrectnessTest as workload for parallel restore.
2020-03-24 22:30:51 -07:00
Meng Xu d185359422 ApiCorrectnessAtomicRestore test: Increase timeout value 2020-03-24 17:36:17 -07:00
Meng Xu d7cf562ec4 Enable rollback workload for multi cycle restore test 2020-03-23 16:33:11 -07:00
Meng Xu 85a9f6ab96 Merge branch 'master' into mengxu/fr-enable-rollback-and-abort-test-PR 2020-03-23 16:32:00 -07:00
Meng Xu 14c641ce2b Enable rollback workload 2020-03-23 16:29:01 -07:00
Meng Xu 4756447b74 Enable abortAndRestartAfter option for restore cycle test 2020-03-23 15:15:14 -07:00
Meng Xu f936adedb0 Change tab to space for test workload file 2020-03-23 15:10:35 -07:00
Meng Xu 9c2c3b26d3 Merge branch 'master' into mengxu/fr-multi-cycle-test-PR 2020-03-23 13:54:20 -07:00
Meng Xu 00ada7e086 Enable attrition workload for restore multi cycle tests 2020-03-23 13:50:05 -07:00
Meng Xu ace19eefe4 Introduce multi cycle tests for fast restore 2020-03-23 12:59:43 -07:00
Meng Xu 5b2b2a8767 Enable assassination for restore cycle test 2020-03-23 12:28:04 -07:00
Meng Xu 48db54424f Add assassination workload to restore test workload
Add assert to ensure restore worker is reliable and not killed.
2020-03-23 11:11:13 -07:00
Meng Xu e9fa7803a8 FastRestore:Test:Let simulation tests turn buggify on and off 2020-02-20 07:06:04 -08:00
Meng Xu 0507e9703c FastRestore:Disable abort fast restore test 2020-02-20 06:54:14 -08:00
Meng Xu e794003b16 FastRestore:AtomicOpTest:Enable buggify 2020-02-19 20:25:07 -08:00
Meng Xu 4d027428df FastRestore:Test:Increase txn load to 2500txn per second
More transactions per second can create more data in a backup version,
this can help test if fast restore handles large memory allocation correctly.
2019-12-16 12:13:29 -08:00
Meng Xu 64abaaf02d FastRestore:Reenable tests for nightly test 2019-12-12 07:57:52 -08:00
Meng Xu 04230b59bf Increase load a bit 2019-12-07 21:14:56 -08:00
Meng Xu 78b8961891 Move parallel restore tests to tests folder
Valgrind found errors on these two parallel restore tests,
although correctness test confirms these two tests have no correctness error.

To prevent these two parallel restore tests from spamming valgrind test results,
we exclude these two tests from our nightly tests for now.
2019-11-25 10:53:10 -08:00
Meng Xu 7cf87e9ae3 FastRestore:Add ParallelRestoreCorrectnessCycle.txt test 2019-11-03 17:31:54 -08:00
Meng Xu 63359bfc8b FastRestore:handleInitVersionBatchRequest:Ensure exact once execution
Also increase the test workload for BackupAndParallelRestoreWithAtomicOp test
2019-11-03 17:26:13 -08:00
Jingyu Zhou a30e6ec147
Merge pull request #2277 from xumengpanda/mengxu/fastrestore-atomicOpTest-increaseLoadAndBugFix-PR
Performant restore [7/XX]: Add tests for transactionBatchSizeThreshold when apply mutations
2019-10-24 21:21:14 -07:00
Meng Xu 7af3239ee7 FastRestore:AtomicOpTest:Debug:1 key per group for ops keyspace 2019-10-23 14:36:34 -07:00
Meng Xu ba7e499efe FastRestore:AtomicOpTest:Limit 1 actor per client 2019-10-23 14:04:14 -07:00
Meng Xu e676348710
Merge pull request #1955 from fzhjon/mark-ss-failed
Add fdbcli and API command to mark storage servers as permanently failed
2019-10-22 23:36:30 -07:00
Meng Xu 96d463bab6 FastRestore:Fix bug in applying mutations and increase atomicOp test worload
When Applier applies mutations to the destination cluster, it advances the
mutation cursor twice when it should only advance it once.
This makes restore miss some mutations when the applying txn includes
more than 1 mutations.
2019-10-22 23:24:23 -07:00
Meng Xu 970327b554 FastRestore:Add ParallelRestoreCorrectnessAtomicOpTinyData.txt 2019-10-21 14:42:11 -07:00
Jon Fu 450a09e117 Code Review Changes 2019-09-24 15:48:50 -07:00
Jon Fu 807b02551e updated help message and changed existing workload to use mark as failed feature 2019-08-27 14:39:43 -07:00
Trevor Clinkenbeard 8f06ccb065 Increased testDuration for DifferentClustersSameRV test
Unlocking the second database can take a while because the local
ratekkeeper throttles reads until the updateStorage actor catches up
after advanceVersion
2019-06-25 16:56:49 -07:00
Trevor Clinkenbeard 148f922813 Revert "Add CycleTest (currently times out)"
This reverts commit f367fcaf25.
2019-06-20 18:34:41 -07:00
Andrew Noyes f367fcaf25 Add CycleTest (currently times out) 2019-06-11 14:10:34 -07:00
Andrew Noyes 02e173b601 Add changeConnectionFile method to Transaction
Also add tests
2019-06-11 13:58:22 -07:00
Alex Miller 6d23eb2d1a Implement log_version.
This mega-commit introduces a new configuration setting, `log_version`,
that controls the TLog implementations and features that are available
within FDB, so that users can opt in to new features if they're willing
to sacrifice backwards compatibility.
2019-02-22 12:15:23 -08:00
Evan Tschannen d8ea3dbf9a Added the ability to configure a cluster from a JSON file 2018-08-16 17:34:59 -07:00