Commit Graph

93 Commits

Author SHA1 Message Date
Alex Miller 878254497a Merge remote-tracking branch 'upstream/master' into toml-testspec 2020-07-19 22:18:31 -07:00
Meng Xu dd85a1ec04 Fix LowLatencyWithFailures.txt
connectionFailuresDisableDuration and minimumReplication global variable should come before testName
2020-07-15 14:17:55 -07:00
Meng Xu 8ae0d9b73d Resolve merge conflict 2020-07-13 10:21:53 -07:00
Meng Xu ef8c1060a2 Merge branch 'master' into mengxu/tmp-merge-6.3 2020-07-13 10:15:56 -07:00
sfc-gh-tclinkenbeard d0189ad0d4 Relax commit latency requirement for LowLatency workload 2020-07-12 20:01:57 -07:00
Alex Miller 2841efe938 Rewrite most .txt tests into (pretty) .toml files.
This includes build/txt-to-toml.py which did the rewrites, and
can be used to rewrite other no-in-tree test spec files to toml.

I didn't touch status or restarting tests yet.  Restarting will be handled
later.  It turns out that I don't understand how status tests work.
2020-07-12 14:47:40 -07:00
Jingyu Zhou a5af214861 Use KeyRangeMap for splitMutation
This simplifies code by reuse KeyRangeMap class.
2020-07-09 09:59:37 -07:00
Jingyu Zhou e78cc9ee4b Use KeyRangeMap for splitMutation
This simplifies code by reuse KeyRangeMap class.
2020-07-08 09:53:34 -07:00
Alex Miller 17570b5b10 Make the testspec more restrictive in terms of what can be set where.
Testspec is currently very permissive in very misleading ways.  In particular,
the tester parser itself will swallow K=V settings and apply them at the test
level, which breaks how a person would expect the scoping to work.  Other
settings apply to the entire simulation run globally, but appear to be workload
specific.  Even further, others affect simulation cluster creation or test
harness behavior, but can again be set anywhere in a testspec.

This changes testspec parsing to error if a setting that applies globally is
anywhere but the top of the file, or if a setting that applies test-wide is
applied to a workload instead of a test.
2020-07-06 02:03:30 -07:00
Meng Xu 90861ead6a Reenable all tests in BackupAndParallelRestoreWithAtomicOp 2020-06-23 08:29:31 -07:00
Meng Xu b122575dda BackupAndParallelRestoreWithAtomicOp:Turn on debug options 2020-06-22 16:53:43 -07:00
Meng Xu 16898408ae FastRestore:Rename tests for new backup by adding NewBackup keyword 2020-04-01 21:31:54 -07:00
Meng Xu 1eea388278 Add unit test for splitMutation test file
Comment out debug trace as well.
2020-04-01 21:27:18 -07:00
Meng Xu 321b1b6ee7 Add RunRestoreWorkerWorkload into Parallel Restore WriteDuringReadAtomicRestore tests 2020-03-31 18:48:29 -07:00
Meng Xu a1d2779f04 Add ParallelRestoreWriteDuringReadAtomicRestore.txt
Test for fast restore with new backup.
2020-03-31 18:25:17 -07:00
Meng Xu 0fa3bfa6f3 Increase timeout threshold for ParallelRestoreOldBackupWriteDuringReadAtomicRestore.txt 2020-03-31 18:21:36 -07:00
Meng Xu faab8a0d19 Add ParallelRestoreOldBackupApiCorrectnessAtomicRestore.txt
Add tests/ParallelRestoreApiCorrectnessAtomicRestore.txt back which
was mistakenly deleted in the previous commit.
2020-03-30 21:59:47 -07:00
Meng Xu 73345a7ebd Add new tests for parallel restore
Add two tests for parallel restore with old backup data
ParallelRestoreApiCorrectnessAtomicRestore.txt
ParallelRestoreOldBackupWriteDuringReadAtomicRestore.txt
2020-03-30 21:53:26 -07:00
Meng Xu 6e60c62d7b Add ParallelRestoreCorrectnessAtomicOp.txt 2020-03-28 16:00:51 -07:00
Meng Xu f7233bade7 Rename ParallelRestoreCorrectnessAtomicOpTinyData.txt by removing TinyData 2020-03-27 13:08:59 -07:00
Meng Xu 5c6752fb24 Add tests for new restore with old backup 2020-03-27 13:07:38 -07:00
Meng Xu 97f8e46388 Sanity check subversion for log mutations 2020-03-27 13:07:08 -07:00
Jingyu Zhou 96a7b4b459 Disable ParallelRestoreApiCorrectnessAtomicRestore test 2020-03-26 14:59:50 -07:00
Jingyu Zhou cffcac92ad Disable partitioned log for atomic restore workload
This will be reenabled after fixing test failures related to it.
2020-03-26 13:07:40 -07:00
Meng Xu 6a8d6ddb8e Introduce ParallelRestoreApiCorrectnessAtomicRestore.txt test
This covers ApiCorrectnessTest as workload for parallel restore.
2020-03-24 22:30:51 -07:00
Meng Xu d185359422 ApiCorrectnessAtomicRestore test: Increase timeout value 2020-03-24 17:36:17 -07:00
Meng Xu d7cf562ec4 Enable rollback workload for multi cycle restore test 2020-03-23 16:33:11 -07:00
Meng Xu 85a9f6ab96 Merge branch 'master' into mengxu/fr-enable-rollback-and-abort-test-PR 2020-03-23 16:32:00 -07:00
Meng Xu 14c641ce2b Enable rollback workload 2020-03-23 16:29:01 -07:00
Meng Xu 4756447b74 Enable abortAndRestartAfter option for restore cycle test 2020-03-23 15:15:14 -07:00
Meng Xu f936adedb0 Change tab to space for test workload file 2020-03-23 15:10:35 -07:00
Meng Xu 9c2c3b26d3 Merge branch 'master' into mengxu/fr-multi-cycle-test-PR 2020-03-23 13:54:20 -07:00
Meng Xu 00ada7e086 Enable attrition workload for restore multi cycle tests 2020-03-23 13:50:05 -07:00
Meng Xu ace19eefe4 Introduce multi cycle tests for fast restore 2020-03-23 12:59:43 -07:00
Meng Xu 5b2b2a8767 Enable assassination for restore cycle test 2020-03-23 12:28:04 -07:00
Meng Xu 48db54424f Add assassination workload to restore test workload
Add assert to ensure restore worker is reliable and not killed.
2020-03-23 11:11:13 -07:00
Meng Xu e9fa7803a8 FastRestore:Test:Let simulation tests turn buggify on and off 2020-02-20 07:06:04 -08:00
Meng Xu 0507e9703c FastRestore:Disable abort fast restore test 2020-02-20 06:54:14 -08:00
Meng Xu e794003b16 FastRestore:AtomicOpTest:Enable buggify 2020-02-19 20:25:07 -08:00
Meng Xu 4d027428df FastRestore:Test:Increase txn load to 2500txn per second
More transactions per second can create more data in a backup version,
this can help test if fast restore handles large memory allocation correctly.
2019-12-16 12:13:29 -08:00
Meng Xu 64abaaf02d FastRestore:Reenable tests for nightly test 2019-12-12 07:57:52 -08:00
Meng Xu 04230b59bf Increase load a bit 2019-12-07 21:14:56 -08:00
Meng Xu 78b8961891 Move parallel restore tests to tests folder
Valgrind found errors on these two parallel restore tests,
although correctness test confirms these two tests have no correctness error.

To prevent these two parallel restore tests from spamming valgrind test results,
we exclude these two tests from our nightly tests for now.
2019-11-25 10:53:10 -08:00
Meng Xu 7cf87e9ae3 FastRestore:Add ParallelRestoreCorrectnessCycle.txt test 2019-11-03 17:31:54 -08:00
Meng Xu 63359bfc8b FastRestore:handleInitVersionBatchRequest:Ensure exact once execution
Also increase the test workload for BackupAndParallelRestoreWithAtomicOp test
2019-11-03 17:26:13 -08:00
Jingyu Zhou a30e6ec147
Merge pull request #2277 from xumengpanda/mengxu/fastrestore-atomicOpTest-increaseLoadAndBugFix-PR
Performant restore [7/XX]: Add tests for transactionBatchSizeThreshold when apply mutations
2019-10-24 21:21:14 -07:00
Meng Xu 7af3239ee7 FastRestore:AtomicOpTest:Debug:1 key per group for ops keyspace 2019-10-23 14:36:34 -07:00
Meng Xu ba7e499efe FastRestore:AtomicOpTest:Limit 1 actor per client 2019-10-23 14:04:14 -07:00
Meng Xu e676348710
Merge pull request #1955 from fzhjon/mark-ss-failed
Add fdbcli and API command to mark storage servers as permanently failed
2019-10-22 23:36:30 -07:00
Meng Xu 96d463bab6 FastRestore:Fix bug in applying mutations and increase atomicOp test worload
When Applier applies mutations to the destination cluster, it advances the
mutation cursor twice when it should only advance it once.
This makes restore miss some mutations when the applying txn includes
more than 1 mutations.
2019-10-22 23:24:23 -07:00