Commit Graph

57 Commits

Author SHA1 Message Date
A.J. Beamon f24adc7b6a Fix a bunch of places where we used old-style arguments. Allow hyphens for profiler args. 2021-12-14 09:59:14 -08:00
A.J. Beamon f29f487823
Unify flags (#25)
* Unify flags implementation and change help text in backup.actor.cpp
Description

Testing

* Keep LOG_GROUP unchanged

Description

Testing

* Transfer the hyphens to underscores for internal options and user's input, EXCEPT leading hyphens

Description

Testing

* Use a deep copy of the user's input flag to do the match

Description

Testing

* Convert the _ to - in Option arrays of backup.actor.cpp

Description

Testing

* Transter _ to - for files:
        TLSConfig.actor.h, fdbcli.actor.cpp, fdbserver.actor.cpp, FileConverter.h, FileConverter.cpp

Description

Testing

* Change another way to unify flag: using SO_O_ICASE_HYPHEN_AND_UNDERSCORE to determine whether we do the conversion in function IsEqual

Description

Testing

* Change the config command's name from SO_O_ICASE_HYPHEN_AND_UNDERSCORE to SO_O_HYPHEN_TO_UNDERSCORE

Description

Testing

* Update the comment for the SO_O_HYPHEN_TO_UNDERSCORE

Description

Testing

* Fix left underscore in SOption arrays

Description

Testing

* Convert _ to - in several files for commands

Description

Testing

* Make the FDBService and fdbmonitor backward compatible

Description

Testing

* Fix bugs about pointers

Description

Testing

* Check underscore and hyphen at the same time for --knob_, --localily_ and --test_
And fix bugs in fdbmonitor and FDBService
Description

Testing

* Simplify the function in fdbmonitor and FDBService about retrieving arguments.
And fix some documents in masterserver.actor.cpp

Description

Testing

* Convert _ to - for knob in the setKnob functions

Description

Testing

* Convert - to _ in the setKnob functions

Description
Since key in the knob related maps only contain _

Testing

* Rename varialbe name in the fdbmonitor and FDBService for clarification

Description

Testing

Co-authored-by: Chang Liu <chang.liu@snowflake.com>
2021-12-14 08:44:39 -08:00
A.J. Beamon c82d820bfd Fixes to new disconnected tests; add a version that doesn't use MVC 2021-09-29 13:16:17 -06:00
A.J. Beamon de863d170d Add some tests for timeout behavior with disconnected clusters 2021-09-29 13:16:17 -06:00
Mohamed Oulmahdi e93f6e323a Fix test paths for on Windows 2021-09-15 16:30:58 -06:00
Steve Atherton 09a8561606 Merge branch 'master' of github.com:apple/foundationdb into redwood-io-priority
# Conflicts:
#	fdbserver/IPager.h
#	fdbserver/VersionedBTree.actor.cpp
2021-07-18 01:49:36 -07:00
Chaoguang Lin 3552080266 Update some comments of the change 2021-07-15 16:38:04 +00:00
Chaoguang Lin a3ae0c26ca Add comments, fix foundationdb.conf template 2021-07-14 22:36:17 +00:00
Chaoguang Lin 063de7d7fc Remove unnecessay change, fix bug 2021-07-14 21:26:54 +00:00
Chaoguang Lin c6a01d3976 Set process_number=1 for TempCluster 2021-07-14 21:21:52 +00:00
Chaoguang Lin b5629bc014 Add default value for process_number in the constructor of TempCluster 2021-07-14 20:58:20 +00:00
Chaoguang Lin 41a9470058 Add comments, remove debugging info 2021-07-14 20:24:16 +00:00
Chaoguang Lin 1e3d3811cc Merge branch 'master' of github.com:apple/foundationdb into extend-fdbclient-test-for-multiple-processes 2021-07-14 20:20:39 +00:00
Chaoguang Lin 368657623a Extend add_fdbclient_test to support multiple processes' cluster 2021-07-14 20:17:12 +00:00
Russell Sears c42815f15f
Merge pull request #5127 from vishesh/cherrypick
Making it possible to run a multiple-cluster Java integration test (cherry-pick of #4456 from 6.3)
2021-07-13 09:14:20 -07:00
Scott Fines d1db0d4013 Making it possible to run a multiple-cluster Java integration test 2021-07-07 10:15:18 -07:00
Daniel Smith f9edb3d870
Merge pull request #4983 from Daniel-B-Smith/rollforward-test-nonsim
Roll forward: Add support for running non-simulation tests on Joshua
2021-06-16 18:49:00 -04:00
Xiaoxi Wang 8f3e8ecf10 add injected fault check 2021-06-15 21:47:16 +00:00
Daniel Smith 44cba555eb Don't fail on missing simfdb dir 2021-06-15 14:15:02 -04:00
Lukas Joswiak 4ea760b2a9 Revert "Merge pull request #4136 from sfc-gh-mpilman/features/actor-lineage"
This reverts commit da41534618, reversing
changes made to e6300905d6.
2021-05-10 20:26:12 -07:00
Markus Pilman 7307750e5e Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-04-19 11:29:52 -06:00
Andrew Noyes eb4c80db39 Respect the version constraints for restart tests in ctest 2021-04-12 23:15:17 +00:00
Markus Pilman eb036b7b02 Merge remote-tracking branch 'origin/master' into features/actor-lineage 2021-03-17 11:59:54 -06:00
Andrew Noyes 18ee11e69a Use add_fdbclient_test for java integration tests
Also change add_fdbclient_test to run its subcommand with FDB_CLUSTER_FILE set
2021-03-02 01:54:17 +00:00
Markus Pilman f8e1df6c4f Support for actor stack traces 2020-12-10 10:42:04 -07:00
Markus Pilman 2e7dcb6907 ask the OS to find a free port 2020-09-29 10:39:00 -06:00
Markus Pilman 94b7fcf823 fix typo 2020-09-28 14:20:58 -06:00
Markus Pilman bf179dfbf3 Add better help text to tmp_cluster script 2020-09-28 14:17:08 -06:00
Markus Pilman 33d6c412c1 return error code correctly and cmake fixes 2020-09-24 15:58:41 -06:00
Markus Pilman 4c25214085 Add ability to run tests on fdb in ctest 2020-09-24 15:43:05 -06:00
Alex Miller f040694bf0 Make ctest use --crash when running simulation tests.
So that tests with ASSERTion failures don't cause CI to run slow and
produce massive logs.  There's also rarely a reason to continue through
assertion failures.
2020-05-05 03:11:09 -07:00
mpilman f453c12f0f remove object serialization flag from TestRunner 2019-08-06 10:20:01 -07:00
mpilman 1ac2d01b03 Merge remote-tracking branch 'upstream/master' into flatbuffers-fixes2 2019-07-18 09:50:08 -07:00
mpilman d5caf0c1b4 Merge branch 'flatbuffers-fixes2' of github.com:mpilman/foundationdb into flatbuffers-fixes2 2019-07-16 14:47:40 -07:00
Andrew Noyes bc29b1e78a Use flatbuffers for testing 2019-07-11 23:03:31 -07:00
Andrew Noyes 274cb40eb8 Run tests under valgrind when USE_VALGRIND 2019-07-11 23:03:31 -07:00
dyoungworth 35be45d4ce Remove code accidentally left for testing ctest fix 2019-07-11 10:01:26 -07:00
dyoungworth 62d7ee9424 Fix ctests so each restart test has a seed unique to the first test
and any other test
2019-07-11 09:56:51 -07:00
Alex Miller 1611f0385a Remove symbolication from ctest, as a large number of backtraces times out tests.
HugeArenaAllocation in particular is a bit spammy of backtraces,
intentionally, and is causing testing in the CI to time out.
2019-06-19 13:37:59 -07:00
sramamoorthy 8370871e4c stale RESTORE option related code removed 2019-05-28 22:07:46 -07:00
sramamoorthy 4bc4c615da exec op to all tlog, restore change in test &other
- exec operation to go to all the TLogs
- minor bug fix in tlog
- restore implementation for the simulator
- restore snap UID to be stored in restartInfo.ini
- test cases added
- indentation and trace file fixes
2019-05-28 22:07:46 -07:00
Andrew Noyes 8082362830 Hardcode flatbuffers to off for ctest 2019-05-16 13:02:06 -07:00
mpilman 6afce01744 Implementation complete (not yet working) 2019-05-13 14:15:22 -07:00
Andrew Noyes 121ed4acf9 Trace the cmake SEED
This will be included in the repro instructions, so we need to trace it
to keep track of it.
2019-03-08 15:03:56 -08:00
Andrew Noyes 1292f5c59a Add TEST_LOG_FORMAT to cmake 2019-02-21 14:36:01 -08:00
mpilman a6627fa5ca be less clever for seed generation and seed>0
simulator doesn't accept a seed that is 0
2019-02-19 22:06:45 -08:00
mpilman e8af6512ec Generate distinct pseudo-random number for each test
Fixes #1161
2019-02-19 22:06:45 -08:00
mpilman a2e4dc042f Implement automatic package verification 2019-02-19 11:11:43 -08:00
Alex Miller 2d7f5f505c Pass a bytestring to xml.sax.parseString
This fixes the ctest prb.

CI was broken because TestRunner errored at:

    Traceback (most recent call last):
      File "/foundationdb/tests/TestRunner/TestRunner.py", line 373, in <module>
        res = run_simulation_test(basedir, args)
      File "/foundationdb/tests/TestRunner/TestRunner.py", line 313, in run_simulation_test
        options.log_format, return_codes)
      File "/foundationdb/tests/TestRunner/TestRunner.py", line 261, in process_traces
        parser.processTraces()
      File "/foundationdb/tests/TestRunner/TestRunner.py", line 112, in processTraces
        obj = self.processLine(line, linenr)
      File "/foundationdb/tests/TestRunner/TestRunner.py", line 222, in processLine
        xml.sax.parseString(line, handler, errorHandler=errorHandler)
      File "/usr/lib/python3.4/xml/sax/__init__.py", line 45, in parseString
        inpsrc.setByteStream(BytesIO(string))
    TypeError: 'str' does not support the buffer interface

Which means you can't parse a string to parseString.  This was fixed by
3.7, but our CI runs 3.4, so we need to .encode() `line` before passing
it, so that it ends up as a `bytes`.
2019-02-11 17:59:52 -08:00
mpilman 58964af7e1 ctest improvements - #1058
- A set of CMake variables controls whether to keep
  the simfdb directory and the traces and whether we
  want to aggregate the traces into a single file
- Test labels now contain the directory they are in
  so that one can now run `ctest -R fast/`
- A different binary can be used for restart tests. CMake
  will automatically look for an installed fdb and use that
  by default. If none is found, it will use the built one
  but it will also print a warning
- CMake will throw an error if there are any text files in
  the tests directory that are not associated with a test.
- Moved testing from fdbserver/CMakeLists.txt to
  tests/CMakeLists.txt
- Moved fdb testing functions to its own cmake module
2019-01-22 14:34:51 -08:00