foundationdb/fdbcli
michael stack aea37ae90d Use s3 if available when running the bulkload test.
It was disabled until we made it so the SS could
talk to s3, included in this PR.

Also finished the bulkload test. It only had the
bulkdump portion. bulkload support was recentlty
added so finish off the test here by adding bulkload
of the bulkdump and then verifying all data present.

Added passing knobs to the fdb cluster so available to the
fdbserver when it goes to talk to s3. Also added passing
SS count to start in fdb cluster.

* fdbclient/tests/fdb_cluster_fixture.sh
 Add ability to pass multiple knobs to fdb cluster
 and to specify more than just one SS.

* fdbserver/fdbserver.actor.cpp
 Add --blob-server option and processing of FDB_BLOB_CREDENTIALS
 if present (hijacked the unused, unadvertised --
   blob-credentials-file).

* tests/loopback_cluster/run_custom_cluster.sh
 Allow passing more than just one knob.

* fdbclient/BulkLoading.cpp
* fdbclient/include/fdbclient/BulkLoading.h
 Added getPath

* fdbclient/S3BlobStore.actor.cpp
 Fix bug where we were doubling up the first '/' on a path if
 it had a root '/' already (s3 treats /a/b as distinct from
 /a//b).

* fdbclient/S3Client.actor.cpp
 Fix up of traceevent Types.

* fdbclient/tests/bulkload_test.sh
 Enable being able to use s3 if available.
 Pick up jobid when bulkdumping. Feed it to new bulkload
 method. Add verification all data present post-bulkload.

* fdbserver/BulkLoadUtil.actor.cpp
 Add support for blobstore.

* tests/loopback_cluster/run_custom_cluster.sh
 Bug fix -- we were only able to pass in one knob. Allow
 passing multiple.
2025-01-17 17:29:56 -08:00
..
include/fdbcli Bulkload FDBCLI Command (#11886) 2025-01-15 09:27:59 -08:00
tests Add `clearknob` fdbcli command 2023-08-31 17:36:05 -07:00
AdvanceVersionCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
AuditStorageCommand.actor.cpp More copyright end year updates (#11556) 2024-08-05 14:00:32 -07:00
BlobKeyCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
BlobRangeCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
BulkDumpCommand.actor.cpp Bulkload FDBCLI Command (#11886) 2025-01-15 09:27:59 -08:00
BulkLoadCommand.actor.cpp Use s3 if available when running the bulkload test. 2025-01-17 17:29:56 -08:00
CMakeLists.txt Ignore some ctests for ASAN 2024-12-12 09:47:46 +08:00
CacheRangeCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ChangeFeedCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ConfigureCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ConsistencyCheckCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ConsistencyScanCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
CoordinatorsCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
DataDistributionCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
DebugCommands.actor.cpp Fix warnings for long long or int64_t format specifiers by switching to fmt::print* (#11574) 2024-09-12 12:10:40 -07:00
ExcludeCommand.actor.cpp Refactor locality-based exclusion checks to reduce additional overhead (#11838) 2024-12-20 20:45:31 +00:00
ExpensiveDataCheckCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
FileConfigureCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
FlowLineNoise.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ForceRecoveryWithDataLossCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
GetAuditStatusCommand.actor.cpp Fix warnings for long long or int64_t format specifiers by switching to fmt::print* (#11574) 2024-09-12 12:10:40 -07:00
HotRangeCommand.actor.cpp More copyright end year updates (#11556) 2024-08-05 14:00:32 -07:00
IdempotencyIdsCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
IncludeCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
KillCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
LocationMetadataCommand.actor.cpp More copyright end year updates (#11556) 2024-08-05 14:00:32 -07:00
LockCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
MaintenanceCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
MetaclusterCommands.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ProfileCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
QuotaCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
RangeConfigCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
SetClassCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
SnapshotCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
StatusCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
SuspendCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
TenantCommands.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
TenantGroupCommands.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ThrottleCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
TriggerDDTeamInfoLogCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
TssqCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
Util.actor.cpp Add more trace events for exclude command 2024-08-12 18:19:57 -07:00
VersionEpochCommand.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
fdbcli.actor.cpp Bulkload FDBCLI Command (#11886) 2025-01-15 09:27:59 -08:00