Commit Graph

19 Commits

Author SHA1 Message Date
Trevor Clinkenbeard 3e2c704147 Fix BulkDumping narrow-range sampling livelock 2026-07-24 12:18:12 -07:00
Trevor Clinkenbeard 7f8b84d41d Remove MockDD end-to-end emulation 2026-07-12 10:54:57 -07:00
Trevor Clinkenbeard 8d18f51d23 Split StatusSchema and RangeLock from ManagementAPI 2026-06-22 20:45:02 -07:00
Akanksha Mahajan 20cd070a0d
Fix bulkdump simulation failure (#13193)
* Fix bulkdump simulation failure

* Addressed comments
2026-05-12 10:18:00 -07:00
Trevor Clinkenbeard 399d13505f Make single-argument constructors explicit 2026-04-24 18:53:40 +00:00
Trevor Clinkenbeard e38baf18ea Fix more clang-tidy warnings 2026-04-15 14:23:33 +00:00
Trevor Clinkenbeard 9ba44fd75b Rename *.actor.h files without ACTORs 2026-03-27 04:53:43 +00:00
Trevor Clinkenbeard 38b05e51cd Post coroutine conversion linting 2026-03-25 16:31:16 -07:00
Trevor Clinkenbeard d477eab73d Merge remote-tracking branch 'apple/main' into dev/tclinkenbeard/management-api-coro 2026-03-25 02:14:46 +00:00
Trevor Clinkenbeard e75340b8fb Move tester code from fdbserver/core to fdbserver/tester 2026-03-24 21:54:07 +00:00
Trevor Clinkenbeard 5cf4b48319 Rename ManagementAPI* files 2026-03-24 16:13:35 +00:00
Trevor Clinkenbeard 9c94fcb649 Merge remote-tracking branch 'apple/main' into dev/tclinkenbeard/modularize-fdbserver2 2026-03-19 17:31:58 +00:00
Michael Stack 1f75fbe25b
Improve backup/restore observability and status messages (#12729)
* Add BulkDump/BulkLoad observability for backup/restore progress tracking

Progress tracking APIs:
- getBulkDumpProgress() / getBulkLoadProgress() - track tasks, bytes, throughput, ETA
- getBulkDumpOwner() - track job ownership (e.g., which backup owns a bulkdump)
- Owner registration system for backup agents

CLI improvements:
- 'bulkdump status' and 'bulkload status' commands with human-readable output
- Progress display with throughput and ETA

Backup agent integration:
- Register backup as owner of bulkdump jobs
- Show bulkdump/bulkload progress in backup status output

Utility functions (flow/Util.h):
- formatBytesHumanReadable() - "1.23 TB", "456 MB"
- formatDurationHumanReadable() - "2 hours 30 minutes"
- formatBytesProgress(), formatThroughputLine(), formatETALine()

Test coverage:
- verifyBulkDumpObservability() / verifyBulkLoadObservability() in BackupS3BlobCorrectness

Bug fixes:
- Fix format string mismatch crash in FileBackupAgent progress display
- Add empty result guards for krmGetRanges() calls to prevent size_t underflow

* Formatting

* Rebase and formatting

* * cmake/CompileRocksDB.cmake
 Preserve version when find_packge doesn't turn up rocksdb version

* fdbbackup/tests/backup_tests_common.sh
 Wait when mode is 'both' for snapshot to be written.

* fdbclient/BulkLoading.cpp
 Remove extra '/'.

* Output time of bulkload in bulkload history fdcli output as iso8601 instead of seconds since epoch

* Print start time as iso8601 -- readable -- instead of seconds since epoch -- unreadable... And don't crash if not a UUID

* Remove cute graphics.. and bullet characters

* Throw exception if not able to parse backup 'mode'
2026-03-18 21:10:28 -07:00
Trevor Clinkenbeard bab8dca1fa Remove unnecessary calls to store coroutine 2026-03-18 08:26:43 -07:00
Trevor Clinkenbeard 42d135ea77 Fix post-merge build failures 2026-03-16 06:47:23 +00:00
Trevor Clinkenbeard 25ceae16bd Move more orphaned fdbserver files to lower-level libraries 2026-03-16 01:09:56 +00:00
Trevor Clinkenbeard 6216c9083d Remove wrapper header files from fdbserver/include/fdbserver 2026-03-15 02:22:40 +00:00
Trevor Clinkenbeard faecbdf04e Merge remote-tracking branch 'origin/main' into dev/tclinkenbeard/modularize-fdbserver2 2026-03-12 20:13:26 -07:00
Trevor Clinkenbeard 28bb81c6a0 Rename actor.cpp files without ACTORs 2026-03-12 21:30:19 +00:00