Commit Graph

13 Commits

Author SHA1 Message Date
Trevor Clinkenbeard d1fba364b4 Merge remote-tracking branch 'origin/main' into dev/tclinkenbeard/pr-13374-ci 2026-07-09 09:41:54 -07:00
Trevor Clinkenbeard 8d18f51d23 Split StatusSchema and RangeLock from ManagementAPI 2026-06-22 20:45:02 -07:00
Trevor Clinkenbeard 347586cc74 Rename ThreadHelper.actor.h 2026-06-21 01:58:26 -07:00
Trevor Clinkenbeard 5cf4b48319 Rename ManagementAPI* files 2026-03-24 16:13:35 +00:00
Michael Stack 1f75fbe25b
Improve backup/restore observability and status messages (#12729)
* Add BulkDump/BulkLoad observability for backup/restore progress tracking

Progress tracking APIs:
- getBulkDumpProgress() / getBulkLoadProgress() - track tasks, bytes, throughput, ETA
- getBulkDumpOwner() - track job ownership (e.g., which backup owns a bulkdump)
- Owner registration system for backup agents

CLI improvements:
- 'bulkdump status' and 'bulkload status' commands with human-readable output
- Progress display with throughput and ETA

Backup agent integration:
- Register backup as owner of bulkdump jobs
- Show bulkdump/bulkload progress in backup status output

Utility functions (flow/Util.h):
- formatBytesHumanReadable() - "1.23 TB", "456 MB"
- formatDurationHumanReadable() - "2 hours 30 minutes"
- formatBytesProgress(), formatThroughputLine(), formatETALine()

Test coverage:
- verifyBulkDumpObservability() / verifyBulkLoadObservability() in BackupS3BlobCorrectness

Bug fixes:
- Fix format string mismatch crash in FileBackupAgent progress display
- Add empty result guards for krmGetRanges() calls to prevent size_t underflow

* Formatting

* Rebase and formatting

* * cmake/CompileRocksDB.cmake
 Preserve version when find_packge doesn't turn up rocksdb version

* fdbbackup/tests/backup_tests_common.sh
 Wait when mode is 'both' for snapshot to be written.

* fdbclient/BulkLoading.cpp
 Remove extra '/'.

* Output time of bulkload in bulkload history fdcli output as iso8601 instead of seconds since epoch

* Print start time as iso8601 -- readable -- instead of seconds since epoch -- unreadable... And don't crash if not a UUID

* Remove cute graphics.. and bullet characters

* Throw exception if not able to parse backup 'mode'
2026-03-18 21:10:28 -07:00
Trevor Clinkenbeard 1306c2f5a9 Remove unnecessary success calls 2026-03-18 09:00:46 -07:00
Trevor Clinkenbeard 673dcfdbf0 Rename fdbcli.actor.h 2026-03-13 00:43:02 +00:00
Trevor Clinkenbeard 23885dbb7e Rename non-actor files in fdbcli 2026-03-13 00:23:11 +00:00
Chaoguang Lin 8de3417f24 Fix comment, add a new function for reading special keys' error message 2021-08-24 14:18:43 -07:00
Chaoguang Lin 9a6151d3fc Update fdbcli.h to fdbcli.actor.h, removed the unnecessary wrapper 2021-05-11 14:31:08 -07:00
Chaoguang Lin 73fdb55f4b Add headers in new files 2021-05-06 16:43:56 -07:00
Chaoguang Lin 41c135ec93 Change namespace FDBCLI to fdb_cli 2021-03-29 12:51:32 -07:00
Chaoguang Lin cb39d1a6ed Refactor consistencycheck command using special keys 2021-03-24 09:33:20 -07:00