foundationdb/fdbclient
gxglass 9aaa5222f8
latency tracking for dataDistributionRelocator (#13072) (#13103)
Cherrypick PR#13072 into release-7.4.

This function does a lot of stuff and has been observed to be expensive from time to time. This PR tracks its latency explicitly. This is done in 5 minute windows which seems about the right granularity for the sort of incidents which we might anticipate. Note too short, not too long.

Testing (7.4 specific):
20260428-142636-gglass-3b52791173c99235 compressed=True data_size=41487471 duration=4813496 ended=100000 fail_fast=1000 max_runs=100000 pass=100000 priority=100 remaining=0 runtime=1:00:16 sanity=False started=100000 stopped=20260428-152652 submitted=20260428-142636 timeout=5400 username=gglass

* latency tracking for dataDistributionRelocator (#13072)

* add latency tracking for dataDistributionRelocator

* simplify approach, and try to avoid negative latency samples

* formatting
2026-04-28 16:10:52 -07:00
..
azure_backup Add metadata for Encrypted Backups (#12354) 2025-09-24 11:25:51 -07:00
include/fdbclient latency tracking for dataDistributionRelocator (#13072) (#13103) 2026-04-28 16:10:52 -07:00
sha1 clang-format-19.1.5 repo 2025-04-08 21:56:00 +00:00
tests Encryption changes in status json (#12657) 2026-01-26 11:40:38 -08:00
vexillographer More copyright end year updates (#11556) 2024-08-05 14:00:32 -07:00
ActorLineageProfiler.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
AnnotateActor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
AsyncFileS3BlobStore.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
AsyncTaskThread.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
Atomic.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
AuditUtils.actor.cpp Cherrypick Add restore validation feature: restores to special keyspace allowing validating backup/restore in single cluster (space willing) (#12573) (#12648) 2026-01-22 13:41:34 -08:00
BackupAgentBase.actor.cpp [Release-7.4] Cherry-pick Avoid Source Storage Server Being Overloaded by Data Movements with Replica Consistency Check (#12176) 2025-06-02 12:34:34 -07:00
BackupContainer.actor.cpp Add FileLevelEncryption field to BackupDescription JSON output (#12619) (#12626) 2026-01-07 14:46:42 -08:00
BackupContainerFileSystem.actor.cpp Fix for minRestorableVersion and maxRestorableVersion not updating correctly in case of missing mutation logs. (#12710) 2026-02-16 11:17:32 -08:00
BackupContainerLocalDirectory.actor.cpp Add metadata for Encrypted Backups (#12354) 2025-09-24 11:25:51 -07:00
BackupContainerS3BlobStore.actor.cpp Add metadata for Encrypted Backups (#12354) 2025-09-24 11:25:51 -07:00
BackupTLSConfig.cpp Remove duplicate code. Move BackupTLSConfig.* from fdbbackup to 2024-12-05 08:25:25 -08:00
BlobCipher.cpp Make some codeprobes rare (#11607) 2024-08-26 22:33:38 -07:00
BlobConnectionProvider.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
BlobGranuleCommon.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
BlobGranuleFiles.cpp Make some codeprobes rare (#11607) 2024-08-26 22:33:38 -07:00
BlobGranuleReader.actor.cpp clang-format-19.1.5 repo 2025-04-08 21:56:00 +00:00
BlobMetadataUtils.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
BuildFlags.h.in More copyright end year updates (#11556) 2024-08-05 14:00:32 -07:00
BulkDumping.cpp Bulkload FDBCLI Command (#11886) 2025-01-15 09:27:59 -08:00
BulkLoading.cpp Allow One BulkloadTask Do Multiple Manifests (#12036) 2025-03-17 11:45:15 -07:00
CMakeLists.txt Add checksumming across multipart upload and download (#11988) 2025-03-11 21:34:59 -07:00
ClientKnobCollection.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ClientKnobs.cpp Backup encryption fix on S3 (#12289) 2025-09-24 11:25:51 -07:00
ClientStatusReport.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ClusterConnectionFile.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ClusterConnectionKey.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ClusterConnectionMemoryRecord.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
CommitProxyInterface.cpp address comments 2025-01-23 12:32:27 -08:00
ConfigKnobs.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ConfigTransactionInterface.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
CoordinationInterface.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
DataDistributionConfig.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
DatabaseBackupAgent.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
DatabaseConfiguration.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
DatabaseContext.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
FDBAWSCredentialsProvider.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
FDBTypes.cpp Add rocksdb, sharded rocksdb to configure workload (#11654) 2024-09-12 21:03:06 -07:00
FileBackupAgent.actor.cpp Cherrypick Add restore validation feature: restores to special keyspace allowing validating backup/restore in single cluster (space willing) (#12573) (#12648) 2026-01-22 13:41:34 -08:00
FluentDSampleIngestor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
GlobalConfig.actor.cpp Fix some potential DatabaseContext leaks in NativeApi 2025-08-18 11:55:24 -07:00
IConfigTransaction.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
IKnobCollection.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ISingleThreadTransaction.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
IdempotencyId.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
JsonBuilder.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
KeyRangeMap.actor.cpp New restore consolidated commit (#11901) 2025-01-22 14:54:55 -08:00
LinkTest.cpp Add test executables to catch missing symbols 2022-07-06 14:49:33 -07:00
LocalClientAPI.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ManagementAPI.actor.cpp Separate backup and restore into two workloads [release-7.4] (#12172) 2025-07-08 12:27:53 -07:00
MetaclusterRegistration.cpp More copyright end year updates (#11556) 2024-08-05 14:00:32 -07:00
MonitorLeader.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
MultiVersionTransaction.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
MutationLogReader.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
NameLineage.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
NativeAPI.actor.cpp Forward-port to 7.4: Add DD init and team collection logging for diagnosing slow startups (#13002) 2026-04-22 19:57:28 -07:00
ParallelStream.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
PaxosConfigTransaction.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
RESTClient.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
RESTUtils.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
RYWIterator.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
RandomKeyValueUtils.cpp More copyright end year updates (#11556) 2024-08-05 14:00:32 -07:00
ReadYourWrites.actor.cpp Remove the usage of txsTag (#11688) 2024-09-30 07:53:37 -04:00
RestoreInterface.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
S3BlobStore.actor.cpp Harden parseErrorCodeFromS3 to never throw on non-XML responses (#13021) 2026-04-22 08:24:55 -07:00
S3Client.actor.cpp Cherrypick recent bulkload changes (#12135) 2025-05-19 14:42:22 -07:00
S3Client_cli.actor.cpp Cherrypick recent bulkload changes (#12135) 2025-05-19 14:42:22 -07:00
Schemas.cpp Add rocksdb version to status json. (#11868) 2025-01-09 12:56:09 -08:00
ServerKnobCollection.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ServerKnobs.cpp latency tracking for dataDistributionRelocator (#13072) (#13103) 2026-04-28 16:10:52 -07:00
SimpleConfigTransaction.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
SpecialKeySpace.actor.cpp Refactor locality-based exclusion checks to reduce additional overhead (#11838) 2024-12-20 20:45:31 +00:00
StackLineage.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
StatusClient.actor.cpp Refactor StatusClient to have message type enum to name map 2024-11-21 11:44:46 -08:00
StorageServerInterface.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
Subspace.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
SystemData.cpp Removed no-op mode in BackupWorker (#12748) 2026-03-04 13:24:42 -08:00
TagThrottle.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
TaskBucket.actor.cpp New restore consolidated commit (#11901) 2025-01-22 14:54:55 -08:00
Tenant.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
TenantManagement.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
TestKnobCollection.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
ThreadSafeTransaction.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
Tracing.actor.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
TransactionLineage.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
Tuple.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
TupleVersionstamp.cpp Add testing that a metacluster can be used after a restore. Fix some bugs found by this related to the restore ID and tenant tombstones. 2023-06-21 08:59:22 -07:00
VersionVector.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
VersionedMap.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
WriteMap.cpp Update end year in copyright header 2024-08-02 09:40:11 -07:00
azurestorage.cmake sync with upstream main 2022-08-31 15:46:39 -07:00
notified_support.swift Add code back 2024-07-10 18:52:14 -07:00
versions.h.cmake
zipf.c fdbclient compiling 2022-06-27 18:31:05 -06:00