mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,250 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

22 Commits

Author SHA1 Message Date
dagil-nvidia 07db589583
docs: clean up toctree navigation and add disaggregated serving guide (#6024) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-06 13:20:36 -06:00
jh-nv f3bea5d557
fix: update disagg tracing screenshot and description (#5956) 2026-02-04 14:22:21 -05:00
Keiven C 8e72fb69cf
docs: DYN-1967 update metrics docs after kvstats removal (#5704) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-01-27 17:24:12 -08:00
Keiven C 7361de4208
refactor: reduce Python API to only Prometheus Exposition Format callback (#5594) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-01-23 10:06:06 -08:00
Julien Mancuso 53a609e538
feat: add dynamo operator observability (#5543) 
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
 2026-01-22 15:48:28 -07:00
Neelay Shah 06939770b3
feat: add span event logging and fix trace context extraction (#5400) 
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-16 13:51:37 -08:00
Keiven C 194128ec89
docs: fix tracing doc ZMQ port conflict (#5200) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-01-06 11:32:53 -08:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130) 
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
 2026-01-02 22:08:23 +00:00
Jacky e6a6a1f244
feat: Request Migration Metrics (#5029) 
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
 2025-12-19 12:22:36 -08:00
jh-nv b401a1d66f
feat: propagate trace context to vLLM engine (#4918) 
Signed-off-by: Jie Hao <jihao@nvidia.com>
 2025-12-18 16:50:29 -05:00
Vladislav Nosivskoy f8bb53c0ed
feat: add cached tokens prometheus metric (#4534) 
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
 2025-12-11 08:03:12 +03:00
Tzu-Ling Kan 7c15166d82
feat: Disable health checks by default; auto-enable in K8s via operator (#4804) 
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
 2025-12-09 10:17:07 -08:00
Keiven C 3cf67ee08f
fix(docs): metrics documentation that were missing 2 metrics (#4309) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-13 15:03:47 -08:00
Keiven C 381c428c11
refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ (#4269) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-13 09:44:37 -08:00
Keiven C f817c59576
docs: reorganize prometheus.md to be consistent with docs/observability/metrics.md (#4262) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-12 18:51:18 -08:00
Keiven C afccc9d434
refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-10 20:19:34 +00:00
Keiven C 6bccf099f8
feat: deprecate DYN_SYSTEM_ENABLED in favor of DYN_SYSTEM_PORT (#4082) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-07 15:31:51 -08:00
Ryan McCormick 98842a03a9
docs: Cleanup KServe GRPC docs (#4081) 2025-11-04 01:37:09 +00:00
Thomas Montfort e20adb4436
fix: small fixes for OTEL trace implementation (#3734) 2025-10-31 18:29:17 -07:00
Keiven C cbe0b177ab
refactor: redesign the metrics API from Trait to composition to make the code cleaner and easier to understand (#3687) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-10-24 14:34:29 -07:00
Anish c6b5904579
docs: address Harry/VDR feedback + fixing broken links across repository (#3802) 
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
 2025-10-22 19:56:24 -04:00
Anish 598cbbb73b
docs: reorganizing documentation to make things clearer (#3658) 
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
 2025-10-16 23:59:59 +00:00