mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,944 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

31 Commits

Author SHA1 Message Date
Keiven C 33604afa19
test: generalize router test infrastructure and expand documentations (#7327) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-03-13 13:58:32 -07:00
jh-nv 734c0b8b0b
feat: Add Loki log aggregation, and enable unified OTLP ingestion for both traces and logs through a single endpoint (#6974) 2026-03-10 15:20:33 -07:00
dagil-nvidia 96f3bdccef
docs: 1.0 documentation improvements (#7168) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-10 17:08:31 -05:00
dagil-nvidia fa474d360e
docs: fix disaggregated deployment example in tracing.md (#6999) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-03-10 16:41:10 -05:00
Keiven C 9ab2486a14
docs: document NIXL Prometheus telemetry metrics in observability guide (#7141) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-03-10 11:37:18 -07:00
Tanmay Verma 1bb28d6ff3
docs: Refactor TensorRT-LLM backend docs (#6782) 2026-03-03 01:28:45 +00:00
Alec 75bf1e0993
docs: restructure vLLM docs and add startup banners to launch scripts (#6698) 
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
 2026-03-03 00:37:55 +00:00
Neal Vaidya ece08dc926
docs: restructure docs directory and move fern config to fern/ (#6700) 
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-01 19:58:22 -08:00
Jonathan Tong 39d645e586
docs: migrate Fern docs from fern/ into docs/ (#6206) 
Signed-off-by: Jont828 <jt572@cornell.edu>
 2026-02-11 16:22:27 -08:00
dagil-nvidia 07db589583
docs: clean up toctree navigation and add disaggregated serving guide (#6024) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-06 13:20:36 -06:00
jh-nv f3bea5d557
fix: update disagg tracing screenshot and description (#5956) 2026-02-04 14:22:21 -05:00
Keiven C 8e72fb69cf
docs: DYN-1967 update metrics docs after kvstats removal (#5704) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-01-27 17:24:12 -08:00
Keiven C 7361de4208
refactor: reduce Python API to only Prometheus Exposition Format callback (#5594) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-01-23 10:06:06 -08:00
Julien Mancuso 53a609e538
feat: add dynamo operator observability (#5543) 
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
 2026-01-22 15:48:28 -07:00
Neelay Shah 06939770b3
feat: add span event logging and fix trace context extraction (#5400) 
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-16 13:51:37 -08:00
Keiven C 194128ec89
docs: fix tracing doc ZMQ port conflict (#5200) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-01-06 11:32:53 -08:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130) 
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
 2026-01-02 22:08:23 +00:00
Jacky e6a6a1f244
feat: Request Migration Metrics (#5029) 
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
 2025-12-19 12:22:36 -08:00
jh-nv b401a1d66f
feat: propagate trace context to vLLM engine (#4918) 
Signed-off-by: Jie Hao <jihao@nvidia.com>
 2025-12-18 16:50:29 -05:00
Vladislav Nosivskoy f8bb53c0ed
feat: add cached tokens prometheus metric (#4534) 
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
 2025-12-11 08:03:12 +03:00
Tzu-Ling Kan 7c15166d82
feat: Disable health checks by default; auto-enable in K8s via operator (#4804) 
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
 2025-12-09 10:17:07 -08:00
Keiven C 3cf67ee08f
fix(docs): metrics documentation that were missing 2 metrics (#4309) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-13 15:03:47 -08:00
Keiven C 381c428c11
refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ (#4269) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-13 09:44:37 -08:00
Keiven C f817c59576
docs: reorganize prometheus.md to be consistent with docs/observability/metrics.md (#4262) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-12 18:51:18 -08:00
Keiven C afccc9d434
refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-10 20:19:34 +00:00
Keiven C 6bccf099f8
feat: deprecate DYN_SYSTEM_ENABLED in favor of DYN_SYSTEM_PORT (#4082) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-07 15:31:51 -08:00
Ryan McCormick 98842a03a9
docs: Cleanup KServe GRPC docs (#4081) 2025-11-04 01:37:09 +00:00
Thomas Montfort e20adb4436
fix: small fixes for OTEL trace implementation (#3734) 2025-10-31 18:29:17 -07:00
Keiven C cbe0b177ab
refactor: redesign the metrics API from Trait to composition to make the code cleaner and easier to understand (#3687) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-10-24 14:34:29 -07:00
Anish c6b5904579
docs: address Harry/VDR feedback + fixing broken links across repository (#3802) 
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
 2025-10-22 19:56:24 -04:00
Anish 598cbbb73b
docs: reorganizing documentation to make things clearer (#3658) 
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
 2025-10-16 23:59:59 +00:00