mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,944 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

3944 Commits

Author SHA1 Message Date
Biswa Panda cec19d4db6
feat(perf): add request-plane, transport, and work-handler metric definitions (#6735) 2026-03-14 07:36:31 +00:00
Ryan McCormick a3f805c79d
docs: add image-to-video support for vLLM-Omni in diffusion support matrix (#7374) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-13 19:01:30 -07:00
dagil-nvidia 1da0ecd46f
docs: revert #7371 (#7373) 2026-03-13 20:47:39 -05:00
jh-nv c263a99ed2
feat: propagate OTEL trace context across E/P/D multimodal workers (#7239) 2026-03-14 01:20:41 +00:00
dagil-nvidia 34f13a12c6
docs: use GitHub admonitions instead of Fern-native callouts (#7370) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-03-13 18:02:45 -07:00
KrishnanPrash da783ce0d3
fix: prevent DYN_SYSTEM_PORT collisions in TRT-LLM EPD launch scripts (#7366) 
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
 2026-03-13 17:37:37 -07:00
dagil-nvidia 39310c5ada
docs: remove blog section from sidebar navigation (#7371) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-03-13 19:31:28 -05:00
dagil-nvidia 46dad85b03
docs: update KVBM diagram and bump container image tags to 1.0.0 (#7365) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-03-13 18:08:10 -05:00
Neal Vaidya 6b62df6595
docs: use a different assets folder for each version (#7333) 
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
 2026-03-13 16:07:15 -07:00
Biswa Panda 947939c727
fix: populate logprobs bytes and token fields in OpenAI-compatible responses (#6953) 2026-03-13 22:59:29 +00:00
dagil-nvidia 1d509252b3
docs: remove duplicate title from introduction frontmatter (#7361) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-03-13 17:54:24 -05:00
KrishnanPrash 4105de62ca
fix: reject multimodal requests when worker lacks --modality multimodal (#7065) 
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
 2026-03-13 15:20:11 -07:00
Pavithra Vijayakrishnan b339c27937
ci: relax release branch version extraction to accept any release/* pattern (#7356) 
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
 2026-03-13 15:15:37 -07:00
Anish 5b415abb41
docs: rewrite architecture.md as a clearer system architecture narrative (#7022) 
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Signed-off-by: akshatha-k <akshutk@gmail.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
 2026-03-13 22:08:13 +00:00
KrishnanPrash be2f1dc11b
ci: fit sglang multimodal EPD test on 1 GPU (#7046) 
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
 2026-03-13 14:47:58 -07:00
dagil-nvidia f744c7c32f
docs: add agentic inference post to blog landing page (#7359) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-03-13 16:34:25 -05:00
Keiven C 33604afa19
test: generalize router test infrastructure and expand documentations (#7327) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-03-13 13:58:32 -07:00
Yan Ru Pei cb9b1cd54c
test(kv-router): use flush-and-settle helper in indexer tests (#7347) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-03-13 13:55:51 -07:00
Keiven C 608405e0e7
feat: harden ManagedProcess teardown, add xdist-safe tests (#6670) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-03-13 12:54:37 -07:00
Yan Ru Pei 7e07495f6c
feat(mocker): add --decode-speedup-ratio for speculative decoding simulation (#7349) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-03-13 12:35:40 -07:00
Fern Support 374107c03e
fix: Update custom-domain to support multiple domains (#7353) 
Signed-off-by: Fern Support <126544928+fern-support@users.noreply.github.com>
 2026-03-13 19:23:16 +00:00
dagil-nvidia 19c192cd25
docs: modernize introduction page SVG figures (#7352) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-03-13 15:18:45 -04:00
dagil-nvidia 24fe435d08
docs: update support matrix, release artifacts, and README for v1.0.0 (#7350) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-03-13 15:17:51 -04:00
Graham King e6cb684709
fix: Upgrade futures-util to 0.3.32 (#7346) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2026-03-13 19:11:14 +00:00
hhzhang16 20f1c5a3c0
fix: inject tolerations for interpolation (profiling) (#7344) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2026-03-13 18:44:50 +00:00
Sandeep Maddipatla 23c42d83ed
feat: Add support for cpu builds in dockerfiles (#7139) 
Signed-off-by: Sandeep Maddipatla <sandeep.maddipatla@intel.com>
 2026-03-13 11:15:22 -07:00
Wang, Yi f29753dc89
feat: Add NVTX markers for sglang EPD (#7079) 
Signed-off-by: Wang, Yi <yi.a.wang@intel.com>
 2026-03-13 10:47:05 -07:00
Yan Ru Pei 5aa2f53fc2
feat(kv-router): add Prometheus metrics to standalone indexer (#7339) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-03-13 10:07:48 -07:00
Keiven C c8f7ce9061
docs: add PR rebase guidelines and CI failure reproduction tips (#7298) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-03-13 13:07:19 -04:00
Ran Rubin 9f01dd259e
chore: multi-arch frontend image (#7290) 2026-03-13 16:29:19 +00:00
devivasudevan 57648c1961
feat: GPU discovery extension using DCGM exporter for advanced metrics. (#6705) 
Signed-off-by: devivasudevan <49675305+devivasudevan@users.noreply.github.com>
 2026-03-13 07:51:59 -07:00
ZhengHongming888 1fc5026347
feat: enable intel XPU Dockerfile for Dev Target (#7134) 
Signed-off-by: Hongming Zheng <hongming.zheng@intel.com>
Co-authored-by: Zhan Xue <zhan.xue@intel.com>
 2026-03-13 00:24:29 -07:00
Yan Ru Pei bddaaa2658
feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-03-13 04:16:49 +00:00
dagil-nvidia 12785247c2
docs: fix fault tolerance sidebar page order (#7336) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-03-12 22:49:44 -05:00
Tzu-Ling Kan dba69e0f2f
chore(deps): bump vLLM 0.16.0 → 0.17.1 (#7170) 
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
 2026-03-12 20:44:11 -07:00
Ryan Olson 17db1b6abd
fix: harden numa cpuset lookup (#7060) 
Signed-off-by: Ryan Olson <rolson@nvidia.com>
 2026-03-12 20:38:23 -07:00
dagil-nvidia b950034bce
docs: update introduction page with links and formatting (#7330) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
 2026-03-12 20:05:03 -07:00
dagil-nvidia cd8ba391c9
docs: fix Fern CI failures (broken links, MDX parser, missing KVBM assets) (#7322) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-03-12 19:57:02 -07:00
Dmitry Tokarev e3b1081358
fix: Fix kubernetes-operator container image name in docs (#7312) 
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-12 22:33:29 -04:00
Tushar Sharma 56eacd70ad
fix: use check_run_id for retry namespace to avoid label overflow (#7321) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-12 19:17:01 -07:00
Michael Feil d170d56ae7
fix: cancellation kv commit router (#7178) 
Signed-off-by: michaelfeil <63565275+michaelfeil@users.noreply.github.com>
 2026-03-13 01:33:46 +00:00
Yan Ru Pei dcbccbcd2e
feat(kv-router): add worker_type to router selection log (#7258) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-03-12 23:14:28 +00:00
nikharm 7b1939058a
docs: update KV Router A/B testing guide (#7047) 
Signed-off-by: Nikhar Maheshwari <nikharm@nvidia.com>
 2026-03-12 15:28:24 -07:00
Fern Support ec238e7d65
fix: add basepath aware for multi repo setup (#7300) 
Signed-off-by: Ryan Amirthan Stephen <105958906+Ryan-Amirthan@users.noreply.github.com>
Co-authored-by: Ryan Amirthan Stephen <105958906+Ryan-Amirthan@users.noreply.github.com>
 2026-03-12 14:42:03 -07:00
Yan Ru Pei f80ad6926a
feat(kv-router): package dynamo-kv-indexer binary via maturin [LLM-126] (#7194) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-03-12 21:33:11 +00:00
Anant Sharma a2ffdd74e4
fix: unique compliance artifact names for build variants (#7313) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2026-03-12 17:10:42 -04:00
Hongkuan Zhou cd4773fb31
feat: ForwardPassMetrics dynamo event plane integration (#7250) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
 2026-03-12 20:58:01 +00:00
Anish 197f659589
docs: improve Planner documentation clarity and fix incorrect defaults (#7303) 
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-12 13:55:45 -07:00
dagil-nvidia b9d10bdb54
docs: add introduction page to Getting Started (#7292) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
 2026-03-12 20:49:53 +00:00
Anant Sharma f87e2c5846
ci: disable Docker layer cache for nightly builds (#7305) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2026-03-12 20:47:10 +00:00