Commit Graph

722 Commits

Author SHA1 Message Date
ishandhanani 51dfd76045
feat: add SGLang chat processor for frontend pre/post processing (#6834)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-09 23:27:34 +00:00
dagil-nvidia 3ec78ec3d3
docs: update support matrix and release artifacts for v0.9.1 (#7044)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-09 16:32:32 -05:00
Schwinn Saereesitthipitak d54af4f8cf
chore: restrict Dynamo Snapshot to x86_64, document backend support (#7031) 2026-03-09 14:14:39 -07:00
Ryan McCormick 9df36b3868
fix(docs): Fix mermaid chart in MM doc and remove extra table (#7111) 2026-03-09 13:34:07 -07:00
hhzhang16 71f9e7a9de
fix: normalize GPUSKU to AIC system identifier (#6984)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
2026-03-09 12:58:39 -05:00
Thomas Montfort a22b44b7cd
docs: add rolling-update page to kubernetes nav index (#7094) 2026-03-09 10:21:18 -07:00
Schwinn Saereesitthipitak 6831020f35
chore: rename chrek to Dynamo Snapshot (#7028)
Signed-off-by: Schwinn Saereesitthipitak <17022745+galletas1712@users.noreply.github.com>
2026-03-08 15:13:36 -04:00
Thomas Montfort 7dbebf3c61
refactor: replace kube-rbac-proxy sidecar with controller-runtime WithAuthenticationAndAuthorization (#7045) 2026-03-07 08:01:03 -08:00
Harrison Saturley-Hall 25393fb395
chore: bump trtllm to 1.3.0rc5.post1 (#7040)
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
2026-03-06 19:44:24 -05:00
Ryan McCormick f0bcabe0c6
docs(multimodality): Refactor MM docs into high level features and VLM/Diffusion sections (#6831)
Signed-off-by: Ryan McCormick <mccormick.codes@gmail.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
2026-03-06 15:11:39 -08:00
Yifan Jiang 100819299f
feat(trtllm): add additional metrics for dynamo-trtllm (#6668)
Signed-off-by: Yifan Jiang <19356972+yifjiang@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-06 14:34:38 -08:00
dagil-nvidia 8381e28a3e
docs: update v1.0.0 backend versions in support matrix (#7004)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-03-06 12:50:03 -08:00
Julien Mancuso fc2d01d111
refactor: move MPI SSH key generation from Helm hook Job into operator reconciliation (#6940)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
2026-03-06 18:25:00 +00:00
Yan Ru Pei f934744fb9
fix: restore --enforce-disagg to reject requests before prefill router activates (#6957)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-03-06 04:39:28 +00:00
Yan Ru Pei 49fa25e2ce
docs(kv-router): add kv event replay comparison with vLLM (#6928)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-03-05 09:17:34 -08:00
Kris Hung eb0bf24e82
feat: Add NVTX markers for vLLM EPD (#6627) 2026-03-04 17:29:00 -08:00
Yan Ru Pei 5139f688cb
docs(router): add tuning guideline for output block tracking (#6911)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-03-04 16:18:05 -08:00
Julien Mancuso e43b30506c
feat: move webhook certificate management and CA injection from Helm hooks into the operator (#6839)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
2026-03-04 14:12:29 -08:00
Yan Ru Pei b94cb54318
chore(kv-router): split monolithic indexer.rs into indexer/ directory (#6870)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-04 20:42:50 +00:00
Hongkuan Zhou 7c1a62385a
fix: refactor profiler's dgd generation workflow to correctly generate mocker config (#6848)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
2026-03-04 08:44:27 -08:00
Yan Ru Pei 35f99f93c9
feat(kv-indexer): multi-model and multi-tenant isolation (#6830)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-04 09:07:02 +00:00
Dmitry Tokarev 3be537990a
fix: Fix/docs readme skill links (#6856)
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-03 23:32:22 -05:00
atchernych 73a4ab3172
chore: Optimizations for epp interface complience (#6581)
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
2026-03-04 03:46:04 +00:00
Anant Sharma 9254e3d4d2
chore: update nixl version to 0.10.1 (#6826)
Signed-off-by: Anant Sharma <anants@nvidia.com>
2026-03-03 16:47:55 -05:00
Yan Ru Pei 9f3b7b330d
chore(kv-router): deduplicate KvRouterConfig args into shared ArgGroup (#6805)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-03 19:53:03 +00:00
Qi Wang 552ae18631
docs: delete script and add instructions (#6763) 2026-03-03 17:49:48 +00:00
Julien Mancuso 0404a9be29
fix: allow v1alpha1 DGDR creation by fixing webhook version matching and backend enum (#6803)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
2026-03-03 10:17:25 -07:00
Alec 9fe03dd864
docs: vLLM README container instructions and KV offloading page (#6793)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-03 05:07:41 +00:00
Yue Yu 4d7c98458b
feat: FlexKV integration in Dynamo (#5858)
Signed-off-by: zhuofan1123 <zhuofanl@nvidia.com>
Co-authored-by: zhuofan1123 <zhuofanl@nvidia.com>
2026-03-02 20:18:39 -08:00
Tanmay Verma 1bb28d6ff3
docs: Refactor TensorRT-LLM backend docs (#6782) 2026-03-03 01:28:45 +00:00
Yongming Ding 8bd5966b82
fix: auto-scale request count in benchmarks (#6777)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
2026-03-02 17:13:11 -08:00
Alec 75bf1e0993
docs: restructure vLLM docs and add startup banners to launch scripts (#6698)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
2026-03-03 00:37:55 +00:00
ishandhanani 6243506b47
chore: consolidate 3 docs skills into 1, add .claude codeowners (#6785)
Signed-off-by: Ishan Dhanani <ishandhanani@gmail.com>
2026-03-02 16:05:12 -08:00
atchernych ee33acf3c3
fix: Add weight: 1 to the EPP config plugins (#6756)
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
2026-03-02 22:13:44 +00:00
Julien Mancuso f83d9a532f
fix: decouple Helm chart from runtime cluster state for helm template and GitOps compatibility (#6754)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
2026-03-02 14:19:14 -07:00
Simone Chen 63245237d2
docs: update AIC disaggregated serving guide (#6553)
Signed-off-by: Simone Chen <simonec@nvidia.com>
2026-03-02 11:03:36 -08:00
Yan Ru Pei 07742cc27f
feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-02 10:34:21 -08:00
Neal Vaidya ece08dc926
docs: restructure docs directory and move fern config to fern/ (#6700)
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-03-01 19:58:22 -08:00
dagil-nvidia b302ec412c
fix: replace broken archive docs URLs in release-artifacts (#6722)
Signed-off-by: Daniel Gil <dagil@nvidia.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-27 18:23:39 -08:00
Qi Wang 626fb5dde3
docs: update mm embedding cache graphs (#6697) 2026-02-27 14:37:59 -08:00
Ashna Mehrotra d8b7d394ac
docs: V1beta1 dgdr docs (#6647)
Signed-off-by: ashnamehrotra <ashnamehrotra@gmail.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
2026-02-27 22:33:11 +00:00
Hongkuan Zhou 9df78cb6b8
fix: broken link in profiler guide (#6709)
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
2026-02-27 14:25:42 -08:00
Yan Ru Pei 55c0a769b4
feat: default router_event_threads to 4 (#6672)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-02-27 22:14:47 +00:00
Dmitry Tokarev 57b55d889a
fix: fix docs links (#6702)
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
2026-02-27 16:44:17 -05:00
dagil-nvidia 817f2eebbd
docs: add Dynamo Docs Guide and Claude Code skills (#6684)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-27 14:47:08 -06:00
ishandhanani f1d5c95a4e
feat: wire nvext.cache_control TTL-based pinning through Dynamo router (#6213)
Co-authored-by: Claude <noreply@anthropic.com>
2026-02-27 01:03:27 +00:00
dagil-nvidia d9657b34e4
docs: restructure support matrix with summary and merged CUDA tables (#6630)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
2026-02-26 17:13:58 -06:00
Yan Ru Pei 2cf79d92bd
docs: add Ryan Olson to flash indexer author list (#6658)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-02-26 14:56:12 -08:00
Yan Ru Pei 002c6823d6
docs: fix typos and wrong imports in router docs (#6654)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-02-26 14:38:52 -08:00
Alec 64574a3e0f
chore(deps): bump vLLM to 0.16.0 (#6614)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-26 21:09:21 +00:00