Yuewei Na
|
8483e4a07f
|
chore: Upgrade to tensorrt-llm==1.3.0rc5 (#6579)
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
|
2026-02-25 12:22:58 -08:00 |
|
jh-nv
|
42cde26489
|
fix: migrate example and document to the latest endpoint API (#6542)
|
2026-02-25 12:00:04 -08:00 |
|
Nikita
|
d1bd210f1b
|
feat: Kimi K2/K2.5 tool and reasoning parsers (#6407)
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
|
2026-02-25 18:19:14 +00:00 |
|
Keiven C
|
ff06b17e7f
|
fix: guarantee RouterRequestMetrics availability & documentation updates (#6558)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-25 10:18:01 -08:00 |
|
Thomas Montfort
|
6c2714e0b5
|
feat(docs): operator rolling updates documentation (#6541)
|
2026-02-25 17:57:11 +00:00 |
|
dagil-nvidia
|
e0373bd725
|
docs: alphabetize backends (SGLang, TensorRT-LLM, vLLM) (#6537)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-25 10:07:59 -06:00 |
|
Pavithra Vijayakrishnan
|
5734f5c427
|
chore: Update the reference in readme (#6298)
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
|
2026-02-25 08:56:07 +00:00 |
|
Qi Wang
|
d5add7fffa
|
docs: embedding cache in vLLM and TRT-LLM (#6555)
|
2026-02-25 00:04:46 -08:00 |
|
Yongming Ding
|
5d9586234e
|
feat(mocker): add KV cache transfer latency for disagg serving (#6504)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
|
2026-02-24 23:53:28 -08:00 |
|
zhongdaor-nv
|
c3bfbd2040
|
chore: add top_p=1 recommendation for gpt-oss to avoid token repetition (#5550)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
|
2026-02-24 22:42:08 -08:00 |
|
ishandhanani
|
29c46fb775
|
docs: expand SGLang observability guide with tracing and dashboards (#6556)
|
2026-02-24 17:59:55 -08:00 |
|
atchernych
|
c916cd42ff
|
feat: Support epp's "pods" interface in Dynamo fixes [DEP-424] (#6302)
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
|
2026-02-25 01:54:38 +00:00 |
|
Julien Mancuso
|
fcdf661009
|
chore: document all env vars injected by operator (#6548)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
|
2026-02-24 15:59:39 -07:00 |
|
Kyle McGill
|
5c64ffc3c8
|
docs: updated KVBM docs to specify correct configurations for the write-through property (#6506)
Signed-off-by: Kyle McGill <kmcgill@nvidia.com>
|
2026-02-24 14:10:09 -08:00 |
|
ishandhanani
|
6642e23e0f
|
feat: sglang to 0.5.9 + updated docs (#6518)
Co-authored-by: baihuitian <baihuitian.bht@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-24 21:48:25 +00:00 |
|
Keiven C
|
1df620b4d0
|
feat: router metrics with dynamo_router_* {worker_id=...}. Update docs (#6227)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-24 21:34:14 +00:00 |
|
Yan Ru Pei
|
bc00ef3879
|
chore: split JetStream subscriber into dedicated module and deprecate durable_kv_events [DYN-2203] (#6477)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-24 11:30:38 -08:00 |
|
Biswa Panda
|
75fea78797
|
feat: make KV cache events and routing LoRA-aware (#6517)
|
2026-02-24 18:35:08 +00:00 |
|
Thomas Montfort
|
c0f34b15a0
|
feat(operator): operator config versioning and injected as configmap (#6464)
|
2026-02-24 10:26:28 -08:00 |
|
Alec
|
6d3b92f04e
|
feat: remove --connector flag for vLLM backend (LLM-90) (#6450)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-24 17:49:00 +00:00 |
|
Yan Ru Pei
|
c9ff623538
|
chore: replace --enforce-disagg with --decode-fallback, default to enforcing disagg (#6515)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-24 09:24:11 -08:00 |
|
Mohamad
|
0432aad83d
|
docs: Clarify DGDSA creation for services is disabled by default (#6389)
Signed-off-by: Mohamad <159854973+maljazaery@users.noreply.github.com>
|
2026-02-24 09:56:56 -07:00 |
|
hhzhang16
|
659122ed07
|
feat: add Planner schema to DGDR and Profiler input (#6463)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Sertaç Özercan <852750+sozercan@users.noreply.github.com>
|
2026-02-24 10:14:57 -05:00 |
|
Alec
|
7893f2684e
|
feat: add --disaggregation-mode enum to vLLM backend (#6483)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-23 19:34:30 -07:00 |
|
Julien Mancuso
|
5277fb9bbe
|
feat: simplify CRD management (#6466)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
|
2026-02-23 19:18:13 -07:00 |
|
Yan Ru Pei
|
0f48837d58
|
docs: add standalone KV indexer documentation (#6511)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-23 18:07:48 -08:00 |
|
Yan Ru Pei
|
ddeee88b05
|
feat: expose predicted KV hit rate as Prometheus histogram (#6507)
Signed-off-by: Pea Brane <peabrane@peabrane.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-24 00:54:14 +00:00 |
|
Richard Huo
|
15d217606a
|
chore: revert the kvbm workaround since trtllm v1.3.0rc3 is upgraded (#6495)
|
2026-02-23 15:05:04 -08:00 |
|
Biswa Panda
|
04a532edc4
|
feat: add multimodal lora docs and deployment example for k8s (#6452)
|
2026-02-23 10:49:46 -07:00 |
|
Schwinn Saereesitthipitak
|
673822ea93
|
fix(chrek): fix CI errors and replace SIGUSR2 with SIGKILL on checkpoint failure (#6478)
|
2026-02-23 10:23:52 -05:00 |
|
jh-nv
|
ea86df2985
|
feat: Backend accept new requests during shutdown grace period (#6093)
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
|
2026-02-23 03:18:46 +00:00 |
|
Alec
|
4ebb244b2a
|
feat: add --headless mode for multi-node TP/PP in dynamo.vllm (#6204)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-22 22:38:17 +00:00 |
|
Schwinn Saereesitthipitak
|
bb8fc8a4a9
|
feat(chrek): external restore, signal-based IPC, and package refactor (#6286)
Co-authored-by: Dan Feigin <dfeigin@nvidia.com>
|
2026-02-21 01:31:32 +00:00 |
|
Julien Mancuso
|
f385661ae0
|
chore: remove mechanism to disable webhooks (#6441)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
|
2026-02-20 09:53:10 -07:00 |
|
hhzhang16
|
ebc61637d8
|
feat: Add v1beta1 DGDR API with conversion framework (#6352)
Signed-off-by: Jont828 <jt572@cornell.edu>
Signed-off-by: Hongkuan Zhou <hongkuanz@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Jont828 <jt572@cornell.edu>
|
2026-02-19 23:09:02 -08:00 |
|
Alec
|
7bbacce196
|
feat: default kv-events-config to empty (align with vLLM defaults) (#6404)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-20 06:44:51 +00:00 |
|
Ayush Agarwal
|
d6c49779de
|
chore: unify filesystem usage across all frameworks and workers (#6391)
Signed-off-by: ayushag <ayushag@nvidia.com>
|
2026-02-20 05:56:31 +00:00 |
|
Ayush Agarwal
|
6dd3ce2ea0
|
feat: vllm omni text to video generation pipeline (#6104)
Signed-off-by: ayushag <ayushag@nvidia.com>
|
2026-02-20 04:23:44 +00:00 |
|
dagil-nvidia
|
9bdc8b7303
|
docs: fix 14 broken links detected by lychee CI (#6438)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-19 19:20:06 -05:00 |
|
mohammedabdulwahhab
|
46d9f448c8
|
fix: disable etcd subchart by default (#6329)
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
|
2026-02-19 12:35:24 -08:00 |
|
Yuewei Na
|
9a15730a7f
|
chore: Upgrade to tensorrt-llm==1.3.0rc3 (#6402)
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
|
2026-02-19 14:12:32 -05:00 |
|
Ziqi Fan
|
832bf80a15
|
feat: add NVTX annotation to KVBM (#6334)
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
|
2026-02-19 17:23:33 +00:00 |
|
Thomas Montfort
|
61889a14fb
|
feat(operator): add observedGeneration to DGD status (#6398)
|
2026-02-18 19:08:50 -08:00 |
|
hhzhang16
|
6a3f2002bd
|
feat: Optional GPU Discovery for Namespace-Scoped Operators (#6343)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
|
2026-02-18 18:13:06 -08:00 |
|
jh-nv
|
44a76f96b3
|
refactor: update frontend kv-router flags to be consistent with router (#6361)
|
2026-02-19 00:27:15 +00:00 |
|
Ayush Agarwal
|
33d71102b1
|
feat: glm47 tool parser (#5897)
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Co-authored-by: Matej Kosec <mkosec@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-02-18 23:17:23 +00:00 |
|
Thomas Montfort
|
72579ee7d8
|
feat: add DGDR Status .state enum (#6396)
|
2026-02-18 22:55:27 +00:00 |
|
Nikita
|
82f721c738
|
feat: Add DGD .status.state enum (#6324)
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
|
2026-02-18 14:53:06 -06:00 |
|
Qi Wang
|
4d0380d54a
|
refactor: introduce worker factory in vLLM multimodal (#6060)
|
2026-02-18 12:21:21 -08:00 |
|
jh-nv
|
858f33fc3d
|
feat: migrate router configuration (#6346)
|
2026-02-18 00:50:00 -05:00 |