Commit Graph

661 Commits

Author SHA1 Message Date
Fern Support 967e29619b
docs: Update Footer Legal Links (#6589)
Signed-off-by: willkendall01 <will.kendall@buildwithfern.com>
Co-authored-by: willkendall01 <will.kendall@buildwithfern.com>
2026-02-25 13:26:47 -08:00
Yuewei Na 8483e4a07f
chore: Upgrade to tensorrt-llm==1.3.0rc5 (#6579)
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
2026-02-25 12:22:58 -08:00
dagil-nvidia 4fbd8f1c66
chore: remove binary data file from flash-indexer blog (#6584)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-25 20:04:53 +00:00
jh-nv 42cde26489
fix: migrate example and document to the latest endpoint API (#6542) 2026-02-25 12:00:04 -08:00
dagil-nvidia 222c2e85c8
docs: add Flash Indexer blog post (#6472)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-25 12:21:49 -06:00
Nikita d1bd210f1b
feat: Kimi K2/K2.5 tool and reasoning parsers (#6407)
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
2026-02-25 18:19:14 +00:00
Keiven C ff06b17e7f
fix: guarantee RouterRequestMetrics availability & documentation updates (#6558)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-25 10:18:01 -08:00
Thomas Montfort 6c2714e0b5
feat(docs): operator rolling updates documentation (#6541) 2026-02-25 17:57:11 +00:00
dagil-nvidia e0373bd725
docs: alphabetize backends (SGLang, TensorRT-LLM, vLLM) (#6537)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-25 10:07:59 -06:00
Pavithra Vijayakrishnan 5734f5c427
chore: Update the reference in readme (#6298)
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
2026-02-25 08:56:07 +00:00
Qi Wang d5add7fffa
docs: embedding cache in vLLM and TRT-LLM (#6555) 2026-02-25 00:04:46 -08:00
Yongming Ding 5d9586234e
feat(mocker): add KV cache transfer latency for disagg serving (#6504)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
2026-02-24 23:53:28 -08:00
zhongdaor-nv c3bfbd2040
chore: add top_p=1 recommendation for gpt-oss to avoid token repetition (#5550)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
2026-02-24 22:42:08 -08:00
ishandhanani 29c46fb775
docs: expand SGLang observability guide with tracing and dashboards (#6556) 2026-02-24 17:59:55 -08:00
atchernych c916cd42ff
feat: Support epp's "pods" interface in Dynamo fixes [DEP-424] (#6302)
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
2026-02-25 01:54:38 +00:00
Julien Mancuso fcdf661009
chore: document all env vars injected by operator (#6548)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
2026-02-24 15:59:39 -07:00
Kyle McGill 5c64ffc3c8
docs: updated KVBM docs to specify correct configurations for the write-through property (#6506)
Signed-off-by: Kyle McGill <kmcgill@nvidia.com>
2026-02-24 14:10:09 -08:00
ishandhanani 6642e23e0f
feat: sglang to 0.5.9 + updated docs (#6518)
Co-authored-by: baihuitian <baihuitian.bht@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-24 21:48:25 +00:00
Keiven C 1df620b4d0
feat: router metrics with dynamo_router_* {worker_id=...}. Update docs (#6227)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-24 21:34:14 +00:00
Yan Ru Pei bc00ef3879
chore: split JetStream subscriber into dedicated module and deprecate durable_kv_events [DYN-2203] (#6477)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-02-24 11:30:38 -08:00
Biswa Panda 75fea78797
feat: make KV cache events and routing LoRA-aware (#6517) 2026-02-24 18:35:08 +00:00
Thomas Montfort c0f34b15a0
feat(operator): operator config versioning and injected as configmap (#6464) 2026-02-24 10:26:28 -08:00
Alec 6d3b92f04e
feat: remove --connector flag for vLLM backend (LLM-90) (#6450)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-24 17:49:00 +00:00
Yan Ru Pei c9ff623538
chore: replace --enforce-disagg with --decode-fallback, default to enforcing disagg (#6515)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-02-24 09:24:11 -08:00
Mohamad 0432aad83d
docs: Clarify DGDSA creation for services is disabled by default (#6389)
Signed-off-by: Mohamad <159854973+maljazaery@users.noreply.github.com>
2026-02-24 09:56:56 -07:00
hhzhang16 659122ed07
feat: add Planner schema to DGDR and Profiler input (#6463)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Sertaç Özercan <852750+sozercan@users.noreply.github.com>
2026-02-24 10:14:57 -05:00
Alec 7893f2684e
feat: add --disaggregation-mode enum to vLLM backend (#6483)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-23 19:34:30 -07:00
Julien Mancuso 5277fb9bbe
feat: simplify CRD management (#6466)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
2026-02-23 19:18:13 -07:00
Yan Ru Pei 0f48837d58
docs: add standalone KV indexer documentation (#6511)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-02-23 18:07:48 -08:00
Yan Ru Pei ddeee88b05
feat: expose predicted KV hit rate as Prometheus histogram (#6507)
Signed-off-by: Pea Brane <peabrane@peabrane.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-24 00:54:14 +00:00
Richard Huo 15d217606a
chore: revert the kvbm workaround since trtllm v1.3.0rc3 is upgraded (#6495) 2026-02-23 15:05:04 -08:00
Biswa Panda 04a532edc4
feat: add multimodal lora docs and deployment example for k8s (#6452) 2026-02-23 10:49:46 -07:00
Schwinn Saereesitthipitak 673822ea93
fix(chrek): fix CI errors and replace SIGUSR2 with SIGKILL on checkpoint failure (#6478) 2026-02-23 10:23:52 -05:00
jh-nv ea86df2985
feat: Backend accept new requests during shutdown grace period (#6093)
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
Co-authored-by: Jacky <18255193+kthui@users.noreply.github.com>
2026-02-23 03:18:46 +00:00
Alec 4ebb244b2a
feat: add --headless mode for multi-node TP/PP in dynamo.vllm (#6204)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-22 22:38:17 +00:00
Schwinn Saereesitthipitak bb8fc8a4a9
feat(chrek): external restore, signal-based IPC, and package refactor (#6286)
Co-authored-by: Dan Feigin <dfeigin@nvidia.com>
2026-02-21 01:31:32 +00:00
Julien Mancuso f385661ae0
chore: remove mechanism to disable webhooks (#6441)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
2026-02-20 09:53:10 -07:00
hhzhang16 ebc61637d8
feat: Add v1beta1 DGDR API with conversion framework (#6352)
Signed-off-by: Jont828 <jt572@cornell.edu>
Signed-off-by: Hongkuan Zhou <hongkuanz@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Co-authored-by: Jont828 <jt572@cornell.edu>
2026-02-19 23:09:02 -08:00
Alec 7bbacce196
feat: default kv-events-config to empty (align with vLLM defaults) (#6404)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-20 06:44:51 +00:00
Ayush Agarwal d6c49779de
chore: unify filesystem usage across all frameworks and workers (#6391)
Signed-off-by: ayushag <ayushag@nvidia.com>
2026-02-20 05:56:31 +00:00
Ayush Agarwal 6dd3ce2ea0
feat: vllm omni text to video generation pipeline (#6104)
Signed-off-by: ayushag <ayushag@nvidia.com>
2026-02-20 04:23:44 +00:00
dagil-nvidia 9bdc8b7303
docs: fix 14 broken links detected by lychee CI (#6438)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-19 19:20:06 -05:00
mohammedabdulwahhab 46d9f448c8
fix: disable etcd subchart by default (#6329)
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
2026-02-19 12:35:24 -08:00
Yuewei Na 9a15730a7f
chore: Upgrade to tensorrt-llm==1.3.0rc3 (#6402)
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
2026-02-19 14:12:32 -05:00
dagil-nvidia 058fc6ac90
fix: correct blog URL from /blog/blog to /blog (#6414)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-19 11:35:36 -06:00
Ziqi Fan 832bf80a15
feat: add NVTX annotation to KVBM (#6334)
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
2026-02-19 17:23:33 +00:00
dagil-nvidia 7df460b8e4
docs: add blog section with navbar dropdown and landing page (#6409)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-19 10:58:31 -06:00
Thomas Montfort 61889a14fb
feat(operator): add observedGeneration to DGD status (#6398) 2026-02-18 19:08:50 -08:00
hhzhang16 6a3f2002bd
feat: Optional GPU Discovery for Namespace-Scoped Operators (#6343)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
2026-02-18 18:13:06 -08:00
jh-nv 44a76f96b3
refactor: update frontend kv-router flags to be consistent with router (#6361) 2026-02-19 00:27:15 +00:00