Alec
|
e10787894d
|
fix: add periodic vLLM engine stats logging and fix log routing (#6566)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-25 23:45:34 +00:00 |
|
Schwinn Saereesitthipitak
|
5a7ead2bdc
|
feat(sglang): add checkpoint/restore support for chrek (#6594)
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
|
2026-02-25 23:42:16 +00:00 |
|
zhongdaor-nv
|
49eca14b69
|
fix: optimize uuid calculation (#6596)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
|
2026-02-25 15:25:48 -08:00 |
|
Schwinn Saereesitthipitak
|
a6d970e961
|
feat: refactor GMS client memory manager with tiered API (#6549)
|
2026-02-25 23:24:17 +00:00 |
|
daiyaanarfeen
|
651ef5b506
|
feat: throughput-metrics-source for SLA planner + GlobalPlanner disagg scaling (#6500)
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-02-25 22:58:24 +00:00 |
|
Tzu-Ling Kan
|
c18b475851
|
feat: Use --request-rate and --request-rate-mode for aiper client (#6585)
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
|
2026-02-25 14:20:44 -08:00 |
|
Fern Support
|
967e29619b
|
docs: Update Footer Legal Links (#6589)
Signed-off-by: willkendall01 <will.kendall@buildwithfern.com>
Co-authored-by: willkendall01 <will.kendall@buildwithfern.com>
|
2026-02-25 13:26:47 -08:00 |
|
Anant Sharma
|
6608cd5947
|
fix: stage sccache off PATH to prevent meson auto detection (#6578)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2026-02-25 16:01:44 -05:00 |
|
Dillon Cullinan
|
e325dd13fd
|
ci: OPS-3359: Refactor post-merge and nightly workflows (#6388)
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
|
2026-02-25 16:01:09 -05:00 |
|
Nikita
|
21fce9ba0d
|
feat: Tiktoken support (#6460)
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
|
2026-02-25 12:46:47 -08:00 |
|
Yuewei Na
|
8483e4a07f
|
chore: Upgrade to tensorrt-llm==1.3.0rc5 (#6579)
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
|
2026-02-25 12:22:58 -08:00 |
|
Yan Ru Pei
|
ebaf048d16
|
chore: plumb allowed_worker_ids through RoutingHints (#6580)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-25 12:12:53 -08:00 |
|
dagil-nvidia
|
4fbd8f1c66
|
chore: remove binary data file from flash-indexer blog (#6584)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-25 20:04:53 +00:00 |
|
jh-nv
|
42cde26489
|
fix: migrate example and document to the latest endpoint API (#6542)
|
2026-02-25 12:00:04 -08:00 |
|
dagil-nvidia
|
222c2e85c8
|
docs: add Flash Indexer blog post (#6472)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-25 12:21:49 -06:00 |
|
Nikita
|
d1bd210f1b
|
feat: Kimi K2/K2.5 tool and reasoning parsers (#6407)
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
|
2026-02-25 18:19:14 +00:00 |
|
Keiven C
|
ff06b17e7f
|
fix: guarantee RouterRequestMetrics availability & documentation updates (#6558)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-25 10:18:01 -08:00 |
|
Thomas Montfort
|
6c2714e0b5
|
feat(docs): operator rolling updates documentation (#6541)
|
2026-02-25 17:57:11 +00:00 |
|
Tzu-Ling Kan
|
539117546a
|
fix: Parse the latest successful attempt (#6565)
Signed-off-by: Tzu-Ling <tzulingk@nvidia.com>
|
2026-02-25 10:55:25 -07:00 |
|
Anant Sharma
|
73c02a0b4a
|
fix: disable media-ffmpeg feature by default (#6574)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2026-02-25 11:49:58 -05:00 |
|
dagil-nvidia
|
e0373bd725
|
docs: alphabetize backends (SGLang, TensorRT-LLM, vLLM) (#6537)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-25 10:07:59 -06:00 |
|
Kris Hung
|
80955ef463
|
perf: Keep embeddings on GPU Embedding Sender in EPD pipeline + minor fixes (#6535)
|
2026-02-25 07:51:20 -08:00 |
|
Pavithra Vijayakrishnan
|
5734f5c427
|
chore: Update the reference in readme (#6298)
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
|
2026-02-25 08:56:07 +00:00 |
|
Qi Wang
|
d5add7fffa
|
docs: embedding cache in vLLM and TRT-LLM (#6555)
|
2026-02-25 00:04:46 -08:00 |
|
Yongming Ding
|
5d9586234e
|
feat(mocker): add KV cache transfer latency for disagg serving (#6504)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
|
2026-02-24 23:53:28 -08:00 |
|
Ran Rubin
|
8fbe722895
|
chore: bake sccache into dynamo base (#6532)
|
2026-02-25 09:50:07 +02:00 |
|
Ran Rubin
|
e5f97343fd
|
ci: Accelerate dynamo frontend image build (#6479)
|
2026-02-25 08:56:22 +02:00 |
|
zhongdaor-nv
|
c3bfbd2040
|
chore: add top_p=1 recommendation for gpt-oss to avoid token repetition (#5550)
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
|
2026-02-24 22:42:08 -08:00 |
|
Alec
|
35323da20c
|
fix: vllm launch script errors for disagg and spec decoding (#6562)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-24 20:41:45 -08:00 |
|
John Pohl
|
44d43d0cf6
|
feat: MJPEG video streaming via /v1/videos/stream (experimental) (#6487)
Signed-off-by: Ryan McCormick <mccormick.codes@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2026-02-25 03:04:39 +00:00 |
|
Yan Ru Pei
|
65dc451db9
|
feat: add ZMQ KV event publishing to mocker [DYN-2221] (#6528)
Signed-off-by: Ru Pei <rupei@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-24 18:57:28 -08:00 |
|
Tushar Sharma
|
e3dc179304
|
fix: add explicit --kv-transfer-config to disagg prefill workers (#6554)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-25 02:33:15 +00:00 |
|
Alec
|
eac94322f0
|
feat: add --kv-transfer-config NixlConnector to disagg scripts and recipes (#6560)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
|
2026-02-25 02:26:47 +00:00 |
|
Ryan McCormick
|
4bd4c1657b
|
feat: Log discovery backend type (#6559)
|
2026-02-25 02:25:44 +00:00 |
|
ishandhanani
|
29c46fb775
|
docs: expand SGLang observability guide with tracing and dashboards (#6556)
|
2026-02-24 17:59:55 -08:00 |
|
atchernych
|
c916cd42ff
|
feat: Support epp's "pods" interface in Dynamo fixes [DEP-424] (#6302)
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
|
2026-02-25 01:54:38 +00:00 |
|
Qi Wang
|
5a4c96dbaf
|
test: introduce multimodal benchmark toolkit (#6330)
|
2026-02-24 16:55:04 -08:00 |
|
Julien Mancuso
|
fcdf661009
|
chore: document all env vars injected by operator (#6548)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
|
2026-02-24 15:59:39 -07:00 |
|
Jason Zhou
|
4ea80e9585
|
chore: use aic release/0.7.0 (#6494)
|
2026-02-24 16:27:19 -06:00 |
|
Anant Sharma
|
7f9fdb6e4b
|
ci: enable GPU access for rust-checks in dynamo validation (#6545)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2026-02-24 14:21:44 -08:00 |
|
KrishnanPrash
|
8e2363758e
|
fix: restore E/P/D multimodal disagg serving and add Qwen3-VL-30B-A3B support (#6533)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Signed-off-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
|
2026-02-24 14:13:10 -08:00 |
|
Kyle McGill
|
5c64ffc3c8
|
docs: updated KVBM docs to specify correct configurations for the write-through property (#6506)
Signed-off-by: Kyle McGill <kmcgill@nvidia.com>
|
2026-02-24 14:10:09 -08:00 |
|
ishandhanani
|
6642e23e0f
|
feat: sglang to 0.5.9 + updated docs (#6518)
Co-authored-by: baihuitian <baihuitian.bht@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-24 21:48:25 +00:00 |
|
Keiven C
|
1df620b4d0
|
feat: router metrics with dynamo_router_* {worker_id=...}. Update docs (#6227)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-24 21:34:14 +00:00 |
|
Keiven C
|
f89088007e
|
fix: vLLM Dockerfile need nvlink and crt for kvbm dependencies (#6521)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-24 13:28:44 -08:00 |
|
Ayush Agarwal
|
e94f464760
|
chore: install vllm-omni in vllm container (#6458)
Signed-off-by: ayushag <ayushag@nvidia.com>
|
2026-02-24 21:03:53 +00:00 |
|
Yan Ru Pei
|
efa89448f5
|
chore: de-async scheduler read paths and unblock decode output tracking (#6510)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-24 21:00:36 +00:00 |
|
Biswa Panda
|
6fab12be19
|
test: add tests for lora aware kv cache events and routing (#6523)
|
2026-02-24 12:38:06 -08:00 |
|
Raghav Potluri
|
35128b144b
|
fix: frontend crash when using TRTLLM runtime image (#6481)
Signed-off-by: Raghav Potluri <raghav.potluri21@gmail.com>
|
2026-02-24 19:52:04 +00:00 |
|
Yan Ru Pei
|
bc00ef3879
|
chore: split JetStream subscriber into dedicated module and deprecate durable_kv_events [DYN-2203] (#6477)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-24 11:30:38 -08:00 |