Yan Ru Pei
|
0b33c1dfa0
|
fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2025-12-31 10:55:44 -08:00 |
|
Nate Mailhot
|
910b587db1
|
chore: update nixl to 0.8.0 and ucx 1.20 (#5007)
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
|
2025-12-19 10:55:40 -08:00 |
|
Anant Sharma
|
7436e3bc03
|
chore: update versions for 0.8.0 release (#5031)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2025-12-19 10:21:52 -08:00 |
|
Anant Sharma
|
5b82b8b096
|
chore: update versions to match latest release (#4966)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2025-12-18 08:45:44 -08:00 |
|
milesial
|
74fcd4a9b9
|
feat: video decoder in the frontend (#4719)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
|
2025-12-16 14:28:06 -08:00 |
|
KrishnanPrash
|
24ac6c1588
|
chore: bump minijinja to 2.14.0 (#4949)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
|
2025-12-15 09:58:52 -08:00 |
|
Biswa Panda
|
6a0e67ed78
|
feat: add LoRA common APIs and implementation for lora management (#4464)
|
2025-11-26 20:29:25 +00:00 |
|
milesial
|
0a06591826
|
feat: decoded media via NIXL (#3988)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
|
2025-11-25 19:15:04 +00:00 |
|
Graham King
|
27904535fb
|
fix(storage): Correctly encoding FileStore keys (#4539)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-21 17:01:40 -05:00 |
|
Graham King
|
2f1778c13d
|
fix(storage): File store shouldn't notify on metdata changes (#4434)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-18 10:24:04 -08:00 |
|
Yan Ru Pei
|
fc2ad4eb1e
|
feat: mocker can use planner profile data (#4422)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
|
2025-11-18 08:06:50 +00:00 |
|
Biswa Panda
|
06b0ebef88
|
feat: transport agnostic request plane for dynamo - natless (#4246)
|
2025-11-13 17:54:54 +00:00 |
|
Yan Ru Pei
|
38242c8d7b
|
chore: use notify instead of inotify (#4250)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2025-11-12 16:53:39 +00:00 |
|
Graham King
|
fbad28602e
|
chore: Remove the python bindings for port allocation (#4237)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-11 20:35:36 +00:00 |
|
mohammedabdulwahhab
|
7afb5431ff
|
fix: add kube impl for discovery and add metadata endpoint (#4136)
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: tmontfort <tmontfort@nvidia.com>
|
2025-11-10 22:42:04 +00:00 |
|
Anant Sharma
|
23660bc5c3
|
chore: update versions for 0.7.0 release (#4217)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2025-11-10 21:40:06 +00:00 |
|
Graham King
|
794c0a4431
|
feat(keyvalue): Filesystem backed KeyValueStore (#4138)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-07 21:11:33 +00:00 |
|
KrishnanPrash
|
3d036fc4a4
|
feat: Reject unsupported parameters with 400 Bad Request (`/v1/completions`) (#4140)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
|
2025-11-05 17:32:50 -08:00 |
|
KrishnanPrash
|
b73c571f0f
|
feat: Add base64 and HTTP image URL support to vLLM workers (#4114)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
|
2025-11-05 16:47:06 -08:00 |
|
Richard Huo
|
6afa679c5d
|
chore: KVBM pip wheel (#3826)
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
|
2025-10-31 14:19:30 -07:00 |
|
Tushar Sharma
|
1da9d70ab1
|
chore: bump nixl verison to 0.7.0 (#3936)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
|
2025-10-30 10:28:17 -07:00 |
|
jthomson04
|
3998fdcb28
|
feat: KVBM V2 Initial Migration (#3861)
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
|
2025-10-28 16:08:14 -07:00 |
|
Tushar Sharma
|
9bb1af3376
|
chore: Update version to 0.6.1 (#3916)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
|
2025-10-27 17:17:26 -04:00 |
|
Richard Huo
|
94aa2a7bbb
|
refactor: kvbm modularity DIS-657 Eliminate ETCD from the leader-worker initialization (#3202)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
|
2025-10-23 00:10:09 -07:00 |
|
Graham King
|
9ae98ed7f9
|
refactor(runtime): Replace std::sync::Mutex with parking_lot::Mutex (#3740)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-10-21 12:38:51 +00:00 |
|
Harrison Saturley-Hall
|
cd2389baef
|
chore: pre-0.6.0 activities (#3592)
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
|
2025-10-13 17:45:19 -04:00 |
|
mohammedabdulwahhab
|
1f92dd547e
|
feat: OTEL Exporter and Tempo Visualization (#3307)
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
|
2025-10-13 18:39:09 +00:00 |
|
Richard Huo
|
5c69c11930
|
chore: upgrade nixl to 0.6.0 (#3550)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
|
2025-10-10 13:18:21 -07:00 |
|
Ryan McCormick
|
ef04a0869e
|
feat: Add OpenAPI routes to serve HTTP server API documentation (#3480)
|
2025-10-08 13:52:19 -07:00 |
|
Graham King
|
1b1265e6fc
|
chore: Remove GGUF support (#3488)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-10-08 11:42:24 -04:00 |
|
Elyas Mehtabuddin
|
67e1f6ee11
|
feat: enable parallel tool calling and add testing (#3188)
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
|
2025-09-29 15:30:42 +00:00 |
|
Graham King
|
c03e2f6bbe
|
chore: Migrate planner virtual_connector internals into bindings (#3205)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-09-25 18:04:58 -04:00 |
|
Harrison Saturley-Hall
|
980727bba1
|
chore: bump versions ahead of 0.5.1 release (#3209)
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
|
2025-09-24 18:26:38 -04:00 |
|
Ryan Olson
|
c63cceaa77
|
feat: JailedStream (#3034)
Signed-off-by: ayushag <ayushag@nvidia.com>
|
2025-09-23 22:24:17 +00:00 |
|
Graham King
|
3865a94148
|
feat: Port vllm port allocator to Rust in bindings (#3125)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-09-19 18:34:52 +00:00 |
|
Elyas Mehtabuddin
|
31f5ed3ce7
|
feat: add finish reason = tool_calls for stream=False and phi-4 detect token start fix (#3087)
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
|
2025-09-18 21:45:52 +00:00 |
|
Graham King
|
f88d7dc74b
|
chore(bindings): Remove NatsQueue (#3086)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-09-17 12:46:54 -04:00 |
|
Tzu-Ling Kan
|
08cb08c1bc
|
feat: Canary Health Check. (#2903)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
|
2025-09-17 03:31:56 +00:00 |
|
Graham King
|
87e6e0529d
|
fix: Interactive inputs actually stops, does not ignore stop token (#3057)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-09-16 14:39:05 -04:00 |
|
ryan-lempka
|
435803ea16
|
chore: add additional param support for multimodal models (#3042)
Signed-off-by: Ryan Lempka <rlempka@nvidia.com>
|
2025-09-16 16:26:39 +00:00 |
|
Graham King
|
6f14e94159
|
feat: Add a checksum to ModelDeploymentCard fields (#2934)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-09-09 16:12:42 +00:00 |
|
Olga Andreeva
|
27fad26faf
|
refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
|
2025-09-03 22:22:37 +00:00 |
|
KrishnanPrash
|
c920cbd9dc
|
feat: Add --custom-jinja-template argument to pass a custom chat template for vLLM (#2829)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
|
2025-09-03 14:22:15 -07:00 |
|
Harrison Saturley-Hall
|
561ecb98a2
|
chore: bump version numbers ahead of 0.5.0 release (#2812)
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
|
2025-09-02 16:13:28 -04:00 |
|
KavinKrishnan
|
95ce83d59a
|
feat: Integrate Model Express Client into Dynamo Model Downloads (#2574)
Signed-off-by: Kavin Krishnan <kavink@nvidia.com>
Co-authored-by: KavinKrishnan <kavin.krishnan@nvidia.com>
|
2025-08-28 16:09:04 -07:00 |
|
GuanLuo
|
91a459c038
|
feat: KServe gRPC support (#2638)
|
2025-08-26 22:57:31 -07:00 |
|
Yan Ru Pei
|
f08729ae15
|
feat: python bindings for the entire KvPushRouter + per-request router configs (#2658)
|
2025-08-25 22:27:10 +00:00 |
|
nachiketb-nvidia
|
3036e60b1e
|
feat: add gpt oss reasoning parser through harmony (#2656)
- couple of refactors
- added a new dependency, openai-harmony
- implemented the gpt oss parser
|
2025-08-25 17:13:38 +00:00 |
|
Ziqi Fan
|
b658ba6139
|
feat: enable dynamo metrics on KVBM (#2626)
|
2025-08-22 19:58:05 +00:00 |
|
Graham King
|
49958435eb
|
chore: Remove async-openai-macros (#2554)
|
2025-08-20 11:33:10 -07:00 |