Nikita
|
21fce9ba0d
|
feat: Tiktoken support (#6460)
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
|
2026-02-25 12:46:47 -08:00 |
|
Ryan Olson
|
61c6780469
|
feat: add kvbm-kernels crate and upgrade cudarc to 0.19 (#6309)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
|
2026-02-23 16:15:28 +00:00 |
|
Ryan Olson
|
7a6283e927
|
chore: cargo machete - remove unused dependencies (#6453)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
|
2026-02-20 19:11:52 +00:00 |
|
Yan Ru Pei
|
cf51a0c4fd
|
chore: gate plotters dependency behind bench feature (#6380)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-18 15:27:19 -05:00 |
|
Yan Ru Pei
|
c5c6a55190
|
feat: more flash indexer optimizations (#6305)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-18 09:13:37 -08:00 |
|
atchernych
|
5227176057
|
feat: Decomposed pipeline for EPP integration [DEP-730] (#5446)
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
|
2026-02-13 06:18:29 +00:00 |
|
Yongming Ding
|
2d517e7780
|
feat(mocker): improve mocker's perf timing accuracy (#6100)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
|
2026-02-12 17:33:43 -08:00 |
|
Yan Ru Pei
|
937398cf61
|
feat: Flash Indexer (#5785)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: Janelle Cai <jcai18@mit.edu>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>
|
2026-02-11 22:26:56 -08:00 |
|
Yan Ru Pei
|
6a728d1044
|
chore: remove kv indexers bindings (#6159)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-11 20:23:48 +00:00 |
|
Yan Ru Pei
|
6783bdcaa9
|
chore: enable local indexers by default, and use normal event plane by default (not jetstream) (#5941)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-08 20:48:02 +00:00 |
|
Yongming Ding
|
7c25f70291
|
feat(mocker): add optional KV cache allocation/eviction trace (#6052)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
|
2026-02-07 03:02:28 +00:00 |
|
Anant Sharma
|
3842b24479
|
fix: update bytes crate version to latest (#6041)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2026-02-06 15:11:04 -05:00 |
|
Yan Ru Pei
|
91fb78cddf
|
chore: make mocker it's own crate (#5958)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-05 19:35:42 +00:00 |
|
milesial
|
9bff03f237
|
feat: vLLM backend with frontend media decoding (#5781)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
|
2026-02-03 09:19:26 -08:00 |
|
Yan Ru Pei
|
fc92fc187b
|
chore: clean ups in kv-router (#5771)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-01-29 03:20:04 +00:00 |
|
Dmitry Tokarev
|
2d6babe5fc
|
chore: Bump rust lib oneshot to 0.1.13 (#5694)
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
|
2026-01-27 17:26:11 -05:00 |
|
Pavithra Vijayakrishnan
|
66c369964a
|
chore: version update for 0.9.0 (#5661)
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
|
2026-01-26 17:18:05 -08:00 |
|
Keiven C
|
7361de4208
|
refactor: reduce Python API to only Prometheus Exposition Format callback (#5594)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
|
2026-01-23 10:06:06 -08:00 |
|
Nate Mailhot
|
6dba119d7a
|
chore: update nixl to 0.9.0 (#5528)
|
2026-01-22 15:25:03 -08:00 |
|
Yan Ru Pei
|
0b33c1dfa0
|
fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2025-12-31 10:55:44 -08:00 |
|
Nate Mailhot
|
910b587db1
|
chore: update nixl to 0.8.0 and ucx 1.20 (#5007)
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
|
2025-12-19 10:55:40 -08:00 |
|
Anant Sharma
|
7436e3bc03
|
chore: update versions for 0.8.0 release (#5031)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2025-12-19 10:21:52 -08:00 |
|
Anant Sharma
|
5b82b8b096
|
chore: update versions to match latest release (#4966)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2025-12-18 08:45:44 -08:00 |
|
milesial
|
74fcd4a9b9
|
feat: video decoder in the frontend (#4719)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
|
2025-12-16 14:28:06 -08:00 |
|
KrishnanPrash
|
24ac6c1588
|
chore: bump minijinja to 2.14.0 (#4949)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
|
2025-12-15 09:58:52 -08:00 |
|
Biswa Panda
|
6a0e67ed78
|
feat: add LoRA common APIs and implementation for lora management (#4464)
|
2025-11-26 20:29:25 +00:00 |
|
milesial
|
0a06591826
|
feat: decoded media via NIXL (#3988)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
|
2025-11-25 19:15:04 +00:00 |
|
Graham King
|
27904535fb
|
fix(storage): Correctly encoding FileStore keys (#4539)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-21 17:01:40 -05:00 |
|
Graham King
|
2f1778c13d
|
fix(storage): File store shouldn't notify on metdata changes (#4434)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-18 10:24:04 -08:00 |
|
Yan Ru Pei
|
fc2ad4eb1e
|
feat: mocker can use planner profile data (#4422)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
|
2025-11-18 08:06:50 +00:00 |
|
Biswa Panda
|
06b0ebef88
|
feat: transport agnostic request plane for dynamo - natless (#4246)
|
2025-11-13 17:54:54 +00:00 |
|
Yan Ru Pei
|
38242c8d7b
|
chore: use notify instead of inotify (#4250)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2025-11-12 16:53:39 +00:00 |
|
Graham King
|
fbad28602e
|
chore: Remove the python bindings for port allocation (#4237)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-11 20:35:36 +00:00 |
|
mohammedabdulwahhab
|
7afb5431ff
|
fix: add kube impl for discovery and add metadata endpoint (#4136)
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: tmontfort <tmontfort@nvidia.com>
|
2025-11-10 22:42:04 +00:00 |
|
Anant Sharma
|
23660bc5c3
|
chore: update versions for 0.7.0 release (#4217)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2025-11-10 21:40:06 +00:00 |
|
Graham King
|
794c0a4431
|
feat(keyvalue): Filesystem backed KeyValueStore (#4138)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-07 21:11:33 +00:00 |
|
KrishnanPrash
|
3d036fc4a4
|
feat: Reject unsupported parameters with 400 Bad Request (`/v1/completions`) (#4140)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
|
2025-11-05 17:32:50 -08:00 |
|
KrishnanPrash
|
b73c571f0f
|
feat: Add base64 and HTTP image URL support to vLLM workers (#4114)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
|
2025-11-05 16:47:06 -08:00 |
|
Richard Huo
|
6afa679c5d
|
chore: KVBM pip wheel (#3826)
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
|
2025-10-31 14:19:30 -07:00 |
|
Tushar Sharma
|
1da9d70ab1
|
chore: bump nixl verison to 0.7.0 (#3936)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
|
2025-10-30 10:28:17 -07:00 |
|
jthomson04
|
3998fdcb28
|
feat: KVBM V2 Initial Migration (#3861)
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
|
2025-10-28 16:08:14 -07:00 |
|
Tushar Sharma
|
9bb1af3376
|
chore: Update version to 0.6.1 (#3916)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
|
2025-10-27 17:17:26 -04:00 |
|
Richard Huo
|
94aa2a7bbb
|
refactor: kvbm modularity DIS-657 Eliminate ETCD from the leader-worker initialization (#3202)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
|
2025-10-23 00:10:09 -07:00 |
|
Graham King
|
9ae98ed7f9
|
refactor(runtime): Replace std::sync::Mutex with parking_lot::Mutex (#3740)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-10-21 12:38:51 +00:00 |
|
Harrison Saturley-Hall
|
cd2389baef
|
chore: pre-0.6.0 activities (#3592)
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
|
2025-10-13 17:45:19 -04:00 |
|
mohammedabdulwahhab
|
1f92dd547e
|
feat: OTEL Exporter and Tempo Visualization (#3307)
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
|
2025-10-13 18:39:09 +00:00 |
|
Richard Huo
|
5c69c11930
|
chore: upgrade nixl to 0.6.0 (#3550)
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
|
2025-10-10 13:18:21 -07:00 |
|
Ryan McCormick
|
ef04a0869e
|
feat: Add OpenAPI routes to serve HTTP server API documentation (#3480)
|
2025-10-08 13:52:19 -07:00 |
|
Graham King
|
1b1265e6fc
|
chore: Remove GGUF support (#3488)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-10-08 11:42:24 -04:00 |
|
Elyas Mehtabuddin
|
67e1f6ee11
|
feat: enable parallel tool calling and add testing (#3188)
Signed-off-by: Elyas Mehtabuddin <emehtabuddin@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
|
2025-09-29 15:30:42 +00:00 |