Ryan Olson
|
63d7c01c9c
|
feat: velo-backend (#6547)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
|
2026-03-09 23:26:25 +00:00 |
|
Yan Ru Pei
|
2e29620df1
|
chore(kv-router): move benches to lib/bench to break circular dep [OPS-3752] (#7013)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-03-06 23:24:03 +00:00 |
|
Graham King
|
abc02c689f
|
fix: llm/mocker: Remove the llm -> mocker crate dependency, move config (#6998)
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-03-06 09:41:39 -08:00 |
|
Anant Sharma
|
9254e3d4d2
|
chore: update nixl version to 0.10.1 (#6826)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2026-03-03 16:47:55 -05:00 |
|
Ryan Olson
|
57bdbdf1ee
|
feat: upgrade rust to v1.93.0 (#6802)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
|
2026-03-03 17:08:35 +00:00 |
|
Ryan Olson
|
7604295938
|
feat(kvbm): add testing utilities to kvbm-logical and kvbm-physical (#6691)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
|
2026-03-02 21:18:32 -07:00 |
|
Yan Ru Pei
|
07742cc27f
|
feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-03-02 10:34:21 -08:00 |
|
Ryan Olson
|
9ab148dcb9
|
feat: kvbm-physical (#6490)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
|
2026-03-01 09:43:03 +00:00 |
|
Yan Ru Pei
|
e5850e2385
|
feat(kv-router): add ActiveSequences benchmark and extract common bench utils (#6633)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-28 02:55:20 +00:00 |
|
Nate Mailhot
|
64082ccd3a
|
chore: upgrade nixl to 0.10.0 (#6685)
|
2026-02-27 13:01:07 -08:00 |
|
Harrison Saturley-Hall
|
db88c9530b
|
chore: bump versions to 1.0.0 (#6613)
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
|
2026-02-25 22:42:33 -05:00 |
|
Yan Ru Pei
|
3f99cf217f
|
chore: move ActiveSequences to kv-router and add unit tests (#6600)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-26 00:53:04 +00:00 |
|
Nikita
|
21fce9ba0d
|
feat: Tiktoken support (#6460)
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
|
2026-02-25 12:46:47 -08:00 |
|
Ryan Olson
|
61c6780469
|
feat: add kvbm-kernels crate and upgrade cudarc to 0.19 (#6309)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
|
2026-02-23 16:15:28 +00:00 |
|
Ryan Olson
|
7a6283e927
|
chore: cargo machete - remove unused dependencies (#6453)
Signed-off-by: Ryan Olson <rolson@nvidia.com>
|
2026-02-20 19:11:52 +00:00 |
|
Yan Ru Pei
|
cf51a0c4fd
|
chore: gate plotters dependency behind bench feature (#6380)
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-18 15:27:19 -05:00 |
|
Yan Ru Pei
|
c5c6a55190
|
feat: more flash indexer optimizations (#6305)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-18 09:13:37 -08:00 |
|
atchernych
|
5227176057
|
feat: Decomposed pipeline for EPP integration [DEP-730] (#5446)
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
|
2026-02-13 06:18:29 +00:00 |
|
Yongming Ding
|
2d517e7780
|
feat(mocker): improve mocker's perf timing accuracy (#6100)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
|
2026-02-12 17:33:43 -08:00 |
|
Yan Ru Pei
|
937398cf61
|
feat: Flash Indexer (#5785)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: Janelle Cai <jcai18@mit.edu>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>
|
2026-02-11 22:26:56 -08:00 |
|
Yan Ru Pei
|
6a728d1044
|
chore: remove kv indexers bindings (#6159)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-11 20:23:48 +00:00 |
|
Yan Ru Pei
|
6783bdcaa9
|
chore: enable local indexers by default, and use normal event plane by default (not jetstream) (#5941)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-08 20:48:02 +00:00 |
|
Yongming Ding
|
7c25f70291
|
feat(mocker): add optional KV cache allocation/eviction trace (#6052)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
|
2026-02-07 03:02:28 +00:00 |
|
Anant Sharma
|
3842b24479
|
fix: update bytes crate version to latest (#6041)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2026-02-06 15:11:04 -05:00 |
|
Yan Ru Pei
|
91fb78cddf
|
chore: make mocker it's own crate (#5958)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-05 19:35:42 +00:00 |
|
milesial
|
9bff03f237
|
feat: vLLM backend with frontend media decoding (#5781)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
|
2026-02-03 09:19:26 -08:00 |
|
Yan Ru Pei
|
fc92fc187b
|
chore: clean ups in kv-router (#5771)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-01-29 03:20:04 +00:00 |
|
Dmitry Tokarev
|
2d6babe5fc
|
chore: Bump rust lib oneshot to 0.1.13 (#5694)
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
|
2026-01-27 17:26:11 -05:00 |
|
Pavithra Vijayakrishnan
|
66c369964a
|
chore: version update for 0.9.0 (#5661)
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
|
2026-01-26 17:18:05 -08:00 |
|
Keiven C
|
7361de4208
|
refactor: reduce Python API to only Prometheus Exposition Format callback (#5594)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
|
2026-01-23 10:06:06 -08:00 |
|
Nate Mailhot
|
6dba119d7a
|
chore: update nixl to 0.9.0 (#5528)
|
2026-01-22 15:25:03 -08:00 |
|
Yan Ru Pei
|
0b33c1dfa0
|
fix: sglang disagg routing fixes and optimizations [DYN-1692] (#5106)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
Co-authored-by: Sean SH Choi <sechoi@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2025-12-31 10:55:44 -08:00 |
|
Nate Mailhot
|
910b587db1
|
chore: update nixl to 0.8.0 and ucx 1.20 (#5007)
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
|
2025-12-19 10:55:40 -08:00 |
|
Anant Sharma
|
7436e3bc03
|
chore: update versions for 0.8.0 release (#5031)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2025-12-19 10:21:52 -08:00 |
|
Anant Sharma
|
5b82b8b096
|
chore: update versions to match latest release (#4966)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2025-12-18 08:45:44 -08:00 |
|
milesial
|
74fcd4a9b9
|
feat: video decoder in the frontend (#4719)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
|
2025-12-16 14:28:06 -08:00 |
|
KrishnanPrash
|
24ac6c1588
|
chore: bump minijinja to 2.14.0 (#4949)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
|
2025-12-15 09:58:52 -08:00 |
|
Biswa Panda
|
6a0e67ed78
|
feat: add LoRA common APIs and implementation for lora management (#4464)
|
2025-11-26 20:29:25 +00:00 |
|
milesial
|
0a06591826
|
feat: decoded media via NIXL (#3988)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
|
2025-11-25 19:15:04 +00:00 |
|
Graham King
|
27904535fb
|
fix(storage): Correctly encoding FileStore keys (#4539)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-21 17:01:40 -05:00 |
|
Graham King
|
2f1778c13d
|
fix(storage): File store shouldn't notify on metdata changes (#4434)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-18 10:24:04 -08:00 |
|
Yan Ru Pei
|
fc2ad4eb1e
|
feat: mocker can use planner profile data (#4422)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
|
2025-11-18 08:06:50 +00:00 |
|
Biswa Panda
|
06b0ebef88
|
feat: transport agnostic request plane for dynamo - natless (#4246)
|
2025-11-13 17:54:54 +00:00 |
|
Yan Ru Pei
|
38242c8d7b
|
chore: use notify instead of inotify (#4250)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2025-11-12 16:53:39 +00:00 |
|
Graham King
|
fbad28602e
|
chore: Remove the python bindings for port allocation (#4237)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-11 20:35:36 +00:00 |
|
mohammedabdulwahhab
|
7afb5431ff
|
fix: add kube impl for discovery and add metadata endpoint (#4136)
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: tmontfort <tmontfort@nvidia.com>
|
2025-11-10 22:42:04 +00:00 |
|
Anant Sharma
|
23660bc5c3
|
chore: update versions for 0.7.0 release (#4217)
Signed-off-by: Anant Sharma <anants@nvidia.com>
|
2025-11-10 21:40:06 +00:00 |
|
Graham King
|
794c0a4431
|
feat(keyvalue): Filesystem backed KeyValueStore (#4138)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-07 21:11:33 +00:00 |
|
KrishnanPrash
|
3d036fc4a4
|
feat: Reject unsupported parameters with 400 Bad Request (`/v1/completions`) (#4140)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
|
2025-11-05 17:32:50 -08:00 |
|
KrishnanPrash
|
b73c571f0f
|
feat: Add base64 and HTTP image URL support to vLLM workers (#4114)
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
|
2025-11-05 16:47:06 -08:00 |