mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,557 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

167 Commits

Author SHA1 Message Date
Nikita 21fce9ba0d
feat: Tiktoken support (#6460) 
Signed-off-by: Nikita Sukharev <kaonael@gmail.com>
 2026-02-25 12:46:47 -08:00
Yan Ru Pei 0cb1d73383
fix: fold scheduling into queue so backpressure actually works (#6470) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-23 18:33:03 -08:00
Ryan Olson 61c6780469
feat: add kvbm-kernels crate and upgrade cudarc to 0.19 (#6309) 
Signed-off-by: Ryan Olson <rolson@nvidia.com>
 2026-02-23 16:15:28 +00:00
Ryan Olson 7a6283e927
chore: cargo machete - remove unused dependencies (#6453) 
Signed-off-by: Ryan Olson <rolson@nvidia.com>
 2026-02-20 19:11:52 +00:00
Yan Ru Pei cf51a0c4fd
chore: gate plotters dependency behind bench feature (#6380) 
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-18 15:27:19 -05:00
Yan Ru Pei c5c6a55190
feat: more flash indexer optimizations (#6305) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-18 09:13:37 -08:00
Ryan Olson 976bb70a3b
feat: add KVBM memory management enhancements (DIS-1311) (#5532) 2026-02-18 01:54:00 +00:00
Yan Ru Pei 4ede59a269
feat: speculative prefill (#6230) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>
 2026-02-15 09:27:34 +00:00
Ryan Olson 94fad4799f
feat: kvbm-logical (#6033) 
Signed-off-by: Ryan Olson <rolson@nvidia.com>
 2026-02-14 02:24:26 +00:00
Yongming Ding 2d517e7780
feat(mocker): improve mocker's perf timing accuracy (#6100) 
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
 2026-02-12 17:33:43 -08:00
Graham King bbe82f182a
chore: Remove dynamo-run and mistral-rs engine (#6203) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2026-02-12 21:50:58 +00:00
Yan Ru Pei 937398cf61
feat: Flash Indexer (#5785) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: Janelle Cai <jcai18@mit.edu>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>
 2026-02-11 22:26:56 -08:00
Yongming Ding 7c25f70291
feat(mocker): add optional KV cache allocation/eviction trace (#6052) 
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
 2026-02-07 03:02:28 +00:00
Anant Sharma 3842b24479
fix: update bytes crate version to latest (#6041) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2026-02-06 15:11:04 -05:00
Yan Ru Pei 9e33e3fa66
chore: clean ups in kv_router.rs (#6028) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-06 19:27:44 +00:00
Yan Ru Pei 91fb78cddf
chore: make mocker it's own crate (#5958) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-05 19:35:42 +00:00
milesial 9bff03f237
feat: vLLM backend with frontend media decoding (#5781) 
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
 2026-02-03 09:19:26 -08:00
Graham King 2ffd58475b
chore: Remove native-tls / openssl dependency (#5703) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2026-01-28 17:36:11 +00:00
Yan Ru Pei 649d9b7d30
chore: make core kv-router its own crate (#5677) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-01-28 10:42:53 +00:00
Dmitry Tokarev 2d6babe5fc
chore: Bump rust lib oneshot to 0.1.13 (#5694) 
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
 2026-01-27 17:26:11 -05:00
Biswa Panda 8fc70f20f3
feat: add ZMQ transport and its discovery (#5625) 2026-01-27 02:31:04 +00:00
Pavithra Vijayakrishnan 66c369964a
chore: version update for 0.9.0 (#5661) 
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
 2026-01-26 17:18:05 -08:00
Nate Mailhot 6dba119d7a
chore: update nixl to 0.9.0 (#5528) 2026-01-22 15:25:03 -08:00
Ryan Olson 34e582240c
feat: add PositionalLineageHash for hierarchical block tracking (DIS-1307) (#5522) 
Signed-off-by: Ryan Olson <rolson@nvidia.com>
 2026-01-21 09:16:52 -08:00
Neelay Shah 07724eb9f6
chore: remove unused lib/discovery crate (#5266) 
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-07 23:30:19 -08:00
smatta-star f63e273c43
feat: add auto-generated frontend OpenAPI spec and helper binary (#4802) 
Signed-off-by: Satvik Matta <smatta@nvidia.com>
 2025-12-22 21:45:03 +00:00
Nate Mailhot 910b587db1
chore: update nixl to 0.8.0 and ucx 1.20 (#5007) 
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
 2025-12-19 10:55:40 -08:00
Anant Sharma 7436e3bc03
chore: update versions for 0.8.0 release (#5031) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-12-19 10:21:52 -08:00
jh-nv b401a1d66f
feat: propagate trace context to vLLM engine (#4918) 
Signed-off-by: Jie Hao <jihao@nvidia.com>
 2025-12-18 16:50:29 -05:00
Anant Sharma 5b82b8b096
chore: update versions to match latest release (#4966) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-12-18 08:45:44 -08:00
milesial 74fcd4a9b9
feat: video decoder in the frontend (#4719) 
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
 2025-12-16 14:28:06 -08:00
KrishnanPrash 24ac6c1588
chore: bump minijinja to 2.14.0 (#4949) 
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
 2025-12-15 09:58:52 -08:00
Karen Chung 332499458b
feat: worker-local KvIndexer in KvEventPublisher (#4519) 
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
 2025-12-11 23:18:34 +00:00
jthomson04 01819b8718
feat: KVBM V2 optimized bounce buffer transfer + benchmark (#3947) 
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
 2025-12-09 22:14:41 -08:00
Keiven C 3cad926e58
fix: integration test failures. Support DYN_SYSTEM_PORT=0 for random port binding, and update etcd test (#4687) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-12-02 16:49:41 -08:00
Biswa Panda 6a0e67ed78
feat: add LoRA common APIs and implementation for lora management (#4464) 2025-11-26 20:29:25 +00:00
milesial 0a06591826
feat: decoded media via NIXL (#3988) 
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
Signed-off-by: Ayush Agarwal <ayushag@nvidia.com>
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Krishnan Prashanth <kprashanth@nvidia.com>
Co-authored-by: KrishnanPrash <140860868+KrishnanPrash@users.noreply.github.com>
 2025-11-25 19:15:04 +00:00
Graham King 27904535fb
fix(storage): Correctly encoding FileStore keys (#4539) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-11-21 17:01:40 -05:00
William Zhang 65f18884f8
feat: Xml coder tool parser (#4415) 
This commit adds a parser implementation for Xml style
tool calls, based currently on Qwen3 coder.

Followup work needs to be done to make it more generic
and parameterizable.
 2025-11-21 08:27:33 +00:00
Graham King 2100f6aac5
feat(mistralrs): Upgrade to support CUDA 13 (#4474) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-11-19 14:12:17 -08:00
Dmitry Tokarev c2cc9782b8
fix: Revert "feat: kvbm kernels (#4356)" (#4467) 2025-11-19 13:52:22 -05:00
Kyle McGill 0b8b7ffb73
chore: Upgrade NIXL to 0.7.1 and allow KVBM to pick NIXL cuda 12 or 13 (#4281) 
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
 2025-11-19 08:18:31 -08:00
Yan Ru Pei fc2ad4eb1e
feat: mocker can use planner profile data (#4422) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
 2025-11-18 08:06:50 +00:00
Ryan Olson 4d3269cd63
feat: discovery traits, systems and managers (#4070) 
Signed-off-by: Ryan Olson <rolson@nvidia.com>
 2025-11-17 21:59:04 -07:00
Ryan Olson 09bb1c68cc
feat: kvbm kernels (#4356) 
Signed-off-by: Ryan Olson <rolson@nvidia.com>
 2025-11-17 23:01:11 +00:00
Graham King 886506c12d
feat: Command line flag to set request plane mode: tcp, http or nats (#4365) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-11-17 09:02:36 -08:00
Biswa Panda 06b0ebef88
feat: transport agnostic request plane for dynamo - natless (#4246) 2025-11-13 17:54:54 +00:00
Yan Ru Pei 38242c8d7b
chore: use notify instead of inotify (#4250) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2025-11-12 16:53:39 +00:00
mohammedabdulwahhab 7afb5431ff
fix: add kube impl for discovery and add metadata endpoint (#4136) 
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
Co-authored-by: tmontfort <tmontfort@nvidia.com>
 2025-11-10 22:42:04 +00:00
Anant Sharma 23660bc5c3
chore: update versions for 0.7.0 release (#4217) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-11-10 21:40:06 +00:00