Yongming Ding
|
5d9586234e
|
feat(mocker): add KV cache transfer latency for disagg serving (#6504)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
|
2026-02-24 23:53:28 -08:00 |
|
Yan Ru Pei
|
65dc451db9
|
feat: add ZMQ KV event publishing to mocker [DYN-2221] (#6528)
Signed-off-by: Ru Pei <rupei@nvidia.com>
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-24 18:57:28 -08:00 |
|
Yongming Ding
|
9b2e8f3dd5
|
refactor(mocker): modularize into common/scheduler/kv_manager/cache (#6440)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
|
2026-02-20 10:47:59 -08:00 |
|
Yan Ru Pei
|
4ede59a269
|
feat: speculative prefill (#6230)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>
|
2026-02-15 09:27:34 +00:00 |
|
Yan Ru Pei
|
e30696e5aa
|
chore: allow frontend + mockers to run on macos (#6282)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-13 19:33:45 +00:00 |
|
Yan Ru Pei
|
5a3c52ab70
|
chore: more mocker rusty cleanups (#6271)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-13 08:20:53 -08:00 |
|
Yongming Ding
|
2d517e7780
|
feat(mocker): improve mocker's perf timing accuracy (#6100)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
|
2026-02-12 17:33:43 -08:00 |
|
Yongming Ding
|
373b8ffb68
|
feat(mocker): enable KV cache trace for decode workers (#6207)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
|
2026-02-12 09:55:35 -08:00 |
|
Yongming Ding
|
7c25f70291
|
feat(mocker): add optional KV cache allocation/eviction trace (#6052)
Signed-off-by: Yongming Ding <yongmingd@nvidia.com>
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
|
2026-02-07 03:02:28 +00:00 |
|
Yan Ru Pei
|
9e33e3fa66
|
chore: clean ups in kv_router.rs (#6028)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-06 19:27:44 +00:00 |
|
Yan Ru Pei
|
91fb78cddf
|
chore: make mocker it's own crate (#5958)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-05 19:35:42 +00:00 |