mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,557 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

31 Commits

Author SHA1 Message Date
jh-nv 42cde26489
fix: migrate example and document to the latest endpoint API (#6542) 2026-02-25 12:00:04 -08:00
Keiven C ff06b17e7f
fix: guarantee RouterRequestMetrics availability & documentation updates (#6558) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-25 10:18:01 -08:00
dagil-nvidia e0373bd725
docs: alphabetize backends (SGLang, TensorRT-LLM, vLLM) (#6537) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-25 10:07:59 -06:00
Kyle McGill 5c64ffc3c8
docs: updated KVBM docs to specify correct configurations for the write-through property (#6506) 
Signed-off-by: Kyle McGill <kmcgill@nvidia.com>
 2026-02-24 14:10:09 -08:00
Keiven C 1df620b4d0
feat: router metrics with dynamo_router_* {worker_id=...}. Update docs (#6227) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-24 21:34:14 +00:00
Yan Ru Pei bc00ef3879
chore: split JetStream subscriber into dedicated module and deprecate durable_kv_events [DYN-2203] (#6477) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-24 11:30:38 -08:00
Alec 6d3b92f04e
feat: remove --connector flag for vLLM backend (LLM-90) (#6450) 
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-24 17:49:00 +00:00
Yan Ru Pei 0f48837d58
docs: add standalone KV indexer documentation (#6511) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-23 18:07:48 -08:00
Richard Huo 15d217606a
chore: revert the kvbm workaround since trtllm v1.3.0rc3 is upgraded (#6495) 2026-02-23 15:05:04 -08:00
Alec 7bbacce196
feat: default kv-events-config to empty (align with vLLM defaults) (#6404) 
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-20 06:44:51 +00:00
Ziqi Fan 832bf80a15
feat: add NVTX annotation to KVBM (#6334) 
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
 2026-02-19 17:23:33 +00:00
hhzhang16 6a3f2002bd
feat: Optional GPU Discovery for Namespace-Scoped Operators (#6343) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2026-02-18 18:13:06 -08:00
jh-nv 44a76f96b3
refactor: update frontend kv-router flags to be consistent with router (#6361) 2026-02-19 00:27:15 +00:00
jh-nv 858f33fc3d
feat: migrate router configuration (#6346) 2026-02-18 00:50:00 -05:00
Yan Ru Pei ee0218b566
feat: plumb request priority through sglang and vllm handlers (#6348) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-18 04:48:52 +00:00
Yan Ru Pei 56d91ee962
docs: update KV event docs to use event plane terminology (#6326) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-17 09:54:07 -08:00
Graham King 87c5c7bfc0
docs: Document that front-end needs access to model config files (#6327) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2026-02-17 12:53:56 -05:00
Yan Ru Pei 4ede59a269
feat: speculative prefill (#6230) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>
 2026-02-15 09:27:34 +00:00
Hongkuan Zhou 359765d354
feat: load-based scaling in SLA Planner (#6145) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
 2026-02-14 09:43:02 -08:00
hhzhang16 d56439ec28
feat: migrate GPU discovery from Dynamo Profiler to Dynamo Operator with automatic injection (#6224) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2026-02-14 00:34:21 +00:00
Tzu-Ling Kan 5624d14481
Rename fetch_llm to fetch_model (#6268) 
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
 2026-02-13 23:22:35 +00:00
Ziqi Fan 014266954b
docs: update kvbm guide according to docker build change (#6264) 
Signed-off-by: Ziqi Fan <ziqif@nvidia.com>
 2026-02-13 21:21:22 +00:00
mohammedabdulwahhab a289695c37
fix: consolidate dyn_discovery_backend and dyn_kv_store (#6167) 
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
 2026-02-13 19:07:11 +00:00
Yan Ru Pei 14eceb43df
chore: rename KvPushRouter to KvRouter in python + more bindings removal (#6238) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-12 23:44:52 -08:00
Yan Ru Pei 16a280584c
chore: remove stale indexer benchmarking results (#6233) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-13 05:32:39 +00:00
Yan Ru Pei bc514fbee6
feat: router priority queue (#6010) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
 2026-02-13 02:43:17 +00:00
dagil-nvidia dd6c399565
docs: add frontmatter title to all docs pages (#6254) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-12 22:48:44 +00:00
dagil-nvidia 5ff88b330b
docs: fix image paths to render on both GitHub and Fern (#6228) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-12 09:48:41 -08:00
Hongkuan Zhou a04b56310c
feat: support AIC DGD gen call (WILL BREAK DGDR) (#6216) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
 2026-02-12 08:47:55 -08:00
Yan Ru Pei 937398cf61
feat: Flash Indexer (#5785) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Signed-off-by: jthomson04 <jothomson@nvidia.com>
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Signed-off-by: Janelle Cai <jcai18@mit.edu>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: Janelle Cai <jcai18@mit.edu>
 2026-02-11 22:26:56 -08:00
Jonathan Tong 39d645e586
docs: migrate Fern docs from fern/ into docs/ (#6206) 
Signed-off-by: Jont828 <jt572@cornell.edu>
 2026-02-11 16:22:27 -08:00