mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,944 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

43 Commits

Author SHA1 Message Date
dagil-nvidia 46dad85b03
docs: update KVBM diagram and bump container image tags to 1.0.0 (#7365) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-03-13 18:08:10 -05:00
Keiven C 33604afa19
test: generalize router test infrastructure and expand documentations (#7327) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-03-13 13:58:32 -07:00
Yan Ru Pei 5aa2f53fc2
feat(kv-router): add Prometheus metrics to standalone indexer (#7339) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-03-13 10:07:48 -07:00
Yan Ru Pei bddaaa2658
feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-03-13 04:16:49 +00:00
Anish 197f659589
docs: improve Planner documentation clarity and fix incorrect defaults (#7303) 
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-12 13:55:45 -07:00
dagil-nvidia 330f001d08
docs: update KVBM diagram from PNG to SVG (#7277) 
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
 2026-03-12 15:26:05 -05:00
dagil-nvidia bb43fadaed
chore: remove outdated router_standalone_trtllm example and add standalone router docs (#7278) 
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: akshatha-k <akshutk@gmail.com>
 2026-03-12 13:04:48 -05:00
Yan Ru Pei bb07b2f455
feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-03-12 10:46:01 -07:00
hhzhang16 5c7e66ece1
docs: add docs for DGDR usage -- golden path (#6946) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2026-03-12 17:18:09 +00:00
daiyaanarfeen 5d5fd243da
feat: GlobalPlanner --max-total-gpus for cluster-wide GPU budget (#7103) 
Signed-off-by: Daiyaan <darfeen@nvidia.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
 2026-03-11 21:54:55 +00:00
dagil-nvidia 96f3bdccef
docs: 1.0 documentation improvements (#7168) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-10 17:08:31 -05:00
Yan Ru Pei 48eb52e777
feat(kv-router): P2P recovery for standalone KV indexer [DYN-2367] (#6934) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-09 23:52:48 +00:00
Yan Ru Pei 49fa25e2ce
docs(kv-router): add kv event replay comparison with vLLM (#6928) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-03-05 09:17:34 -08:00
Yan Ru Pei 5139f688cb
docs(router): add tuning guideline for output block tracking (#6911) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-03-04 16:18:05 -08:00
Yan Ru Pei b94cb54318
chore(kv-router): split monolithic indexer.rs into indexer/ directory (#6870) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-04 20:42:50 +00:00
Hongkuan Zhou 7c1a62385a
fix: refactor profiler's dgd generation workflow to correctly generate mocker config (#6848) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
 2026-03-04 08:44:27 -08:00
Yan Ru Pei 35f99f93c9
feat(kv-indexer): multi-model and multi-tenant isolation (#6830) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-04 09:07:02 +00:00
Yan Ru Pei 9f3b7b330d
chore(kv-router): deduplicate KvRouterConfig args into shared ArgGroup (#6805) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-03 19:53:03 +00:00
Yan Ru Pei 07742cc27f
feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-02 10:34:21 -08:00
Neal Vaidya ece08dc926
docs: restructure docs directory and move fern config to fern/ (#6700) 
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-01 19:58:22 -08:00
Ashna Mehrotra d8b7d394ac
docs: V1beta1 dgdr docs (#6647) 
Signed-off-by: ashnamehrotra <ashnamehrotra@gmail.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2026-02-27 22:33:11 +00:00
Hongkuan Zhou 9df78cb6b8
fix: broken link in profiler guide (#6709) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
 2026-02-27 14:25:42 -08:00
Fern Support 967e29619b
docs: Update Footer Legal Links (#6589) 
Signed-off-by: willkendall01 <will.kendall@buildwithfern.com>
Co-authored-by: willkendall01 <will.kendall@buildwithfern.com>
 2026-02-25 13:26:47 -08:00
dagil-nvidia e0373bd725
docs: alphabetize backends (SGLang, TensorRT-LLM, vLLM) (#6537) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-25 10:07:59 -06:00
hhzhang16 d56439ec28
feat: migrate GPU discovery from Dynamo Profiler to Dynamo Operator with automatic injection (#6224) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2026-02-14 00:34:21 +00:00
Jonathan Tong 39d645e586
docs: migrate Fern docs from fern/ into docs/ (#6206) 
Signed-off-by: Jont828 <jt572@cornell.edu>
 2026-02-11 16:22:27 -08:00
Yan Ru Pei 6783bdcaa9
chore: enable local indexers by default, and use normal event plane by default (not jetstream) (#5941) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-08 20:48:02 +00:00
Richard Huo 7d035afffb
docs: add notes and instruction for latest trtllm kvbm disagg (#6055) 2026-02-06 17:03:07 -08:00
akshatha-k fce8bbc250
docs: add quick start sections to KVBM and Router guides (#6043) 
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Dan Gil <dagil@nvidia.com>
 2026-02-06 15:17:21 -06:00
dagil-nvidia 07db589583
docs: clean up toctree navigation and add disaggregated serving guide (#6024) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-06 13:20:36 -06:00
dagil-nvidia b19de4ed77
docs: cleanup of docs refactor for components, integrations, and features (#6019) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-05 19:50:17 -08:00
dagil-nvidia 400126d2bc
docs: migrate Frontend docs to three-tier structure (#6002) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-06 01:00:52 +00:00
dagil-nvidia 3023c6258a
docs: migrate Profiler docs to three-tier structure (#6003) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Jonathan Tong <jt572@cornell.edu>
 2026-02-05 18:05:49 -06:00
Anish 598cbbb73b
docs: reorganizing documentation to make things clearer (#3658) 
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
 2025-10-16 23:59:59 +00:00
Anant Sharma 0a2a820bca
docs: move all md files from components to docs (#3440) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
 2025-10-10 03:39:26 +00:00
Yan Ru Pei 1995ef9aee
docs: change docs to default port 8000 (#2876) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2025-09-05 01:16:53 +00:00
Yan Ru Pei 7fabe7bfe2
fix: do not delete KV events jetstream (#2800) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2025-09-01 21:25:49 +00:00
Ryan McCormick 766d3f2cf8
docs: Simplify sphinx build and table of contents on webpage (#2519) 2025-08-25 23:36:31 +00:00
Yan Ru Pei f08729ae15
feat: python bindings for the entire KvPushRouter + per-request router configs (#2658) 2025-08-25 22:27:10 +00:00
Anish 129a2444e0
docs: Consolidate documentation and fix redundant headings (#2518) 2025-08-19 18:25:24 +00:00
Yan Ru Pei f7e468c7e8
docs: fix lowest cost mistake in doc (#2361) 
Signed-off-by: Yan Ru Pei <yanrpei@gmail.com>
 2025-08-07 23:53:14 +00:00
Yan Ru Pei 096d117d62
docs: update router docs (#2148) 2025-07-28 20:49:14 +00:00
atchernych 24cb926ef5
docs: Clean index.rst (#2104) 2025-07-25 18:17:50 +00:00