mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,250 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

568 Commits

Author SHA1 Message Date
orangeng 98eb6b7e03
docs: Fix service name in port-forward command (#5527) 
Signed-off-by: Orange Ng <ngquanhao@outlook.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
 2026-02-09 16:04:34 -08:00
Ayush Agarwal 9f76d0606c
feat: text to image vLLM Omni (#5912) 
Signed-off-by: ayushag <ayushag@nvidia.com>
 2026-02-09 18:19:27 -05:00
dagil-nvidia d14d6ff49b
docs: improve Fern sidebar titles, add guide subtitles, and replace ASCII diagrams with D2 (#6069) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Jonathan Tong <jt572@cornell.edu>
 2026-02-09 22:11:33 +00:00
dagil-nvidia bf270c2825
refactor: optimize regex patterns in docs scripts (#5777) 2026-02-09 17:20:03 +00:00
Yan Ru Pei 6783bdcaa9
chore: enable local indexers by default, and use normal event plane by default (not jetstream) (#5941) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-08 20:48:02 +00:00
Richard Huo 7d035afffb
docs: add notes and instruction for latest trtllm kvbm disagg (#6055) 2026-02-06 17:03:07 -08:00
Yan Ru Pei d00f96074b
docs: clarify the usage of LRU for mocker evictor (#6053) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-06 15:08:41 -08:00
akshatha-k fce8bbc250
docs: add quick start sections to KVBM and Router guides (#6043) 
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Dan Gil <dagil@nvidia.com>
 2026-02-06 15:17:21 -06:00
Jacky 1ffa489ea1
refactor: Move --migration-limit flag from backend to frontend (#5918) 
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
 2026-02-06 20:50:55 +00:00
mohammedabdulwahhab 82a8d768a5
fix: remove envsubst for logging-dashboard.yaml to preserve Grafana template variables (#6045) 
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
 2026-02-06 12:07:31 -08:00
Ryan McCormick bed29a1600
docs: Update disagg and request flow design docs based on latest code (#5993) 2026-02-07 04:01:13 +08:00
dagil-nvidia 07db589583
docs: clean up toctree navigation and add disaggregated serving guide (#6024) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-06 13:20:36 -06:00
Yan Ru Pei 3e41702211
chore: remove and unify bindings in kv.rs (#6016) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-06 18:44:46 +00:00
dagil-nvidia b19de4ed77
docs: cleanup of docs refactor for components, integrations, and features (#6019) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-05 19:50:17 -08:00
akshatha-k 80e7bafd37
docs: Migrate router documentation to three-tier structure (#5979) 
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-06 01:55:50 +00:00
Karen Chung b5c0db63c3
feat: TRTLLM DP Rank Routing (#5936) 2026-02-05 17:43:04 -08:00
dagil-nvidia 400126d2bc
docs: migrate Frontend docs to three-tier structure (#6002) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-06 01:00:52 +00:00
dagil-nvidia 3023c6258a
docs: migrate Profiler docs to three-tier structure (#6003) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Jonathan Tong <jt572@cornell.edu>
 2026-02-05 18:05:49 -06:00
akshatha-k 4c3eba2aeb
docs: restructure KVBM documentation into three-tier format (#5905) 
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Kyle McGill <101670481+nv-kmcgill53@users.noreply.github.com>
 2026-02-05 18:02:05 -06:00
dagil-nvidia 87449e1c97
docs: migrate LoRA docs to three-tier structure (#6000) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-05 23:52:32 +00:00
dagil-nvidia c57099800d
docs: migrate Multimodal docs to three-tier structure (#5999) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-05 17:48:54 -06:00
Anish 7752ce219e
docs: planner 3-tier documentation restructure (#5876) 
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-05 17:45:19 -06:00
dagil-nvidia 8aa7335e35
docs: migrate Speculative Decoding docs to three-tier structure (#6001) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-05 17:45:10 -06:00
Indrajit Bhosale 8c8680b179
feat: Make grpc startup dynamic for high ISL/OSL in GRPC frontend (#5536) 
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
 2026-02-05 10:11:20 -08:00
dagil-nvidia 3a9bfc4853
docs: add documentation templates for streamlined docs structure (#5834) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-05 08:24:35 -08:00
jh-nv f3bea5d557
fix: update disagg tracing screenshot and description (#5956) 2026-02-04 14:22:21 -05:00
dagil-nvidia 4d9e64a2c1
docs: update support matrix with backend dependencies for Dynamo 0.9.0 + 1.0.0 (#5932) 2026-02-04 11:39:48 -06:00
Julien Mancuso f3aa1e0129
feat: introducing ChReK (Checkpoint Restore in K8s) (#4978) 
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
 2026-02-03 13:34:14 -07:00
Tushar Sharma 07d5789423
chore: regenerate api references doc to resolve operator build failures (#5909) 
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
 2026-02-03 09:47:49 -08:00
dagil-nvidia 6720dfb658
docs: fix SGLang docs links (docs.sglang.ai → docs.sglang.io) (#5894) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-03 04:29:57 +00:00
Thomas Montfort 04f32fe226
docs: fix prometheusEndpoint helm value path in metrics guide (#5890) 2026-02-03 02:01:01 +00:00
Janelle Cai 18d9d1fa4f
feat(mocker): pre-fetch model and staggered launches (#5871) 2026-02-03 00:46:23 +00:00
Jacky 934d03c545
fix: Disable calls to abort() at TRT-LLM backend - temporary (#5827) 
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
 2026-01-30 15:03:30 -08:00
Yuewei Na e2982e1f5a
fix(docs): remove trailing transition causing Sphinx build failure (#5831) 
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
 2026-01-30 12:51:26 -08:00
Yan Ru Pei 408d7868b7
docs: mocker (#5832) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-01-30 12:25:48 -08:00
Yuewei Na 284f772b25
docs: add known issues section for TRT-LLM backend (#5801) 
Signed-off-by: Yuewei Na <nv-yna@users.noreply.github.com>
Signed-off-by: Yuewei Na <248773860+nv-yna@users.noreply.github.com>
Co-authored-by: Yuewei Na <nv-yna@users.noreply.github.com>
 2026-01-30 11:21:28 -08:00
dagil-nvidia a4600927f5
docs: transpose backend dependency tables, extend to v0.6.0 (#5663) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
 2026-01-30 18:31:23 +00:00
dagil-nvidia e8c7bbf3d5
docs: refactor Dynamo readme.md and quick_start_local.rst (#5649) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-01-30 18:27:30 +00:00
Yan Ru Pei ec0469280c
docs: update main router doc (#5812) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-01-30 03:03:09 +00:00
Tanmay Verma ba711cc1ac
chore: Upgrade to Tensorrt-LLM 1.3.0rc1 (#5700) 
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
 2026-01-29 15:20:58 -08:00
Julien Mancuso 9e2a2cc9e6
feat: add epp component (#5611) 
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
 2026-01-29 22:43:01 +00:00
Richard Huo 8cdfe68242
docs: fix the statements for setting up the trtllm NIXL backends (#5763) 2026-01-29 08:15:45 -08:00
Jonathan Tong a379c1b1ae
docs: fix prometheus helm install namespace selector syntax (#5548) 
Signed-off-by: Jont828 <jt572@cornell.edu>
 2026-01-28 21:56:40 +00:00
ishandhanani ed5e4fd021
docs: remove incorrect HighConfidence dLLM algorithm reference (#5723) 
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-28 08:16:08 -08:00
Alec 63bee8b303
chore: bump vLLM to 0.14.1 (#5691) 
Signed-off-by: alec-flowers <aflowers@nvidia.com>
 2026-01-27 19:51:29 -08:00
Keiven C 8e72fb69cf
docs: DYN-1967 update metrics docs after kvstats removal (#5704) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2026-01-27 17:24:12 -08:00
Pavithra Vijayakrishnan 66c369964a
chore: version update for 0.9.0 (#5661) 
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
 2026-01-26 17:18:05 -08:00
ishandhanani 4f981e282a
feat: sglang update to 0.5.8 (#5655) 2026-01-26 23:46:05 +00:00
Jonathan Tong f9050aae85
docs: migrate existing docs to fern (#5445) 
Signed-off-by: Jont828 <jt572@cornell.edu>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
 2026-01-26 20:42:58 +00:00
dagil-nvidia f238d23a4d
docs: reduce admonition clutter in reference docs (#5646) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-01-26 13:50:46 -06:00