mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,557 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

40 Commits

Author SHA1 Message Date
Alec 7893f2684e
feat: add --disaggregation-mode enum to vLLM backend (#6483) 
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-23 19:34:30 -07:00
Alec 7bbacce196
feat: default kv-events-config to empty (align with vLLM defaults) (#6404) 
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-20 06:44:51 +00:00
Jonathan Tong 39d645e586
docs: migrate Fern docs from fern/ into docs/ (#6206) 
Signed-off-by: Jont828 <jt572@cornell.edu>
 2026-02-11 16:22:27 -08:00
dagil-nvidia b19de4ed77
docs: cleanup of docs refactor for components, integrations, and features (#6019) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-05 19:50:17 -08:00
akshatha-k 80e7bafd37
docs: Migrate router documentation to three-tier structure (#5979) 
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-06 01:55:50 +00:00
Ryan McCormick 910d74f59e
fix: Add mpi arg to all srun commands (#5948) 2026-02-04 17:08:54 -08:00
dagil-nvidia ef292944fd
docs: fix markdown formatting in Distributed_Inference README (#5947) 2026-02-04 15:08:18 -06:00
dagil-nvidia 6720dfb658
docs: fix SGLang docs links (docs.sglang.ai → docs.sglang.io) (#5894) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-03 04:29:57 +00:00
kYLe 6e568d4552
docs: Modify AI configurator command in README (#5820) 
Signed-off-by: kYLe <kylhuang@nvidia.com>
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
 2026-02-02 18:54:55 -05:00
hhzhang16 6c8708104e
fix: add --is-decode-worker flag (#5843) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2026-01-30 16:20:00 -08:00
Julien Mancuso f6d6b34e87
fix: update docker-compose path in doc (#5821) 
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
 2026-01-30 21:24:53 +00:00
hhzhang16 c8770464ab
feat: normalize dynamo namespace computation (#5231) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2026-01-12 19:09:43 +00:00
dagil-nvidia c29f78c19d
docs: add host and bootstrap port to disagg multinode example (#5309) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-01-09 15:31:09 +00:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130) 
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
 2026-01-02 22:08:23 +00:00
Keiven C a77558d442
feat: allow dynamic port in scripts in preparation for parallel testing (part 1) (#4546) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-25 08:48:58 -08:00
Julien Mancuso b7667c4849
fix: fix PVC in shared frontend example (#4517) 
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
 2025-11-21 13:18:39 -07:00
Kris Hung e2f5125434
fix: Update doc to assign port to avoid zmq port collision (#4469) 2025-11-19 18:34:05 +00:00
Ben Hamm 88dfd1b338
docs: Clean up incomplete recipes and clarify Kubernetes-only focus (#4159) 
Signed-off-by: Ben Hamm <ben.hamm@gmail.com>
Signed-off-by: Tanmay Verma <tanmay2592@gmail.com>
Signed-off-by: atchernych <atchernych@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
Co-authored-by: Tanmay Verma <tanmayv@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: atchernych <atchernych@nvidia.com>
 2025-11-18 02:13:48 +00:00
Yan Ru Pei 9fa8125cc8
chore: trtllm use unified frontend (#4097) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2025-11-05 06:33:22 +00:00
Rohan Varma b73e6eb59a
feat: restructure dsr1 recipes and add gb200 (#3891) 
Signed-off-by: Rohan Varma <rohanv@nvidia.com>
 2025-11-01 02:55:45 +00:00
Anant Sharma 8bd37c96d6
refactor: move backend deploy, launch and slurm files from components to examples (#3849) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-10-31 13:09:46 -04:00
Anant Sharma 8354d3258c
refactor: move engine configs out of components directory (#3772) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: tanmayv25 <tanmay2592@gmail.com>
 2025-10-24 13:54:10 -04:00
Anish c6b5904579
docs: address Harry/VDR feedback + fixing broken links across repository (#3802) 
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
 2025-10-22 19:56:24 -04:00
kYLe 69fffdba10
docs: Add AIConfigurator and disagg example for Dynamo vLLM (#3183) 
Signed-off-by: Kyle H <kylhuang@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Signed-off-by: Kyle Huang <kylhuang@nvidia.com>
Signed-off-by: kYLe <kylhuang@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
 2025-10-21 21:00:43 +00:00
Harshini Komali 9f310225eb
feat: Replace genai-perf with aiperf (#3533) 
Signed-off-by: lkomali <lkomali@nvidia.com>
 2025-10-16 09:58:36 -07:00
Anant Sharma 0a2a820bca
docs: move all md files from components to docs (#3440) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
 2025-10-10 03:39:26 +00:00
Maksim Khadkevich 13bf5d9103
docs: added example for a frontend shared across multiple models (#3008) 
Signed-off-by: Maksim Khadkevich <mkhadkevich@nvidia.com>
 2025-10-08 01:47:06 +00:00
Anant Sharma 836d74172f
feat: restructure source code for python packaging (#3201) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-10-01 13:15:24 -04:00
ishandhanani 0ab6bc2b72
chore: update slurm scrips for better warmup and bump sgl version (#3291) 2025-09-30 22:20:11 +00:00
Harrison Saturley-Hall 9e8f67ed0f
fix: update the tags for consistency and remove 0.4.1 refs (#3058) 
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
 2025-09-24 14:53:43 -04:00
kYLe 42669baa13
docs: SNS agg k8s example (#2773) 
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
 2025-09-02 19:30:50 +00:00
Ryan McCormick 766d3f2cf8
docs: Simplify sphinx build and table of contents on webpage (#2519) 2025-08-25 23:36:31 +00:00
Yan Ru Pei f08729ae15
feat: python bindings for the entire KvPushRouter + per-request router configs (#2658) 2025-08-25 22:27:10 +00:00
Ryan McCormick 844f8819a1
docs: Bring back some missed release/0.4.0 doc changes, fix broken links, add lychee link checker github action (#2482) 2025-08-18 10:26:15 -07:00
Nathan Martinez d177cdffd3
fix: Fix docker-compose.yml Path in Example README (#2473) 
Signed-off-by: Nathan Martinez <96562131+nate-martinez@users.noreply.github.com>
 2025-08-17 17:30:46 -07:00
Kris Hung f14f59c262
chore: Remove multimodal readme. (#2212) 2025-07-31 16:07:03 -07:00
Anish 12a7b83bf0
docs: Examples README/restructuring, framework READMEs, EKS examples (#2174) 2025-07-29 22:46:19 +00:00
Neal Vaidya ca5b681a1c
docs: add multinode example (#2155) 2025-07-29 18:40:29 +00:00
Neal Vaidya 291df28620
docs: add disagg example + explanation (#2086) 2025-07-29 18:35:15 +00:00
Neal Vaidya 195c4c47ca
docs: Quickstart with new UX (#2005) 2025-07-29 10:42:44 -07:00