mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,557 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

37 Commits

Author SHA1 Message Date
Alec 7893f2684e
feat: add --disaggregation-mode enum to vLLM backend (#6483) 
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-23 19:34:30 -07:00
zhongdaor-nv 23de4e86ae
feat: e2e mm aware kv cache routing support for trtllm backend (#5480) 
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
Signed-off-by: Zhongdao Ren <zhongdaor@zhongdaor-mlt.client.nvidia.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
Co-authored-by: Zhongdao Ren <zhongdaor@zhongdaor-mlt.client.nvidia.com>
 2026-02-19 20:52:00 -07:00
Yan Ru Pei fc229004b5
chore: Remove ZmqKvEventListener binding and rework standalone TRT-LLM example to use native Python ZMQ (#6164) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-19 04:15:13 +00:00
Yan Ru Pei 14eceb43df
chore: rename KvPushRouter to KvRouter in python + more bindings removal (#6238) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-02-12 23:44:52 -08:00
Jonathan Tong 39d645e586
docs: migrate Fern docs from fern/ into docs/ (#6206) 
Signed-off-by: Jont828 <jt572@cornell.edu>
 2026-02-11 16:22:27 -08:00
Dillon Cullinan 3188c70a3b
chore: Templating Feedback Followup (#6125) 
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
 2026-02-11 13:09:27 -05:00
devivasudevan 93a27308a8
docs: Add AKS storage guidance for Dynamo caches (#5581) 
Signed-off-by: Devi Vasudevan <deviv@microsoft.com>
Signed-off-by: devivasudevan <49675305+devivasudevan@users.noreply.github.com>
Co-authored-by: Sertaç Özercan <852750+sozercan@users.noreply.github.com>
 2026-02-10 14:25:43 -08:00
Dillon Cullinan ac0206293c
feat: Dockerfile templating (#5633) 
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
 2026-02-10 08:56:17 -05:00
Yan Ru Pei ef1078e46e
chore: nuke standalone fast api router (#5845) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-01-30 16:42:21 -08:00
Yan Ru Pei 03162161e4
chore: default python hash seed to zero always for the engines (#5583) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2026-01-22 17:20:24 -08:00
hhzhang16 c8770464ab
feat: normalize dynamo namespace computation (#5231) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2026-01-12 19:09:43 +00:00
Qi Wang 1efc41e0a5
fix: avoid example TRT-LLM worker OOM by tuning params (#5250) 2026-01-07 13:52:39 -08:00
Alec a1333a8ddb
fix: update vLLM to 0.13.0 with API compatibility fixes (#5222) 
Signed-off-by: Vasilis Vagias <vvagias@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Vasilis Vagias <vvagias@nvidia.com>
 2026-01-06 15:08:08 -08:00
Neelay Shah 11d7d3f59e
chore: Remove deprecated Earthfile (#5206) 
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-06 09:58:34 -08:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130) 
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
 2026-01-02 22:08:23 +00:00
Thomas Montfort 3057af00b6
feat(dep-715): refactor helm directory and remove reference to cloud (#5042) 2025-12-23 12:08:19 -05:00
zhongdaor-nv 481dc6363b
feat: add multimodal support to KV router with standalone trtllm example (#4577) 
Signed-off-by: zhongdaor <zhongdaor@nvidia.com>
Signed-off-by: zhongdaor-nv <zhongdaor@nvidia.com>
 2025-12-18 21:01:45 -08:00
Tanmay Verma e1c685b105
fix: Remove debug logging from aiperf benchmarking (#5010) 2025-12-18 02:34:41 +00:00
Sertaç Özercan a6a4f360d2
docs: update aks guide (#3651) 
Signed-off-by: Sertac Ozercan <sozercan@gmail.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
 2025-12-03 02:37:16 +00:00
Sean SH Choi 81b8af8d36
fix: update router standalone to use updated vLLM API (#4079) 
Signed-off-by: Sean Choi <sechoi@nvidia.com>
 2025-11-04 06:02:57 +00:00
Anant Sharma 8bd37c96d6
refactor: move backend deploy, launch and slurm files from components to examples (#3849) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-10-31 13:09:46 -04:00
Biswa Panda d712ce8d0d
feat: GKE examples (#2721) 
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: FortunaZhang <175659032+FortunaZhang@users.noreply.github.com>
Co-authored-by: FortunaZhang <175659032+FortunaZhang@users.noreply.github.com>
 2025-10-22 19:02:42 -04:00
Harshini Komali 9f310225eb
feat: Replace genai-perf with aiperf (#3533) 
Signed-off-by: lkomali <lkomali@nvidia.com>
 2025-10-16 09:58:36 -07:00
kYLe db192a35c7
fix: update ECS doc (#3500) 
Signed-off-by: Kyle H <kylhuang@nvidia.com>
 2025-10-08 23:54:11 -04:00
Julien Mancuso b1b7c50c68
fix: update ETCD image (#3457) 
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
 2025-10-07 16:11:27 -06:00
Neal Vaidya 6bd3ae2ae1
fix: add instructions on creating ecs role (#3381) 
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
 2025-10-06 17:51:32 -04:00
Neal Vaidya cf3ac5b628
fix: update ecs deployment example (#3284) 
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
 2025-09-30 14:32:33 -07:00
Harrison Saturley-Hall 9e8f67ed0f
fix: update the tags for consistency and remove 0.4.1 refs (#3058) 
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
 2025-09-24 14:53:43 -04:00
Julien Mancuso 4a71802842
feat: revamp kubernetes doc (#3173) 
Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
 2025-09-23 14:09:29 -06:00
kYLe 8c665c1bb5
docs: Add AWS ECS deployment example for Dynamo vLLM (#2415) 
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
 2025-09-09 19:37:39 +00:00
nv-nmailhot 3ea3d59b91
docs: fix broken links (#2965) 2025-09-09 18:17:24 +00:00
Ryan McCormick 79a9d69d2b
docs: Fix dynamo cloud quickstart links (#2765) 
Signed-off-by: Ryan McCormick <rmccormick@nvidia.com>
 2025-08-28 23:55:46 +00:00
Biswa Panda b74b887bad
fix: add instruction to deploy model with inference gateway (#2257) 2025-08-14 17:02:48 +00:00
GuanLuo 9b87c89c41
feat: multi-modal example with vLLM v1 and UX v2 (#2040) 
Co-authored-by: krishung5 <krish@nvidia.com>
 2025-08-12 23:55:31 +00:00
Anish 12a7b83bf0
docs: Examples README/restructuring, framework READMEs, EKS examples (#2174) 2025-07-29 22:46:19 +00:00
Anish 5be23eb7ec
Readmes + eks additions (#2157) 2025-07-29 13:57:28 -07:00
saurabh-nvidia 358e9085ab
docs: Adding document for running Dynamo on Azure Kubernetes Services (#2080) 
Co-authored-by: Ubuntu <saurabha@saurabha-cpu.l5mxjxajs0be3dwlje3wrdx5ie.xx.internal.cloudapp.net>
 2025-07-29 09:57:38 -07:00