mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,557 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

25 Commits

Author SHA1 Message Date
Hongkuan Zhou b2075619c9
feat: planner argparse CLI -> config file (#6356) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
 2026-02-18 23:17:36 +00:00
hhzhang16 d56439ec28
feat: migrate GPU discovery from Dynamo Profiler to Dynamo Operator with automatic injection (#6224) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2026-02-14 00:34:21 +00:00
Hongkuan Zhou a04b56310c
feat: support AIC DGD gen call (WILL BREAK DGDR) (#6216) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
 2026-02-12 08:47:55 -08:00
Dmitry Tokarev 4220771fba
fix: Cleanup pytest markers, enable gpu_0 tests on trtllm arm, reduce log noise (#6124) 
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
 2026-02-11 16:00:58 -05:00
Jason Zhou e861f61958
fix: TestProfileSlaAiconfigurator should use new framework versions (#5562) 2026-01-22 15:22:40 -08:00
Hongkuan Zhou fbe6bb0a9e
feat: support PVC model cache in profiler (#5124) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
 2026-01-05 08:52:34 -08:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130) 
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
 2026-01-02 22:08:23 +00:00
Pavithra Vijayakrishnan 5034b14439
test: pytest mark checker (#4812) 
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
 2025-12-20 01:09:13 +00:00
Hongkuan Zhou ca0cd3b18a
feat: add webUI to profiler (#4544) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
 2025-12-10 13:22:04 -08:00
Jason Zhou 2f2a13a3e0
test: add AIConfigurator dense model tests for Dynamo Planner Profiler (#4526) 
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>
 2025-12-03 04:52:49 +00:00
Pavithra Vijayakrishnan 0f6dca6e70
test: Add pytest markers (#4111) 
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
 2025-12-01 09:53:20 -08:00
Yan Ru Pei d821a8b9f7
chore: parallelize planner profile tests + bindings test cleanup (#4532) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2025-11-21 09:21:43 +00:00
Jason Zhou 43986372f5
feat: DynamoPlanner profiler to use hf_id for AIConfigurator 0.4.0 (#4167) 
Signed-off-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>
Signed-off-by: Jason Zhou <jasonzho@nvidia.com>
Co-authored-by: Jason Zhou <jasonzho@jasonzho-mlt.client.nvidia.com>
 2025-11-10 23:17:42 +00:00
Hongkuan Zhou 7750ed1a51
feat: add parallelization filters (#4144) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
 2025-11-07 14:52:49 -05:00
Anant Sharma 8bd37c96d6
refactor: move backend deploy, launch and slurm files from components to examples (#3849) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-10-31 13:09:46 -04:00
hhzhang16 6fc4c59599
feat: remove cluster wide logic from namespace restricted operator (#3934) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2025-10-30 23:08:54 +00:00
hhzhang16 6a84ffd347
feat: turn profiling k8s jobs into sample DGDR requests (#3864) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
 2025-10-27 13:36:31 -07:00
Biswa Panda 0757ecf1e3
fix: consistent model recipes and update simplified doc (#3858) 2025-10-27 10:50:01 -07:00
Hongkuan Zhou a1b38af25e
feat: automatic profiling config generation (#3787) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
 2025-10-23 08:07:39 -07:00
Harrison Saturley-Hall 34fc9693f8
fix: git lfs support is erratic with uv so set env var to force it (#3671) 
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
 2025-10-16 18:49:42 -04:00
Hongkuan Zhou 83e259a7cc
feat: pre-deployment profiling automatically generates and deploys optimized DGD with planner (#3441) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
 2025-10-07 16:52:51 -07:00
Hongkuan Zhou 6243bcbe04
feat: support MoE model in SLA Planner Sglang (#3185) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
 2025-09-23 19:42:43 -07:00
Ilya Sherstyuk 19948b7f5a
feat: Add --use-ai-configurator to profile_sla.py (#3079) 
Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
Signed-off-by: Ilya Sherstyuk <46343317+ilyasher@users.noreply.github.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
 2025-09-19 11:23:24 -07:00
Hongkuan Zhou dcee4dbd17
feat: support trtllm in sla-planner (#2980) 
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>
 2025-09-10 14:41:29 -07:00
Hongkuan Zhou f72dc01d00
test: add test for pre-deployment script (#2857) 
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
 2025-09-04 15:22:07 -07:00