mooncake-track
/
dynamo
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,557 Commits 2 Branches 0 Tags 76 MiB
Commit Graph

130 Commits

Author SHA1 Message Date
dagil-nvidia e0373bd725
docs: alphabetize backends (SGLang, TensorRT-LLM, vLLM) (#6537) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-25 10:07:59 -06:00
ishandhanani 6642e23e0f
feat: sglang to 0.5.9 + updated docs (#6518) 
Co-authored-by: baihuitian <baihuitian.bht@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-24 21:48:25 +00:00
Alec 7bbacce196
feat: default kv-events-config to empty (align with vLLM defaults) (#6404) 
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-20 06:44:51 +00:00
mohammedabdulwahhab a289695c37
fix: consolidate dyn_discovery_backend and dyn_kv_store (#6167) 
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
 2026-02-13 19:07:11 +00:00
dagil-nvidia 307502842e
docs: update docs URLs from Sphinx index.html to Fern paths (#6218) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-11 19:23:00 -06:00
Jonathan Tong 39d645e586
docs: migrate Fern docs from fern/ into docs/ (#6206) 
Signed-off-by: Jont828 <jt572@cornell.edu>
 2026-02-11 16:22:27 -08:00
dagil-nvidia b19de4ed77
docs: cleanup of docs refactor for components, integrations, and features (#6019) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-05 19:50:17 -08:00
akshatha-k 80e7bafd37
docs: Migrate router documentation to three-tier structure (#5979) 
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-06 01:55:50 +00:00
akshatha-k 4c3eba2aeb
docs: restructure KVBM documentation into three-tier format (#5905) 
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: Kyle McGill <101670481+nv-kmcgill53@users.noreply.github.com>
 2026-02-05 18:02:05 -06:00
dagil-nvidia 6720dfb658
docs: fix SGLang docs links (docs.sglang.ai → docs.sglang.io) (#5894) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-02-03 04:29:57 +00:00
dagil-nvidia e8c7bbf3d5
docs: refactor Dynamo readme.md and quick_start_local.rst (#5649) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
 2026-01-30 18:27:30 +00:00
Nate Mailhot 9c71f28634
fix: link checking (#5209) 2026-01-27 10:47:26 -08:00
dagil-nvidia 248073455a
docs: add release-artifacts.md with comprehensive artifact inventory (#5619) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
 2026-01-26 12:42:56 -06:00
dagil-nvidia 417ce216a3
docs: remove PRs merged badge from README (#5623) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-01-26 03:32:57 +08:00
Schwinn Saereesitthipitak 30c6228b82
feat: GPU Memory Service (#5286) 
Signed-off-by: Schwinn Saereesitthipitak <17022745+galletas1712@users.noreply.github.com>
 2026-01-23 09:50:09 +00:00
dagil-nvidia a7bc38d7c5
docs: update vLLM flag for local dev without NATS (#5587) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-01-22 20:58:46 -05:00
dagil-nvidia 38fbb1db44
docs: quick fixes for README.md (#5582) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-01-22 12:30:06 -08:00
dagil-nvidia fb3a77b7b7
docs: improve the contributor experience of CONTRIBUTING.md (#5507) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-01-22 08:21:53 -08:00
dagil-nvidia 83c1370ba6
docs: update roadmap link to H1 '26 timeline (#5508) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
 2026-01-22 06:24:55 +00:00
dagil-nvidia 91a8d07f72
docs: README updates for 0.8.0 (#5395) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
 2026-01-13 16:15:23 -06:00
dagil-nvidia 4ed8584a4a
docs: add feature compatibility matrix and update support matrix for v0.8.0 (#5349) 
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
 2026-01-13 13:14:50 -06:00
Anant Sharma b1fc99ca91
docs: update readme for pip install ai-dynamo[trtllm] (#5312) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2026-01-09 14:38:39 -05:00
Neelay Shah e8c87f175f
docs: Update TensorRT-LLM install prerequisites for 1.2.0rc5 (#5194) 
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
 2026-01-06 10:44:20 -08:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130) 
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
 2026-01-02 22:08:23 +00:00
smatta-star f63e273c43
feat: add auto-generated frontend OpenAPI spec and helper binary (#4802) 
Signed-off-by: Satvik Matta <smatta@nvidia.com>
 2025-12-22 21:45:03 +00:00
Harry Kim cb2ea1be31
docs: Add Recipes to ToC and bump FW Support Matrix further up (#4536) 
Signed-off-by: Harry Kim <harry_kim@live.com>
 2025-11-21 19:18:14 +00:00
Anish d1ce4236d9
docs: update Latest News section in README (#4452) 
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
 2025-11-20 16:35:49 +00:00
Graham King e1af3af6ee
chore: Remove static mode (#4235) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-11-11 19:25:12 +00:00
Keiven C afccc9d434
refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-11-10 20:19:34 +00:00
Anant Sharma 8bd37c96d6
refactor: move backend deploy, launch and slurm files from components to examples (#3849) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-10-31 13:09:46 -04:00
hhzhang16 6a84ffd347
feat: turn profiling k8s jobs into sample DGDR requests (#3864) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
 2025-10-27 13:36:31 -07:00
Anish c6b5904579
docs: address Harry/VDR feedback + fixing broken links across repository (#3802) 
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
 2025-10-22 19:56:24 -04:00
Anant Sharma ee20d2fdb7
docs: fix support_matrix link in readme (#3698) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-10-17 16:04:51 +00:00
Anish 598cbbb73b
docs: reorganizing documentation to make things clearer (#3658) 
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
 2025-10-16 23:59:59 +00:00
Biswa Panda de3ca70b43
feat: update benchmarking script to use aiperf (#3306) 
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: lkomali <lkomali@nvidia.com>
Co-authored-by: lkomali <lkomali@nvidia.com>
Co-authored-by: Harshini Komali <157742537+lkomali@users.noreply.github.com>
 2025-10-14 05:26:29 +00:00
KrishnanPrash 855d9a95ff
docs: Adding instruction to install python3-dev (#3554) 
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
 2025-10-13 09:22:29 -07:00
Anant Sharma 0a2a820bca
docs: move all md files from components to docs (#3440) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
 2025-10-10 03:39:26 +00:00
Graham King 0aa0768f53
chore: Remove llama.cpp engine (#3499) 
Signed-off-by: Graham King <grahamk@nvidia.com>
 2025-10-08 16:44:53 -04:00
Keiven C 1ddb9b0c6f
refactor: rename dynamo_check.py to sanity_check.py (#3423) 
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
 2025-10-07 13:05:50 -07:00
Anant Sharma 836d74172f
feat: restructure source code for python packaging (#3201) 
Signed-off-by: Anant Sharma <anants@nvidia.com>
 2025-10-01 13:15:24 -04:00
ishandhanani 0ab6bc2b72
chore: update slurm scrips for better warmup and bump sgl version (#3291) 2025-09-30 22:20:11 +00:00
Julien Mancuso 4a71802842
feat: revamp kubernetes doc (#3173) 
Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
 2025-09-23 14:09:29 -06:00
Paul Li 007b9d609b
docs: Update README.md to bypass nvidia runtime for dcgm-exporter service when deploying container for etcd and nats (#3148) 
Signed-off-by: Paul Li <zhixiong2008@gmail.com>
 2025-09-19 23:47:13 -07:00
Richard Huo fb29bd5aea
build: update trtllm to v1.1.0rc5 to enable trtllm + KVBM integration (#3119) 
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
 2025-09-19 08:39:49 -07:00
Hongkuan Zhou dcee4dbd17
feat: support trtllm in sla-planner (#2980) 
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>
 2025-09-10 14:41:29 -07:00
Indrajit Bhosale e8cb972e33
chore: Update trtllm version to 1.1.0rc3 (#2930) 
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
 2025-09-09 14:30:02 -07:00
Harry Kim 960646144d
Update README.md (#2938) 
Signed-off-by: Harry Kim <harry_kim@live.com>
 2025-09-08 16:29:31 -07:00
Harry Kim 357efee394
docs: Update README.md (#2906) 
Signed-off-by: Harry Kim <harry_kim@live.com>
 2025-09-05 10:23:18 -07:00
Yan Ru Pei 1995ef9aee
docs: change docs to default port 8000 (#2876) 
Signed-off-by: PeaBrane <yanrpei@gmail.com>
 2025-09-05 01:16:53 +00:00
hhzhang16 699996e4fe
feat: add benchmarking guide (#2620) 
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
 2025-08-29 17:14:55 -07:00