e1af3af6ee
chore: Remove static mode ( #4235 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-11 19:25:12 +00:00
afccc9d434
refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) ( #4173 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-11-10 20:19:34 +00:00
8bd37c96d6
refactor: move backend deploy, launch and slurm files from components to examples ( #3849 )
...
Signed-off-by: Anant Sharma <anants@nvidia.com>
2025-10-31 13:09:46 -04:00
6a84ffd347
feat: turn profiling k8s jobs into sample DGDR requests ( #3864 )
...
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuanz <hongkuanz@nvidia.com>
Co-authored-by: Hongkuan Zhou <tedzhouhk@gmail.com>
2025-10-27 13:36:31 -07:00
c6b5904579
docs: address Harry/VDR feedback + fixing broken links across repository ( #3802 )
...
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
2025-10-22 19:56:24 -04:00
ee20d2fdb7
docs: fix support_matrix link in readme ( #3698 )
...
Signed-off-by: Anant Sharma <anants@nvidia.com>
2025-10-17 16:04:51 +00:00
598cbbb73b
docs: reorganizing documentation to make things clearer ( #3658 )
...
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
2025-10-16 23:59:59 +00:00
de3ca70b43
feat: update benchmarking script to use aiperf ( #3306 )
...
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: lkomali <lkomali@nvidia.com>
Co-authored-by: lkomali <lkomali@nvidia.com>
Co-authored-by: Harshini Komali <157742537+lkomali@users.noreply.github.com>
2025-10-14 05:26:29 +00:00
855d9a95ff
docs: Adding instruction to install python3-dev ( #3554 )
...
Signed-off-by: Krishnan Prashanth <kprashanth@nvidia.com>
2025-10-13 09:22:29 -07:00
0a2a820bca
docs: move all md files from components to docs ( #3440 )
...
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
2025-10-10 03:39:26 +00:00
0aa0768f53
chore: Remove llama.cpp engine ( #3499 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-10-08 16:44:53 -04:00
1ddb9b0c6f
refactor: rename dynamo_check.py to sanity_check.py ( #3423 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-10-07 13:05:50 -07:00
836d74172f
feat: restructure source code for python packaging ( #3201 )
...
Signed-off-by: Anant Sharma <anants@nvidia.com>
2025-10-01 13:15:24 -04:00
0ab6bc2b72
chore: update slurm scrips for better warmup and bump sgl version ( #3291 )
2025-09-30 22:20:11 +00:00
4a71802842
feat: revamp kubernetes doc ( #3173 )
...
Signed-off-by: Julien Mancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
2025-09-23 14:09:29 -06:00
007b9d609b
docs: Update README.md to bypass nvidia runtime for dcgm-exporter service when deploying container for etcd and nats ( #3148 )
...
Signed-off-by: Paul Li <zhixiong2008@gmail.com>
2025-09-19 23:47:13 -07:00
fb29bd5aea
build: update trtllm to v1.1.0rc5 to enable trtllm + KVBM integration ( #3119 )
...
Signed-off-by: richardhuo-nv <rihuo@nvidia.com>
2025-09-19 08:39:49 -07:00
dcee4dbd17
feat: support trtllm in sla-planner ( #2980 )
...
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
Signed-off-by: ayushag <ayushag@nvidia.com>
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
Signed-off-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Signed-off-by: GuanLuo <gluo@nvidia.com>
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
Signed-off-by: Graham King <grahamk@nvidia.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Signed-off-by: Greg Clark <grclark@nvidia.com>
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
Co-authored-by: Ayush Agarwal <ayushag@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan92@gmail.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: julienmancuso <161955438+julienmancuso@users.noreply.github.com>
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Greg Clark <grclark@nvidia.com>
Co-authored-by: Neal Vaidya <nealv@nvidia.com>
Co-authored-by: nv-nmailhot <nmailhot@nvidia.com>
2025-09-10 14:41:29 -07:00
e8cb972e33
chore: Update trtllm version to 1.1.0rc3 ( #2930 )
...
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
2025-09-09 14:30:02 -07:00
960646144d
Update README.md ( #2938 )
...
Signed-off-by: Harry Kim <harry_kim@live.com>
2025-09-08 16:29:31 -07:00
357efee394
docs: Update README.md ( #2906 )
...
Signed-off-by: Harry Kim <harry_kim@live.com>
2025-09-05 10:23:18 -07:00
1995ef9aee
docs: change docs to default port 8000 ( #2876 )
...
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2025-09-05 01:16:53 +00:00
699996e4fe
feat: add benchmarking guide ( #2620 )
...
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
2025-08-29 17:14:55 -07:00
9ab37d9445
fix: Update tensorrt_llm to 1.0.0rc6 ( #2606 )
2025-08-21 17:59:09 -07:00
40ea0fb5c9
docs: Add pinned install for cuda-python in pip install path ( #2553 )
2025-08-20 10:27:13 -07:00
a4bbe49228
feat(http): TLS support ( #2492 )
2025-08-18 16:06:29 -04:00
844f8819a1
docs: Bring back some missed release/0.4.0 doc changes, fix broken links, add lychee link checker github action ( #2482 )
2025-08-18 10:26:15 -07:00
7b1fa5620f
docs: add instructions to install uv ( #2476 )
2025-08-17 17:29:46 -07:00
e22f84ab18
feat: support sglang in sla planner ( #2421 )
...
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2025-08-12 18:43:13 -07:00
8964d0d580
docs: add GPT-OSS deployment guide ( #2297 )
...
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: jthomson04 <jwillthomson19@gmail.com>
Co-authored-by: John Thomson (DLAlgo) <jothomson@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
2025-08-05 13:17:53 -04:00
053ac33e1c
fix: readme instructions for worker running ( #2266 )
2025-08-04 09:59:02 -07:00
da0c57261d
chore: update sgl version and fix h100 wideep example ( #2169 )
2025-07-30 00:31:20 +00:00
a8cb655477
docs: update readme install instructions ( #2170 )
2025-07-29 18:52:12 +00:00
3175b10d92
docs: Update to README.md ( #2141 )
...
Signed-off-by: Anish <80174047+athreesh@users.noreply.github.com>
2025-07-29 05:20:09 +00:00
4498a77d0b
fix: move docker-compose.yml to deploy/, and update frontend port ( #2121 )
...
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-07-25 23:07:57 +00:00
2cd96ec7ba
build: Add TensorRT-LLM to optional dependency and corresponding instructions ( #2113 )
...
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Graham King <grahamk@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
2025-07-25 21:38:04 +00:00
3c500ae7a9
docs: Update docs for new UX ( #2070 )
2025-07-23 22:36:01 +00:00
eebc741039
docs: Adjust the path to examples ( #2056 )
2025-07-23 19:26:18 +00:00
95dd9426d8
docs: Post-Merge cleanup of the deploy documentation ( #1922 )
2025-07-21 13:09:33 -06:00
9e76590fd3
docs: organize sglang readme ( #1910 )
2025-07-15 00:29:56 +00:00
ad8ad66b15
feat: Shrink the ai-dynamo wheel by 35 MiB ( #1918 )
...
Remove http and llmctl binaries. They have been unused for a while.
2025-07-14 19:20:35 +00:00
9622caaa7b
docs: Update Discord invite link README.md ( #1599 )
...
Signed-off-by: Meenakshi Sharma <163925564+nvda-mesharma@users.noreply.github.com>
2025-06-20 21:14:28 -07:00
382e3aedc4
docs: Update main readme with Deepwiki and new documentation and examples links ( #1510 )
...
Signed-off-by: Harry Kim <harry_kim@live.com>
2025-06-13 09:13:29 -07:00
98708c46df
docs: add image to front page readme ( #1320 )
...
Signed-off-by: Faradawn Yang <73060648+faradawn@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2025-06-08 16:47:49 -07:00
f7b3ccfcb2
feat: Update container with better EFA/RDMA support ( #1333 )
...
Need to reinstall the rdma-core and libibverbs to use RDMA devices.
Also, docker container can be built using a recent version of UCX for
EFA support.
Signed-off-by: Adit Ranadive <aranadive@nvidia.com>
2025-06-04 12:36:23 -07:00
1e628d5a39
docs: Add docs.nvidia.com userguides link ( #1378 )
2025-06-04 12:34:43 -07:00
b8272a989e
docs: Fix broken link to `support_matrix.md` in `README.md` ( #1201 )
...
Signed-off-by: Hyogeun Oh <ohg3417@gmail.com>
2025-05-27 09:35:50 -07:00
8d636ebdbe
docs: Add sphinx-theme based userguides ( #528 )
...
Signed-off-by: Suman Tatiraju <167138127+statiraju@users.noreply.github.com>
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Kristen Kelleher <kkelleher@nvidia.com>
Co-authored-by: Suman Tatiraju <statiraju@statiraju-mlt.client.nvidia.com>
Co-authored-by: Hannah Zhang <hannahz@nvidia.com>
2025-05-21 22:41:34 +08:00
b82e7327a0
docs: Update README.md with Dynamo meetup announcement ( #1077 )
...
Signed-off-by: Harry Kim <harry_kim@live.com>
2025-05-14 12:01:37 -07:00
412ec84317
docs: add fix for Zsh globbing error with `pip install .[all]` ( #945 )
...
Signed-off-by: Chasing1020 <chasing1020@gmail.com>
2025-05-07 14:35:14 -07:00
Graham King