Commit Graph

44 Commits

Author SHA1 Message Date
Jacky 1ffa489ea1
refactor: Move --migration-limit flag from backend to frontend (#5918)
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
2026-02-06 20:50:55 +00:00
dagil-nvidia b19de4ed77
docs: cleanup of docs refactor for components, integrations, and features (#6019)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-05 19:50:17 -08:00
akshatha-k 80e7bafd37
docs: Migrate router documentation to three-tier structure (#5979)
Signed-off-by: akshatha-k <akshutk@gmail.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-06 01:55:50 +00:00
dagil-nvidia 400126d2bc
docs: migrate Frontend docs to three-tier structure (#6002)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-06 01:00:52 +00:00
dagil-nvidia 4d9e64a2c1
docs: update support matrix with backend dependencies for Dynamo 0.9.0 + 1.0.0 (#5932) 2026-02-04 11:39:48 -06:00
Jacky 934d03c545
fix: Disable calls to abort() at TRT-LLM backend - temporary (#5827)
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
2026-01-30 15:03:30 -08:00
dagil-nvidia a4600927f5
docs: transpose backend dependency tables, extend to v0.6.0 (#5663)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
2026-01-30 18:31:23 +00:00
dagil-nvidia e8c7bbf3d5
docs: refactor Dynamo readme.md and quick_start_local.rst (#5649)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-01-30 18:27:30 +00:00
Tanmay Verma ba711cc1ac
chore: Upgrade to Tensorrt-LLM 1.3.0rc1 (#5700)
Co-authored-by: Pavithra Vijayakrishnan <160681768+pvijayakrish@users.noreply.github.com>
2026-01-29 15:20:58 -08:00
Alec 63bee8b303
chore: bump vLLM to 0.14.1 (#5691)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
2026-01-27 19:51:29 -08:00
Pavithra Vijayakrishnan 66c369964a
chore: version update for 0.9.0 (#5661)
Signed-off-by: pvijayakrish <pvijayakrish@nvidia.com>
2026-01-26 17:18:05 -08:00
ishandhanani 4f981e282a
feat: sglang update to 0.5.8 (#5655) 2026-01-26 23:46:05 +00:00
dagil-nvidia f238d23a4d
docs: reduce admonition clutter in reference docs (#5646)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-01-26 13:50:46 -06:00
dagil-nvidia 248073455a
docs: add release-artifacts.md with comprehensive artifact inventory (#5619)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
2026-01-26 12:42:56 -06:00
Alec 50f1e0e17a
chore(deps): bump vLLM to 0.14.0 (#5593)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Signed-off-by: Alec Flowers <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-24 01:19:06 +00:00
jthomson04 64ba7dd068
chore: Bump TRTLLM to 1.2.0rc6.post2 (#5580)
Signed-off-by: jthomson04 <jwillthomson19@gmail.com>
2026-01-22 20:23:40 -08:00
dagil-nvidia a7bc38d7c5
docs: update vLLM flag for local dev without NATS (#5587)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2026-01-22 20:58:46 -05:00
Nate Mailhot 6dba119d7a
chore: update nixl to 0.9.0 (#5528) 2026-01-22 15:25:03 -08:00
dagil-nvidia 4ed8584a4a
docs: add feature compatibility matrix and update support matrix for v0.8.0 (#5349)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Signed-off-by: dagil-nvidia <dagil@nvidia.com>
2026-01-13 13:14:50 -06:00
Tanmay Verma abd4b5d9a0
chore: Upgrade to tensorrt_llm==1.2.0rc6.post1 (#5356) 2026-01-12 18:58:00 +00:00
ishandhanani 92748c937f
feat: sglang update to 0.5.7 (#5148) 2026-01-08 17:00:03 +08:00
Alec a1333a8ddb
fix: update vLLM to 0.13.0 with API compatibility fixes (#5222)
Signed-off-by: Vasilis Vagias <vvagias@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Vasilis Vagias <vvagias@nvidia.com>
2026-01-06 15:08:08 -08:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
2026-01-02 22:08:23 +00:00
Nate Mailhot 3c7ed61d05
chore: TRTLLM 1.2.0rc6 (#5017)
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
2026-01-02 10:29:04 -08:00
Thomas Montfort 3057af00b6
feat(dep-715): refactor helm directory and remove reference to cloud (#5042) 2025-12-23 12:08:19 -05:00
ishandhanani 3e0459fb01
feat: bump sglang to `0.5.6.post2` and swap to upstream runtime container (#4762)
Signed-off-by: Dillon Cullinan <dcullinan@nvidia.com>
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
Co-authored-by: Dillon Cullinan <dcullinan@nvidia.com>
Co-authored-by: Dmitry Tokarev <dtokarev@nvidia.com>
2025-12-19 18:33:04 -05:00
MatejKosec 6979710a7e
fix(operator): vLLM multi-node support for TP and DP (#5006) 2025-12-19 13:16:44 -08:00
Nate Mailhot 910b587db1
chore: update nixl to 0.8.0 and ucx 1.20 (#5007)
Signed-off-by: Nate Mailhot <nmailhot@nvidia.com>
2025-12-19 10:55:40 -08:00
Anant Sharma 7436e3bc03
chore: update versions for 0.8.0 release (#5031)
Signed-off-by: Anant Sharma <anants@nvidia.com>
2025-12-19 10:21:52 -08:00
Anant Sharma 5b82b8b096
chore: update versions to match latest release (#4966)
Signed-off-by: Anant Sharma <anants@nvidia.com>
2025-12-18 08:45:44 -08:00
dagil-nvidia 8189e854f7
docs: update support matrix with build dependency version history (#4953)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2025-12-15 15:32:01 +00:00
Dmitry Tokarev 525030324e
chore: TRTLLM 1.2.0rc4 (#4836)
Signed-off-by: Dmitry Tokarev <dtokarev@nvidia.com>
2025-12-11 03:02:24 +00:00
dagil-nvidia 445b4bd906
docs: remove frontend image from support matrix (#4589)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2025-11-25 21:19:37 +00:00
dagil-nvidia 25fd32ab0c
docs: update support matrix for Dynamo 0.7.0 (#4550)
Signed-off-by: Dan Gil <dagil@nvidia.com>
2025-11-24 21:14:14 +00:00
Yan Ru Pei c61e0dd3cc
chore: merge KvIndexer and ApproxKvIndexer (#4500)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2025-11-21 09:09:11 -08:00
Graham King 69797b5ab3
feat: Only monitor NATS metrics if using NATS request plane (#4442)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-19 17:48:49 +00:00
Kyle McGill 0b8b7ffb73
chore: Upgrade NIXL to 0.7.1 and allow KVBM to pick NIXL cuda 12 or 13 (#4281)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
Co-authored-by: Tushar Sharma <tusharma@nvidia.com>
2025-11-19 08:18:31 -08:00
Graham King e1af3af6ee
chore: Remove static mode (#4235)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-11 19:25:12 +00:00
Anant Sharma 23660bc5c3
chore: update versions for 0.7.0 release (#4217)
Signed-off-by: Anant Sharma <anants@nvidia.com>
2025-11-10 21:40:06 +00:00
Anant Sharma 8bd37c96d6
refactor: move backend deploy, launch and slurm files from components to examples (#3849)
Signed-off-by: Anant Sharma <anants@nvidia.com>
2025-10-31 13:09:46 -04:00
Tushar Sharma 1da9d70ab1
chore: bump nixl verison to 0.7.0 (#3936)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
2025-10-30 10:28:17 -07:00
Tushar Sharma 9bb1af3376
chore: Update version to 0.6.1 (#3916)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
2025-10-27 17:17:26 -04:00
Anish c6b5904579
docs: address Harry/VDR feedback + fixing broken links across repository (#3802)
Signed-off-by: Harry Kim <harry_kim@live.com>
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Signed-off-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
Co-authored-by: Harry Kim <harry_kim@live.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: akshatha-k <33278067+akshatha-k@users.noreply.github.com>
Co-authored-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
2025-10-22 19:56:24 -04:00
Anish 598cbbb73b
docs: reorganizing documentation to make things clearer (#3658)
Signed-off-by: athreesh <anish.maddipoti@utexas.edu>
Co-authored-by: Claude <noreply@anthropic.com>
2025-10-16 23:59:59 +00:00