Alec
|
6d3b92f04e
|
feat: remove --connector flag for vLLM backend (LLM-90) (#6450)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-24 17:49:00 +00:00 |
|
Tzu-Ling Kan
|
80cac7c14b
|
feat: Remove Component from public (#6403)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
|
2026-02-23 22:58:38 +00:00 |
|
Biswa Panda
|
04a532edc4
|
feat: add multimodal lora docs and deployment example for k8s (#6452)
|
2026-02-23 10:49:46 -07:00 |
|
Biswa Panda
|
a28c5f3a56
|
feat: add examples for multimodal loras (#6400)
|
2026-02-19 15:23:25 -08:00 |
|
Tzu-Ling Kan
|
0ce3461a9e
|
feat: Add runtime.endpoint() method to eliminate namespace chaining (#6386)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
|
2026-02-19 16:02:37 -05:00 |
|
Biswa Panda
|
4ba48b7993
|
feat: add model field to multimodal protocol for LoRA identity (#6382)
|
2026-02-19 12:48:00 -08:00 |
|
Tzu-Ling Kan
|
5624d14481
|
Rename fetch_llm to fetch_model (#6268)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
|
2026-02-13 23:22:35 +00:00 |
|
Yan Ru Pei
|
14eceb43df
|
chore: rename KvPushRouter to KvRouter in python + more bindings removal (#6238)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-12 23:44:52 -08:00 |
|
dagil-nvidia
|
b6824ae095
|
fix: restrict Image.open() formats to prevent PSD parsing (workaround) (#6212)
Signed-off-by: Dan Gil <dagil@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
|
2026-02-11 15:40:20 -08:00 |
|
Yan Ru Pei
|
3e41702211
|
chore: remove and unify bindings in kv.rs (#6016)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-06 18:44:46 +00:00 |
|
Indrajit Bhosale
|
842f0f15ec
|
fix: VLLM Multimodal minor fixes (#5748)
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
|
2026-01-29 02:45:41 +00:00 |
|
Yan Ru Pei
|
feb6d272ac
|
chore: nuke ForwardPassMetrics (#5531)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-01-23 16:26:01 +00:00 |
|
Yan Ru Pei
|
03162161e4
|
chore: default python hash seed to zero always for the engines (#5583)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-01-22 17:20:24 -08:00 |
|
Graham King
|
c5458b9954
|
chore(router): Remove deprecated best_worker_id and metrics_labels (#5412)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2026-01-14 16:20:42 +00:00 |
|
jh-nv
|
e22bb0376f
|
fix: Properly handle multiple text components from request (#5196)
|
2026-01-14 11:13:22 -05:00 |
|
hhzhang16
|
c8770464ab
|
feat: normalize dynamo namespace computation (#5231)
Signed-off-by: Hannah Zhang <hannahz@nvidia.com>
|
2026-01-12 19:09:43 +00:00 |
|
Alec
|
a1333a8ddb
|
fix: update vLLM to 0.13.0 with API compatibility fixes (#5222)
Signed-off-by: Vasilis Vagias <vvagias@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Vasilis Vagias <vvagias@nvidia.com>
|
2026-01-06 15:08:08 -08:00 |
|
Tanmay Verma
|
2b157d89c2
|
fix: Allow requests to include audio contents before text (#5143)
|
2026-01-05 19:38:25 +00:00 |
|
GuanLuo
|
cd8dddeec8
|
fix: revert audio_agg.sh change from #4849 (#5131)
Signed-off-by: Guan Luo <gluo@nvidia.com>
|
2026-01-02 23:54:03 +00:00 |
|
Tushar Sharma
|
cf433e6825
|
chore: update all copyright headers in repo to 2026 (#5130)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
|
2026-01-02 22:08:23 +00:00 |
|
Kris Hung
|
0173d5e6fb
|
fix: Fix multimodal EPD examples for vllm version bump (#4849)
|
2025-12-10 20:24:32 +00:00 |
|
J Wyman
|
96fe63fe2e
|
feat: nixl_connect: Improve Concurrency Support (#4433)
Signed-off-by: J Wyman <jwyman@nvidia.com>
|
2025-12-09 17:29:22 -05:00 |
|
Julien Debache
|
db5687f535
|
fix: adjust usage of vLLM for deprecation of 'disable_log_requests' (#4659)
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
|
2025-12-03 08:52:41 +00:00 |
|
Graham King
|
69797b5ab3
|
feat: Only monitor NATS metrics if using NATS request plane (#4442)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-19 17:48:49 +00:00 |
|
Kris Hung
|
1e120ed049
|
docs: Update vllm multimodal EPD doc (#4352)
|
2025-11-15 00:39:21 -08:00 |
|
Yuekai Zhang
|
0f5dd2b780
|
feat: Add vLLM multimodal audio support (#2760)
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
|
2025-11-13 13:55:48 -08:00 |
|
Ayush Agarwal
|
4adab52df2
|
chore: llama4 multimodal disagg support migration (#4213)
Signed-off-by: ayushag <ayushag@nvidia.com>
|
2025-11-13 17:38:35 +00:00 |
|
Graham King
|
e1af3af6ee
|
chore: Remove static mode (#4235)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-11 19:25:12 +00:00 |
|
Ayush Agarwal
|
06bc1580b2
|
chore: mm epd disagg (#4151)
Signed-off-by: ayushag <ayushag@nvidia.com>
|
2025-11-10 04:55:48 +00:00 |
|
Neelay Shah
|
6f8fd8655c
|
refactor: align multimodal example port allocation with vLLM components (#4163)
Co-authored-by: Claude <noreply@anthropic.com>
|
2025-11-07 13:24:10 -08:00 |
|
Ayush Agarwal
|
22d910a5cd
|
chore: support for agg llama4 mulimodal (#3984)
Signed-off-by: ayushag <ayushag@nvidia.com>
|
2025-10-30 22:08:43 +00:00 |
|
Ayush Agarwal
|
52090e2e76
|
feat: refactor vllm multimodal example (#3634)
Signed-off-by: ayushag <ayushag@nvidia.com>
|
2025-10-29 19:31:06 +00:00 |
|
Graham King
|
c78b590134
|
chore(runtime): Do not expose etcd lease ID (#3915)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-10-28 16:20:25 +00:00 |
|
Kris Hung
|
9b0948c62f
|
fix: Fix vllm multimodal qwen cuda oom issue (#3598)
|
2025-10-13 19:39:13 -07:00 |
|
Alec
|
90dc758938
|
chore: bump vllm to 0.11.0 (#3422)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
|
2025-10-12 14:26:45 -07:00 |
|
Anant Sharma
|
0a2a820bca
|
docs: move all md files from components to docs (#3440)
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anish <80174047+athreesh@users.noreply.github.com>
|
2025-10-10 03:39:26 +00:00 |
|
Kris Hung
|
069434b418
|
fix: Fix vllm multimodal tests (#3361)
Signed-off-by: krishung5 <krish@nvidia.com>
|
2025-10-06 10:49:41 -07:00 |
|
Kris Hung
|
62661cce3c
|
feat: Add multimodal EPD for Sglang (#3230)
Signed-off-by: krishung5 <krish@nvidia.com>
|
2025-10-01 21:46:18 -07:00 |
|
Alec
|
5bb7490448
|
chore: bump vllm version to 0.10.2 (#3180)
Signed-off-by: Alec <aflowers@nvidia.com>
Signed-off-by: Alec <35311602+alec-flowers@users.noreply.github.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
|
2025-09-26 04:01:57 +00:00 |
|
Graham King
|
3865a94148
|
feat: Port vllm port allocator to Rust in bindings (#3125)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-09-19 18:34:52 +00:00 |
|
Graham King
|
b6595e2484
|
chore(bindings): Provide a binding to clear etcd namespace (#3094)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-09-18 11:49:08 -04:00 |
|
Biswa Panda
|
960dc8967e
|
fix: replace hard coded dynamo namespace with env var (#3048)
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
|
2025-09-16 14:56:51 -07:00 |
|
Alec
|
9320816275
|
refactor: standardize e2e tests across 3 frameworks (#2827)
Signed-off-by: alec-flowers <aflowers@nvidia.com>
|
2025-09-08 23:31:27 +00:00 |
|
GuanLuo
|
9ef1328981
|
fix: use correct prompt template in agg_qwen.yaml (#2909)
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
|
2025-09-05 13:05:45 -07:00 |
|
Yan Ru Pei
|
1995ef9aee
|
docs: change docs to default port 8000 (#2876)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2025-09-05 01:16:53 +00:00 |
|
GuanLuo
|
c403d18a92
|
chore: add agg_qwen.yaml to multimodal deploy (#2872)
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
|
2025-09-04 15:17:26 -04:00 |
|
Olga Andreeva
|
27fad26faf
|
refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
|
2025-09-03 22:22:37 +00:00 |
|
Tzu-Ling Kan
|
dea5f88756
|
feat: Metrics labels for multimodal. (#2835)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
|
2025-09-03 19:18:42 +00:00 |
|
Kris Hung
|
78a1107441
|
feat: Add vLLM multimodal video support (#2738)
Signed-off-by: krishung5 <krish@nvidia.com>
|
2025-08-28 03:41:56 +00:00 |
|
Kris Hung
|
50cd81f320
|
feat: Add vllm multimodal qwen aggregated support (#2694)
|
2025-08-26 14:18:39 -07:00 |