Commit Graph

29 Commits

Author SHA1 Message Date
Kris Hung d43be1f362
fix: Fix chat processor for vllm video/audio examples (#6689) 2026-02-27 14:19:30 -08:00
Blake Ledden f6d4351f4d
fix: Forward stream_options through multimodal request pipeline (#6474)
Signed-off-by: Blake Ledden <blake.ledden@gmail.com>
2026-02-25 18:36:34 -06:00
Tzu-Ling Kan 0ce3461a9e
feat: Add runtime.endpoint() method to eliminate namespace chaining (#6386)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
2026-02-19 16:02:37 -05:00
Biswa Panda 4ba48b7993
feat: add model field to multimodal protocol for LoRA identity (#6382) 2026-02-19 12:48:00 -08:00
Tzu-Ling Kan 5624d14481
Rename fetch_llm to fetch_model (#6268)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
2026-02-13 23:22:35 +00:00
jh-nv e22bb0376f
fix: Properly handle multiple text components from request (#5196) 2026-01-14 11:13:22 -05:00
Alec a1333a8ddb
fix: update vLLM to 0.13.0 with API compatibility fixes (#5222)
Signed-off-by: Vasilis Vagias <vvagias@nvidia.com>
Signed-off-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Vasilis Vagias <vvagias@nvidia.com>
2026-01-06 15:08:08 -08:00
Tanmay Verma 2b157d89c2
fix: Allow requests to include audio contents before text (#5143) 2026-01-05 19:38:25 +00:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
2026-01-02 22:08:23 +00:00
Kris Hung 0173d5e6fb
fix: Fix multimodal EPD examples for vllm version bump (#4849) 2025-12-10 20:24:32 +00:00
Graham King 69797b5ab3
feat: Only monitor NATS metrics if using NATS request plane (#4442)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-19 17:48:49 +00:00
Yuekai Zhang 0f5dd2b780
feat: Add vLLM multimodal audio support (#2760)
Signed-off-by: Yuekai Zhang <zhangyuekai@foxmail.com>
Signed-off-by: krishung5 <krish@nvidia.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
2025-11-13 13:55:48 -08:00
Graham King e1af3af6ee
chore: Remove static mode (#4235)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-11 19:25:12 +00:00
Kris Hung 069434b418
fix: Fix vllm multimodal tests (#3361)
Signed-off-by: krishung5 <krish@nvidia.com>
2025-10-06 10:49:41 -07:00
Biswa Panda 960dc8967e
fix: replace hard coded dynamo namespace with env var (#3048)
Signed-off-by: Biswa Panda <biswa.panda@gmail.com>
2025-09-16 14:56:51 -07:00
Olga Andreeva 27fad26faf
refactor: Split ModelType to ModelInput for request and response type; ModelType for the supported workloads (#2714)
Signed-off-by: Guan Luo <gluo@nvidia.com>
Signed-off-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
Co-authored-by: Guan Luo <gluo@nvidia.com>
Co-authored-by: GuanLuo <41310872+GuanLuo@users.noreply.github.com>
2025-09-03 22:22:37 +00:00
Tzu-Ling Kan dea5f88756
feat: Metrics labels for multimodal. (#2835)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
2025-09-03 19:18:42 +00:00
Kris Hung 78a1107441
feat: Add vLLM multimodal video support (#2738)
Signed-off-by: krishung5 <krish@nvidia.com>
2025-08-28 03:41:56 +00:00
Alec 9b9f2ce4f6
fix: pytest robustness and parsing error (#2676) 2025-08-24 10:13:41 -07:00
Ryan McCormick 844f8819a1
docs: Bring back some missed release/0.4.0 doc changes, fix broken links, add lychee link checker github action (#2482) 2025-08-18 10:26:15 -07:00
GuanLuo 4dc529a1cc
chore: remove vLLM v0 multimodal example (#2099) 2025-07-25 15:22:33 -07:00
hhzhang16 e924a7c7c0
feat: generalize VLM embedding extraction (#1388)
Signed-off-by: hhzhang16 <54051230+hhzhang16@users.noreply.github.com>
Co-authored-by: Kris Hung <krish@nvidia.com>
2025-06-11 14:42:14 -07:00
hhzhang16 b80482a4b2
feat: set model specific prompt templates in the multimodal config files, add documentation for multimodal example deployment (#1366) 2025-06-04 11:47:20 -07:00
Kris Hung 92e33b86d8
perf: Create default sampling params only once during initialization (#1294) 2025-05-30 15:02:18 -07:00
Kris Hung 5a30923f08
feat: Support OAI frontend format and add async image handing for multimodal (#1214)
Co-authored-by: J Wyman <jwyman@nvidia.com>
2025-05-28 16:38:01 -07:00
J Wyman 75e774d431
feat: NIXL Based RDMA Support w/ Multimodal Example (#1060) 2025-05-27 12:29:53 -07:00
Biswa Panda 6d46288c0c
feat: rename dynamo decorator (#1133) 2025-05-21 06:43:05 -07:00
Biswa Panda d675d2218e
feat: decouple dynamo sdk to support mutiple deployment targets (#905) 2025-05-09 06:44:06 +00:00
Kris Hung 58df5aca4c
feat: Add multimodal example with aggregated serving (#709) 2025-05-02 12:45:31 -07:00