Commit Graph

11 Commits

Author SHA1 Message Date
Keiven C a713270ccf
fix: Move NATS max_payload from invalid CLI flag to config file (#5384)
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2026-01-13 11:48:04 -08:00
Wenqi Glantz 6f9619a210
feat(vllm): Add prompt embeds support for pre-computed inference inputs (#4739)
Signed-off-by: Wenqi Glantz <wglantz@nvidia.com>
2026-01-08 20:03:10 +00:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
2026-01-02 22:08:23 +00:00
Keiven C afccc9d434
refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-11-10 20:19:34 +00:00
julienmancuso 58d2699d63
feat: Add support for model express url injection (#2769)
Signed-off-by: Julien Mancuso <jmancuso@nvidia.com>
2025-09-02 09:48:42 -06:00
Keiven C 4498a77d0b
fix: move docker-compose.yml to deploy/, and update frontend port (#2121)
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-07-25 23:07:57 +00:00
hhzhang16 403344e534
refactor: refactor dynamo deploy subfolder (#927) 2025-05-06 17:39:18 +00:00
Ryan McCormick c8737c1f94 fix: Fix KV Cache Hit Rate Metrics and Misc QoL Updates (#199) 2025-03-16 20:13:02 -07:00
Neelay Shah ac13ed0676 refactor: rename count to metrics and move location (#21) 2025-03-06 20:28:55 -05:00
NVShreyas 12d73a824a Updates to support DS R1 in TRTLLM example (#301) 2025-02-28 08:04:12 -06:00
Neelay Shah 08fcd7e93b refactor: move libs to lib dir
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
2025-02-24 18:21:02 -08:00