b6603d90d6
feat: add Anthropic Messages API endpoint (/v1/messages) ( #6231 )
...
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Signed-off-by: Marko Kosec <mkosec@nvidia.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Matej Kosec <mkosec@nvidia.com>
2026-02-18 06:11:52 +00:00
8cb47d04d2
feat: responses API compliance with upstream type alignment ( #6089 )
...
Signed-off-by: Matej Kosec <mkosec@nvidia.com>
Co-authored-by: Ishan Dhanani <ishandhanani@gmail.com>
2026-02-12 01:18:28 +00:00
e18840cef3
feat: add Prometheus auto and custom label injection for engine metrics ( #5989 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2026-02-10 21:22:53 -08:00
027d2653a5
feat: expose Python Prometheus metric via DynamoComponentMetrics ( #5817 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2026-02-09 17:10:37 -08:00
e5557803ef
fix: correct SGLang metrics prefix from sglang_ to sglang: ( #5701 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2026-01-27 17:22:10 -08:00
feb6d272ac
chore: nuke ForwardPassMetrics ( #5531 )
...
Signed-off-by: PeaBrane <yanrpei@gmail.com>
2026-01-23 16:26:01 +00:00
0d3ff44000
fix: enable toggling kv events pub/sub (currently nats based) with --no-kv-events flag ( #5237 )
2026-01-09 06:36:51 +00:00
007c5b60a1
fix: sglang metrics and prefill router fix ( #5147 )
2026-01-04 20:46:45 +00:00
cf433e6825
chore: update all copyright headers in repo to 2026 ( #5130 )
...
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
2026-01-02 22:08:23 +00:00
6da23fcf79
test: make serve tests xdist-safe with dynamic ports ( #4951 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-12-16 09:15:24 -08:00
3c2b72b016
fix: [lora] refactor test and clean up examples ( #4884 )
2025-12-11 10:05:00 -08:00
acab636702
test: add ci tests for lora (agg and router) ( #4817 )
2025-12-10 11:35:43 -08:00
f57fd72f88
feat: Add logprobs support to vLLM backend ( #4683 ) ( #4697 )
...
Signed-off-by: Aryan Bagade <aryan@aryanbagade.com>
Signed-off-by: Aryan Bagade <73382554+AryanBagade@users.noreply.github.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
2025-12-10 04:28:33 +00:00
01bfbea15f
feat: Add logprobs support to TRTLLM backend ( #4759 )
...
Signed-off-by: Elijah Soba <esoba@nvidia.com>
2025-12-09 21:40:04 +00:00
00b64ae001
refactor: remove legacy NATS metrics and stats_handler ( #4680 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-12-04 09:59:39 -08:00
0651a4fe44
test: Multimodal Tool Calling vLLM Test ( #4663 )
...
Signed-off-by: Indrajit Bhosale <iamindrajitb@gmail.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
2025-12-03 16:54:11 -08:00
75bf7c9b0f
fix: expose LMCache metrics via Dynamo metrics endpoint ( #4461 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-11-19 21:09:13 -08:00
381c428c11
refactor: change TensorRT-LLM metrics prefix from trtllm: to trtllm_ ( #4269 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-11-13 09:44:37 -08:00
3e015595cc
feat: TensorRT-LLM and SGLang metrics validation (part 2/3 + 3/3) ( #3842 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-10-23 22:15:28 -07:00
bdef0ec566
test: add backend-specific metrics validation for E2E tests (part 1/3, vLLM only) ( #3804 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-10-22 12:40:43 -07:00
f2ba58e568
feat: add Rust-to-Python const code generator for prometheus_names.py ( #3425 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-10-10 11:20:36 -07:00
d809906e62
feat: Add embedding support to sgl backend ( #3427 )
...
Signed-off-by: krishung5 <krish@nvidia.com>
2025-10-07 00:13:16 +00:00
cacac9b9f4
feat: add Python const for Prometheus metric names ( #3244 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-09-30 10:28:47 -07:00
c8ecc4025f
ci: fix completions race ( #3010 )
...
Signed-off-by: alec-flowers <aflowers@nvidia.com>
2025-09-11 19:46:59 +00:00
fae35432d7
ci: longer timeout, change model for l40 ( #2951 )
...
Signed-off-by: alec-flowers <aflowers@nvidia.com>
2025-09-09 10:38:45 -07:00
9320816275
refactor: standardize e2e tests across 3 frameworks ( #2827 )
...
Signed-off-by: alec-flowers <aflowers@nvidia.com>
2025-09-08 23:31:27 +00:00
ishandhanani