Yan Ru Pei
|
07742cc27f
|
feat: move standalone KV indexer into kv-router crate with HTTP integration tests (#6569)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-03-02 10:34:21 -08:00 |
|
Tzu-Ling Kan
|
80cac7c14b
|
feat: Remove Component from public (#6403)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
|
2026-02-23 22:58:38 +00:00 |
|
Yan Ru Pei
|
038b50d2b6
|
feat: add standalone KV indexer with query endpoint [DYN-2164] (#6446)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-02-23 12:12:25 -08:00 |
|
Tzu-Ling Kan
|
42d6980546
|
feat: Remove public uses of CancellationToken (#6405)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
|
2026-02-20 21:01:13 -08:00 |
|
Tzu-Ling Kan
|
0ce3461a9e
|
feat: Add runtime.endpoint() method to eliminate namespace chaining (#6386)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
|
2026-02-19 16:02:37 -05:00 |
|
Yan Ru Pei
|
fc229004b5
|
chore: Remove ZmqKvEventListener binding and rework standalone TRT-LLM example to use native Python ZMQ (#6164)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-19 04:15:13 +00:00 |
|
Tzu-Ling Kan
|
bc8f1170ce
|
feat: Move ModelDeploymentCard to _internal (#6378)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
|
2026-02-18 23:12:18 +00:00 |
|
Ayush Agarwal
|
2ace5a4a3d
|
chore: multimodal endpoint registration via cli modality (#6270)
Signed-off-by: ayushag <ayushag@nvidia.com>
|
2026-02-18 07:59:39 +00:00 |
|
Tzu-Ling Kan
|
5624d14481
|
Rename fetch_llm to fetch_model (#6268)
Signed-off-by: tzulingk@nvidia.com <tzulingk@nvidia.com>
|
2026-02-13 23:22:35 +00:00 |
|
mohammedabdulwahhab
|
a289695c37
|
fix: consolidate dyn_discovery_backend and dyn_kv_store (#6167)
Signed-off-by: mohammedabdulwahhab <furkhan324@berkeley.edu>
|
2026-02-13 19:07:11 +00:00 |
|
ishandhanani
|
2be83be2d8
|
feat: add video generation support (T2V) (#5793)
|
2026-02-13 09:09:56 +00:00 |
|
Yan Ru Pei
|
14eceb43df
|
chore: rename KvPushRouter to KvRouter in python + more bindings removal (#6238)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-12 23:44:52 -08:00 |
|
atchernych
|
5227176057
|
feat: Decomposed pipeline for EPP integration [DEP-730] (#5446)
Signed-off-by: Anna Tchernych <atchernych@nvidia.com>
|
2026-02-13 06:18:29 +00:00 |
|
Yan Ru Pei
|
6a728d1044
|
chore: remove kv indexers bindings (#6159)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-11 20:23:48 +00:00 |
|
Graham King
|
73dc3be81a
|
chore: Merge bindings client and client2 functions (#6158)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2026-02-11 11:51:01 -05:00 |
|
Graham King
|
4f99451bb0
|
feat(frontend): Use vllm for pre and post processing (#5544)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2026-02-10 22:39:11 +00:00 |
|
Ayush Agarwal
|
9f76d0606c
|
feat: text to image vLLM Omni (#5912)
Signed-off-by: ayushag <ayushag@nvidia.com>
|
2026-02-09 18:19:27 -05:00 |
|
Jacky
|
1ffa489ea1
|
refactor: Move --migration-limit flag from backend to frontend (#5918)
Signed-off-by: Jacky <18255193+kthui@users.noreply.github.com>
|
2026-02-06 20:50:55 +00:00 |
|
Yan Ru Pei
|
3e41702211
|
chore: remove and unify bindings in kv.rs (#6016)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-02-06 18:44:46 +00:00 |
|
Biswa Panda
|
953e5d7beb
|
feat(lora): implement HRW-based LoRA allocation system (#5992)
|
2026-02-05 14:56:15 -08:00 |
|
Konrad Nowicki
|
7e970d44c9
|
feat: image diffusion with SGLang diffusion (#5609)
Signed-off-by: Konrad Nowicki <knowicki@nvidia.com>
Co-authored-by: dagil-nvidia <dagil@nvidia.com>
|
2026-02-03 21:19:21 +00:00 |
|
Janelle Cai
|
18d9d1fa4f
|
feat(mocker): pre-fetch model and staggered launches (#5871)
|
2026-02-03 00:46:23 +00:00 |
|
Keiven C
|
7361de4208
|
refactor: reduce Python API to only Prometheus Exposition Format callback (#5594)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
|
2026-01-23 10:06:06 -08:00 |
|
Yan Ru Pei
|
feb6d272ac
|
chore: nuke ForwardPassMetrics (#5531)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2026-01-23 16:26:01 +00:00 |
|
Graham King
|
ca31b3aa6b
|
chore: Remove binding OAIChatPreprocessor (#5516)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2026-01-22 08:43:02 +08:00 |
|
Schwinn Saereesitthipitak
|
d953f9d038
|
feat: add endpoint instance registration/unregistration for sleep/wake (#5203)
Signed-off-by: Schwinn Saereesitthipitak <schwinns@nvidia.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
|
2026-01-20 12:17:58 +00:00 |
|
Graham King
|
a6e7348400
|
chore(bindings): Remove 'Backend' binding (#5458)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2026-01-16 12:29:50 -05:00 |
|
Graham King
|
f6ae58e349
|
fix(llm): Send HF URLs to frontend not full paths (#5290)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2026-01-12 12:05:49 -05:00 |
|
Biswa Panda
|
0d3ff44000
|
fix: enable toggling kv events pub/sub (currently nats based) with --no-kv-events flag (#5237)
|
2026-01-09 06:36:51 +00:00 |
|
Neelay Shah
|
d22d9e761e
|
fix: support truthy values for OTEL_EXPORT_ENABLED in bindings layer [DYN-1690][DYN-1646] (#5129)
Co-authored-by: Claude <noreply@anthropic.com>
|
2026-01-02 23:39:09 +00:00 |
|
Tushar Sharma
|
cf433e6825
|
chore: update all copyright headers in repo to 2026 (#5130)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
|
2026-01-02 22:08:23 +00:00 |
|
Biswa Panda
|
18b64e90b6
|
feat: switch to tcp as default request plane (#4845)
|
2025-12-18 23:05:38 +00:00 |
|
William Arnold
|
3bc129dc37
|
feat: Add python-configurable engine routes for sglang profiling (#4617)
Signed-off-by: William Arnold <7565007+Aphoh@users.noreply.github.com>
|
2025-12-05 10:28:36 -08:00 |
|
Neal Vaidya
|
118323f26e
|
fix: skip HuggingFace download for non-llms (#4686)
Signed-off-by: Neal Vaidya <nealv@nvidia.com>
|
2025-12-04 10:23:24 -08:00 |
|
Biswa Panda
|
71f94eda23
|
feat: lora - centralize lora cache key, restructure folders, s3 resiliency (#4644)
|
2025-12-02 08:57:25 +00:00 |
|
Biswa Panda
|
6a0e67ed78
|
feat: add LoRA common APIs and implementation for lora management (#4464)
|
2025-11-26 20:29:25 +00:00 |
|
Graham King
|
fcb91e4b3d
|
refactor(storage): Remove the stuttering from key_value_store. (#4604)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-25 22:59:29 +00:00 |
|
Biswa Panda
|
781331c6f3
|
feat: unregister discovery instance (#4459)
|
2025-11-19 20:25:44 +00:00 |
|
Graham King
|
69797b5ab3
|
feat: Only monitor NATS metrics if using NATS request plane (#4442)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-19 17:48:49 +00:00 |
|
Biswa Panda
|
684107c461
|
feat: generate deterministic lora id from lora name (#4457)
|
2025-11-19 02:26:00 +00:00 |
|
Keiven C
|
0e77d3442e
|
refactor: centralize environment variable constants (#4083)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
|
2025-11-17 11:16:38 -08:00 |
|
Graham King
|
886506c12d
|
feat: Command line flag to set request plane mode: tcp, http or nats (#4365)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-17 09:02:36 -08:00 |
|
Graham King
|
fbad28602e
|
chore: Remove the python bindings for port allocation (#4237)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-11 20:35:36 +00:00 |
|
Graham King
|
e1af3af6ee
|
chore: Remove static mode (#4235)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-11 19:25:12 +00:00 |
|
Keiven C
|
afccc9d434
|
refactor: consolidate Observability files (e.g. OTEL docker-compose, md files) (#4173)
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
|
2025-11-10 20:19:34 +00:00 |
|
Graham King
|
cf630bf7b6
|
refactor: Make the Runtime and DistributedRuntime fields private (#4193)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-10 15:56:22 +00:00 |
|
milesial
|
14af074ecd
|
feat: Media decoder and fetcher options in the MDC (#4094)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
|
2025-11-08 02:17:39 +00:00 |
|
Graham King
|
794c0a4431
|
feat(keyvalue): Filesystem backed KeyValueStore (#4138)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-07 21:11:33 +00:00 |
|
Graham King
|
dadf0e2247
|
chore: Remove old DisaggregatedRouter, making etcd presence optional (#4011)
Signed-off-by: Graham King <grahamk@nvidia.com>
|
2025-11-03 10:10:13 -05:00 |
|
Yan Ru Pei
|
6ff49edbb7
|
feat: efficient serving of multiple mockers (#3997)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
|
2025-11-01 01:24:55 +00:00 |