Commit Graph

12 Commits

Author SHA1 Message Date
Graham King ca31b3aa6b
chore: Remove binding OAIChatPreprocessor (#5516)
Signed-off-by: Graham King <grahamk@nvidia.com>
2026-01-22 08:43:02 +08:00
Tushar Sharma cf433e6825
chore: update all copyright headers in repo to 2026 (#5130)
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
2026-01-02 22:08:23 +00:00
milesial d2faf0e6f5
feat: Runtime media decoder config (#5011)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
2025-12-19 05:34:09 +00:00
milesial 74fcd4a9b9
feat: video decoder in the frontend (#4719)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
2025-12-16 14:28:06 -08:00
milesial 14af074ecd
feat: Media decoder and fetcher options in the MDC (#4094)
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
2025-11-08 02:17:39 +00:00
Graham King 7a5a0bd6cd
chore: Upgrade Rust to 1.90 (#3147)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-09-19 18:54:29 -04:00
Graham King cb5a657a6a
fix: Load the tokenizer JSON once for chat and completions. (#2910)
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-09-05 16:48:16 -04:00
Graham King 3f6a74723f
chore: Remove PreprocessedRequest alias BackendInput (#1307)
It was confusing to have two names for one type.

This tidy up started in #1064 , is now complete.
2025-06-02 11:22:27 -04:00
Graham King a1a10365a7
chore: Split PushRouter from Client (#817)
In a distributed system we don't know if the remote workers need pre-processing done ingress-side or not. Previously Client required us to decide this before discovering the remote endpoints, which was fine because pre-processing was worker-side.

As part of moving pre-processing back to ingress-side we need to split this into two steps:
- Client discovers the endpoints, and (later PR) will fetch their Model Deployment Card.
- PushRouter will use the Model Deployment Card to decide if they need pre-processing or not, which affects the types of the generic parameters.

Part of #743
2025-04-29 14:39:56 +00:00
Neelay Shah 602352ce19 chore: rename dynamo (#44)
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
2025-03-08 01:42:40 -08:00
Neelay Shah 1af7433bff refactor: rename triton_distributed to dynemo (#22)
Co-authored-by: Graham King <grahamk@nvidia.com>
2025-03-05 09:15:46 -08:00
Biswa Panda a32cdad622 feat: add python binding for rust llm modules (#13) 2025-03-04 14:52:09 -08:00