cd4773fb31
feat: ForwardPassMetrics dynamo event plane integration ( #7250 )
...
Signed-off-by: hongkuanz <hongkuanz@nvidia.com>
2026-03-12 20:58:01 +00:00
a6e7348400
chore(bindings): Remove 'Backend' binding ( #5458 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2026-01-16 12:29:50 -05:00
cf433e6825
chore: update all copyright headers in repo to 2026 ( #5130 )
...
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
2026-01-02 22:08:23 +00:00
6a0e67ed78
feat: add LoRA common APIs and implementation for lora management ( #4464 )
2025-11-26 20:29:25 +00:00
dadf0e2247
chore: Remove old DisaggregatedRouter, making etcd presence optional ( #4011 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-03 10:10:13 -05:00
6afa679c5d
chore: KVBM pip wheel ( #3826 )
...
Signed-off-by: Anant Sharma <anants@nvidia.com>
Co-authored-by: Anant Sharma <anants@nvidia.com>
2025-10-31 14:19:30 -07:00
f88d7dc74b
chore(bindings): Remove NatsQueue ( #3086 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-09-17 12:46:54 -04:00
07cfc3a11b
feat: kvbm + connector ( #2258 )
...
Signed-off-by: Ryan Olson <rolson@nvidia.com>
Co-authored-by: Olga Andreeva <oandreeva@nvidia.com>
Co-authored-by: Ziqi Fan <ziqif@nvidia.com>
Co-authored-by: John Thompson <jothomson@nvidia.com>
Co-authored-by: Richard Huo <rihuo@nvidia.com>
Co-authored-by: Zicheng Ma <zichengm@nvidia.com>
2025-08-19 12:36:53 -07:00
d0a6363584
feat: add RuntimeConfig to ModelEntry ( #2311 )
...
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
2025-08-14 10:19:53 -07:00
2bf27924a1
feat(python): Python bindings for the Dynamo CLI tools ( #1799 )
2025-07-08 21:40:36 +00:00
437cae0ad0
feat: KV Block Manager Python bindings ( #1022 )
2025-05-19 12:33:41 -04:00
c4213899fe
feat: Migrate NATS Queue to Rust ( #669 ) ( #961 )
2025-05-06 15:36:55 -07:00
447840c223
docs: add docstring for llm.rs ( #267 )
2025-04-10 22:40:09 -04:00
19844fc07e
feat: kv aware router + disagg router + prefill queue ( #11 )
...
Signed-off-by: Hongkuan Zhou <tedzhouhk@gmail.com>
Co-authored-by: hongkuan <hongkuanz@nvidia.com>
Co-authored-by: Piotr Tarasiewicz <ptarasiewicz@nvidia.com>
Co-authored-by: Piotr Tarasiewicz Nvidia <ptarasiewicznv@Piotrs-MacBook-Pro.local>
Co-authored-by: alec-flowers <aflowers@nvidia.com>
Co-authored-by: Neelay Shah <neelays@nvidia.com>
2025-03-08 17:09:11 -08:00
a32cdad622
feat: add python binding for rust llm modules ( #13 )
2025-03-04 14:52:09 -08:00
08fcd7e93b
refactor: move libs to lib dir
...
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
2025-02-24 18:21:02 -08:00
Hongkuan Zhou