dynamo/lib/bindings/python/rust/llm
Jorge António d0a6363584
feat: add RuntimeConfig to ModelEntry (#2311)
Co-authored-by: Yan Ru Pei <yanrpei@gmail.com>
2025-08-14 10:19:53 -07:00
..
block_manager feat: KVBM async Python bindings and Layer class (#1141) 2025-05-29 17:49:05 +00:00
backend.rs chore: Remove PreprocessedRequest alias BackendInput (#1307) 2025-06-02 11:22:27 -04:00
block_manager.rs feat: KVBM async Python bindings and Layer class (#1141) 2025-05-29 17:49:05 +00:00
disagg_router.rs feat: kv aware router + disagg router + prefill queue (#11) 2025-03-08 17:09:11 -08:00
entrypoint.rs feat: add RuntimeConfig to ModelEntry (#2311) 2025-08-14 10:19:53 -07:00
kv.rs feat: predictive active blocks for routing without load metrics (#1731) 2025-07-08 00:18:22 -07:00
local_model.rs feat: add RuntimeConfig to ModelEntry (#2311) 2025-08-14 10:19:53 -07:00
model_card.rs chore: Remove service_name from ModelDeploymentCard (#2349) 2025-08-07 11:02:41 -04:00
nats.rs feat: cleanup EtcdKvCache and PrefillQueue before and after launch (#925) 2025-05-07 16:35:55 -07:00
preprocessor.rs chore: Remove PreprocessedRequest alias BackendInput (#1307) 2025-06-02 11:22:27 -04:00