dynamo/lib/llm/src
Biswa Panda 947939c727
fix: populate logprobs bytes and token fields in OpenAI-compatible responses (#6953)
2026-03-13 22:59:29 +00:00
..
audit feat: Standardized Dynamo Error Type (#6303) 2026-02-23 20:23:58 -08:00
bin feat: add Anthropic Messages API endpoint (/v1/messages) (#6231) 2026-02-18 06:11:52 +00:00
block_manager fix: harden numa cpuset lookup (#7060) 2026-03-12 20:38:23 -07:00
common fix(llm): Send HF URLs to frontend not full paths (#5290) 2026-01-12 12:05:49 -05:00
discovery feat(kv-router): add worker_type to router selection log (#7258) 2026-03-12 23:14:28 +00:00
entrypoint fix: restore --enforce-disagg to reject requests before prefill router activates (#6957) 2026-03-06 04:39:28 +00:00
grpc feat: upgrade rust to v1.93.0 (#6802) 2026-03-03 17:08:35 +00:00
http feat: streaming tool call and reasoning dispatch SSE events (#7114) 2026-03-11 15:24:39 -07:00
kernels chore: update all copyright headers in repo to 2026 (#5130) 2026-01-02 22:08:23 +00:00
kv chore: update all copyright headers in repo to 2026 (#5130) 2026-01-02 22:08:23 +00:00
kv_router feat(kv-router): pluggable scheduling policy for router queue [DYN-2454] (#7260) 2026-03-13 04:16:49 +00:00
local_model fix: properly setup and register vLLM worker for external / hybrid load balancing. Update launch script (#6695) 2026-03-03 14:00:52 -08:00
lora fix: extend LoRA download S3 timeout and stream large LoRA downloads to disk (#6544) 2026-03-05 20:53:43 +00:00
perf feat: text to image vLLM Omni (#5912) 2026-02-09 18:19:27 -05:00
preprocessor fix: respect per-request chat_template_kwargs for DeepSeek V3.2 thinking mode (#7286) 2026-03-12 09:36:51 -04:00
protocols fix: populate logprobs bytes and token fields in OpenAI-compatible responses (#6953) 2026-03-13 22:59:29 +00:00
tokenizers fix: Kimi K2.5 - tiktoken incomplete multi-byte sequence handling with regression tests (#6996) 2026-03-06 18:27:16 +00:00
utils chore: update all copyright headers in repo to 2026 (#5130) 2026-01-02 22:08:23 +00:00
backend.rs fix: Kimi K2.5 - tiktoken incomplete multi-byte sequence handling with regression tests (#6996) 2026-03-06 18:27:16 +00:00
block_manager.md feat: kvbm + connector (#2258) 2025-08-19 12:36:53 -07:00
block_manager.rs chore: update all copyright headers in repo to 2026 (#5130) 2026-01-02 22:08:23 +00:00
common.rs chore: update all copyright headers in repo to 2026 (#5130) 2026-01-02 22:08:23 +00:00
cuda.rs chore: update all copyright headers in repo to 2026 (#5130) 2026-01-02 22:08:23 +00:00
discovery.rs feat(runtime): add hierarchical Model/WorkerSet architecture for multi-namespace support (#6054) 2026-02-23 22:44:38 +00:00
endpoint_type.rs chore: multimodal endpoint registration via cli modality (#6270) 2026-02-18 07:59:39 +00:00
engines.rs feat: Standardized Dynamo Error Type (#6303) 2026-02-23 20:23:58 -08:00
entrypoint.rs fix: restore --enforce-disagg to reject requests before prefill router activates (#6957) 2026-03-06 04:39:28 +00:00
fpm_publisher.rs feat: ForwardPassMetrics dynamo event plane integration (#7250) 2026-03-12 20:58:01 +00:00
grpc.rs chore: update all copyright headers in repo to 2026 (#5130) 2026-01-02 22:08:23 +00:00
http.rs chore: update all copyright headers in repo to 2026 (#5130) 2026-01-02 22:08:23 +00:00
hub.rs feat: Tiktoken support (#6460) 2026-02-25 12:46:47 -08:00
kv.rs chore: update all copyright headers in repo to 2026 (#5130) 2026-01-02 22:08:23 +00:00
kv_router.rs fix: cancellation kv commit router (#7178) 2026-03-13 01:33:46 +00:00
lib.rs feat: ForwardPassMetrics dynamo event plane integration (#7250) 2026-03-12 20:58:01 +00:00
local_model.rs fix: llm/mocker: Remove the llm -> mocker crate dependency, move config (#6998) 2026-03-06 09:41:39 -08:00
lora.rs feat(lora): implement HRW-based LoRA allocation system (#5992) 2026-02-05 14:56:15 -08:00
migration.rs feat: Standardized Dynamo Error Type (#6303) 2026-02-23 20:23:58 -08:00
mocker.rs feat(kv-router): ZMQ gap detection + replay for standalone indexer [LLM-126] (#7209) 2026-03-12 10:46:01 -07:00
model_card.rs feat: Tiktoken support (#6460) 2026-02-25 12:46:47 -08:00
model_type.rs feat: vllm omni text to video generation pipeline (#6104) 2026-02-20 04:23:44 +00:00
namespace.rs feat(runtime): add hierarchical Model/WorkerSet architecture for multi-namespace support (#6054) 2026-02-23 22:44:38 +00:00
perf.rs chore: update all copyright headers in repo to 2026 (#5130) 2026-01-02 22:08:23 +00:00
preprocessor.rs fix: respect per-request chat_template_kwargs for DeepSeek V3.2 thinking mode (#7286) 2026-03-12 09:36:51 -04:00
protocols.rs feat: add Anthropic Messages API endpoint (/v1/messages) (#6231) 2026-02-18 06:11:52 +00:00
recorder.rs test: Expand time range for flaky recorder test to improve stability (#5315) 2026-01-09 20:09:22 +00:00
request_template.rs chore: update all copyright headers in repo to 2026 (#5130) 2026-01-02 22:08:23 +00:00
tokenizers.rs fix: Kimi K2.5 - tiktoken incomplete multi-byte sequence handling with regression tests (#6996) 2026-03-06 18:27:16 +00:00
tokens.rs chore: make core kv-router its own crate (#5677) 2026-01-28 10:42:53 +00:00
types.rs feat: add video generation support (T2V) (#5793) 2026-02-13 09:09:56 +00:00