cd2389baef
chore: pre-0.6.0 activities ( #3592 )
...
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
2025-10-13 17:45:19 -04:00
980727bba1
chore: bump versions ahead of 0.5.1 release ( #3209 )
...
Signed-off-by: Harrison Saturley-Hall <hsaturleyhal@nvidia.com>
2025-09-24 18:26:38 -04:00
561ecb98a2
chore: bump version numbers ahead of 0.5.0 release ( #2812 )
...
Signed-off-by: Harrison King Saturley-Hall <hsaturleyhal@nvidia.com>
2025-09-02 16:13:28 -04:00
9a02188531
chore: Bumped Dynamo version to 0.4.1 ( #2545 )
2025-08-19 21:55:37 -04:00
177d662f86
fix: Dockerfile.sglang - Fixed sglang and dynamo wheels installaiton in ru… ( #2537 )
2025-08-19 20:56:12 -04:00
ffae72b7d2
fix: remove kvmanager feature from python 3.12 ai-dynamo-runtime wheel ( #2456 )
2025-08-15 16:43:55 -04:00
e61f1c8a40
chore: Remove nats-py dependency ( #1387 )
2025-06-05 15:50:36 -07:00
7e452a2e22
fix: Disable block manager by default in Python bindings ( #1128 )
2025-05-19 16:28:12 -07:00
437cae0ad0
feat: KV Block Manager Python bindings ( #1022 )
2025-05-19 12:33:41 -04:00
2981350880
feat(dynamo-run): KV-aware routing ( #1064 )
...
Router:
```
dynamo-run in=http out=dyn://dynamo.endpoint.generate --router-mode kv
```
Worker (* N):
```
dynamo-run in=dyn://dynamo.endpoint.generate out=vllm /data/llms/Qwen/Qwen3-4B
```
You need patched vllm and the C bindings `.so`. Full docs in the updated guide: `docs/guides/dynamo_run.md`.
This gives us a pure-Rust ingress node: OpenAI compliant HTTP server + Pre-processor + KV-aware router.
2025-05-14 15:21:46 -04:00
4564a38711
feat: kv block manager ( #965 )
2025-05-09 21:05:24 +00:00
0715d4691f
chore: bump NIXL version and package versions ( #836 )
...
Signed-off-by: Harrison Saturley-Hall <454891+saturley-hall@users.noreply.github.com>
2025-04-25 19:24:38 -04:00
fa7ee14c2a
chore: update versions to 0.1.1 ( #552 )
2025-04-09 09:50:30 -04:00
8621d914e3
feat: dynamo deploy hello world example to k8s ( #205 )
2025-03-28 20:51:48 +00:00
c1c22703c5
build: reorganize python packaging to build new wheels ( #118 )
2025-03-14 13:43:29 -04:00
ea401e3bc0
ci: build wheel from root directory ( #274 )
2025-02-27 11:56:51 -05:00
08fcd7e93b
refactor: move libs to lib dir
...
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
2025-02-24 18:21:02 -08:00
Harrison Saturley-Hall