cf433e6825
chore: update all copyright headers in repo to 2026 ( #5130 )
...
Signed-off-by: Tushar Sharma <tusharma@nvidia.com>
2026-01-02 22:08:23 +00:00
51c1b9f147
chore(runtime): Tidy up component paths ( #4560 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-25 15:09:56 +00:00
f05f7629f3
chore: Make nats_client private at crate level, various tidy up ( #4513 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-21 14:35:57 -08:00
69797b5ab3
feat: Only monitor NATS metrics if using NATS request plane ( #4442 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-19 17:48:49 +00:00
2f1778c13d
fix(storage): File store shouldn't notify on metdata changes ( #4434 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-18 10:24:04 -08:00
0e77d3442e
refactor: centralize environment variable constants ( #4083 )
...
Signed-off-by: Keiven Chang <keivenchang@users.noreply.github.com>
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-11-17 11:16:38 -08:00
886506c12d
feat: Command line flag to set request plane mode: tcp, http or nats ( #4365 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-17 09:02:36 -08:00
e1af3af6ee
chore: Remove static mode ( #4235 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-11 19:25:12 +00:00
cf630bf7b6
refactor: Make the Runtime and DistributedRuntime fields private ( #4193 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-11-10 15:56:22 +00:00
f6ed01b14c
chore: Replace ServiceConfigBuilder with add_stats_service ( #3736 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-10-20 16:47:05 -04:00
02a22cbcf3
chore(runtime): Shorten the license header ( #3059 )
...
Signed-off-by: Graham King <grahamk@nvidia.com>
2025-09-16 17:13:11 +00:00
bce7458842
chore: Rust to 1.89 and edition 2024 ( #2659 )
2025-08-22 16:17:15 -07:00
f10e44cae9
fix: Integration tests fixes ( #2161 )
...
Co-authored-by: Keiven Chang <keivenchang@users.noreply.github.com>
2025-07-31 15:07:06 -07:00
49b7a0d99e
feat: record + analyze logprobs ( #1957 )
2025-07-17 10:35:04 -04:00
08355da625
refactor: move kv store to runtime ( #1459 )
2025-06-11 16:47:14 -07:00
aeb79e6277
feat: Support multiple models on single ingress node ( #1127 )
...
We can now do this:
- Node 1:
```
dynamo-run in=http out=dyn
```
- Node 2 and 3, two instances of component 'backend' in the nemotron_ultra pipeline:
```
dynamo-run in=dyn://nemotron_ultra.backend.generate out=vllm /data/models/NemotronUltra
```
- Node 4 and 5, two instances of the 'backend' component in nemotron_super pipeline:
```
dynamo-run in=dyn://nemotron_super.backend.generate out=vllm /data/models/NemotronSuper
```
The ingress node will discover all four instances and route correctly. We have been planning for this for a long time now.
As part of this auto-discovery is now always `out=dyn`, with no extra URL parts. Previously it could only route to a single pipeline.
Also:
- Refactor endpoint / instance naming now that I understand them
- Fix removing models when their instance stops.
2025-05-19 18:41:07 -04:00
f04359cf69
feat: global kv block manager ( #45 )
2025-03-13 20:57:28 -06:00
602352ce19
chore: rename dynamo ( #44 )
...
Co-authored-by: Biswa Panda <biswa.panda@gmail.com>
2025-03-08 01:42:40 -08:00
1af7433bff
refactor: rename triton_distributed to dynemo ( #22 )
...
Co-authored-by: Graham King <grahamk@nvidia.com>
2025-03-05 09:15:46 -08:00
08fcd7e93b
refactor: move libs to lib dir
...
Signed-off-by: Neelay Shah <neelays@nvidia.com>
Co-authored-by: Ryan McCormick <rmccormick@nvidia.com>
2025-02-24 18:21:02 -08:00
Tushar Sharma