33 lines
1.3 KiB
ReStructuredText
33 lines
1.3 KiB
ReStructuredText
The examples below assume you build the latest image yourself from source. If using a prebuilt image follow the examples from the corresponding branch.
|
|
|
|
.. grid:: 1 2 2 2
|
|
:gutter: 3
|
|
:margin: 0
|
|
:padding: 3 4 0 0
|
|
|
|
.. grid-item-card:: :doc:`Hello World <../examples/runtime/hello_world/README>`
|
|
:link: ../examples/runtime/hello_world/README
|
|
:link-type: doc
|
|
|
|
Demonstrates the basic concepts of Dynamo by creating a simple GPU-unaware graph
|
|
|
|
.. grid-item-card:: :doc:`vLLM <../backends/vllm/README>`
|
|
:link: ../backends/vllm/README
|
|
:link-type: doc
|
|
|
|
Presents examples and reference implementations for deploying Large Language Models (LLMs) in various configurations with VLLM.
|
|
|
|
.. grid-item-card:: :doc:`SGLang <../backends/sglang/README>`
|
|
:link: ../backends/sglang/README
|
|
:link-type: doc
|
|
|
|
Presents examples and reference implementations for deploying Large Language Models (LLMs) in various configurations with SGLang.
|
|
|
|
.. grid-item-card:: :doc:`TensorRT-LLM <../backends/trtllm/README>`
|
|
:link: ../backends/trtllm/README
|
|
:link-type: doc
|
|
|
|
Presents examples and reference implementations for deploying Large Language Models (LLMs) in various configurations with TensorRT-LLM.
|
|
|
|
|