This commit is contained in:
Tatiana Savina 2024-06-11 13:15:39 +02:00
parent d8d1b1248a
commit 5c5d864e2d
1 changed files with 2 additions and 6 deletions

View File

@ -264,13 +264,9 @@ GenAI API
OpenVINO GenAI Flavor includes the following API:
* generation_config - defines a configuration class for text generation,
enabling customization of the generation process such as the maximum length of the
generated text, whether to ignore end-of-sentence tokens, and the specifics of the decoding
strategy (greedy, beam search, or multinomial sampling).
* generation_config - defines a configuration class for text generation, enabling customization of the generation process such as the maximum length of the generated text, whether to ignore end-of-sentence tokens, and the specifics of the decoding strategy (greedy, beam search, or multinomial sampling).
* llm_pipeline - provides classes and utilities for text generation,
including a pipeline for processing inputs, generating text, and managing outputs with configurable options.
* llm_pipeline - provides classes and utilities for text generation, including a pipeline for processing inputs, generating text, and managing outputs with configurable options.
* streamer_base - an abstract base class for creating streamers.