From ec4f36b0150203384c6145e8b5929c7d0dc41181 Mon Sep 17 00:00:00 2001 From: Zlobin Vladimir Date: Tue, 30 Jan 2024 01:21:31 +0400 Subject: [PATCH] Fix grammar (#22457) --- docs/articles_en/openvino_workflow/gen_ai.rst | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/articles_en/openvino_workflow/gen_ai.rst b/docs/articles_en/openvino_workflow/gen_ai.rst index 0ea0eac6a24..38a19b6e181 100644 --- a/docs/articles_en/openvino_workflow/gen_ai.rst +++ b/docs/articles_en/openvino_workflow/gen_ai.rst @@ -139,8 +139,8 @@ The optimized model can be saved as usual with a call to ``save_pretrained()``. with `GPTQ `__. In this case, there is no need for an additional model optimization step because model conversion will automatically preserve the INT4 optimization results, allowing model inference to benefit from it. Another optimization that is applied by default when using ``OVModelForCausalLM`` class is transformation of the model to a stateful form. -This transformation further improves inference performance and decreases amount of allocated runtime memory in long running text generation scenarious. -It is achieved by hiding inputs and outputs of the model that represent past KV-cache tensors, and handling them inside the model in a more efficient way. +This transformation further improves inference performance and decreases amount of allocated runtime memory in long running text generation scenarios. +It is achieved by hiding inputs and outputs of the model that represent past KV-cache tensors and handling them inside the model in a more efficient way. This feature is activated automatically for a wide range of supported text generation models, keeping not supported models in a regular, stateless form. Model usage are identical for stateful and stateless models as long as Optimum-Intel API is used because KV-cache handling is an internal detail of the text-generation API of Transformers library.