Skip to content

Commit

Permalink
Update llm_inference_guide.rst
Browse files Browse the repository at this point in the history
  • Loading branch information
kblaszczak-intel committed Jan 16, 2025
1 parent 4f9cb57 commit b1050ab
Show file tree
Hide file tree
Showing 2 changed files with 15 additions and 6 deletions.
5 changes: 4 additions & 1 deletion docs/articles_en/about-openvino/release-notes-openvino.rst
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ OpenVINO Release Notes



2024.6 - 18 December 2024
2025.0 - 05 February 2025
#############################

:doc:`System Requirements <./release-notes-openvino/system-requirements>` | :doc:`Release policy <./release-notes-openvino/release-policy>` | :doc:`Installation Guides <./../get-started/install-openvino>`
Expand Down Expand Up @@ -146,6 +146,9 @@ Deprecated and to be removed in the future
future. OpenVINO's dynamic shape models are recommended instead.
* MacOS x86 is no longer recommended for use due to the discontinuation of validation.
Full support will be removed later in 2025.
* The `openvino` namespace of the OpenVINO Python API has been redesigned, removing the nested
`openvino.runtime` module. The old namespace is now considered deprecated and will be
discontinued in 2026.0.



Expand Down
16 changes: 11 additions & 5 deletions docs/articles_en/learn-openvino/llm_inference_guide.rst
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ options:

`Check out the OpenVINO GenAI Quick-start Guide [PDF] <https://docs.openvino.ai/nightly/_static/download/GenAI_Quick_Start_Guide.pdf>`__

.. tab-item:: Hugging Face integration
.. tab-item:: Optimum Intel (Hugging Face integration)

| - Suggested for prototyping and, if the use case is not covered by OpenVINO GenAI, production.
| - Bigger footprint and more dependencies.
Expand All @@ -55,10 +55,16 @@ options:
as well as conversion on the fly. For integration with the final product it may offer
lower performance, though.

Note that the base version of OpenVINO may also be used to run generative AI. Although it may
offer a simpler environment, with fewer dependencies, it has significant limitations and a more
demanding implementation process. For reference, see
`the article on generative AI usage of OpenVINO 2024.6 <https://docs.openvino.ai/2024/learn-openvino/llm_inference_guide/llm-inference-native-ov.html>`__.
.. tab-item:: Base OpenVINO (not recommended)

Note that the base version of OpenVINO may also be used to run generative AI. Although it may
offer a simpler environment, with fewer dependencies, it has significant limitations and a more
demanding implementation process.

To learn more, refer to the article for the 2024.6 OpenVINO version:
`Generative AI with Base OpenVINO <https://docs.openvino.ai/2024/learn-openvino/llm_inference_guide/llm-inference-native-ov.html>`__



The advantages of using OpenVINO for generative model deployment:

Expand Down

0 comments on commit b1050ab

Please sign in to comment.