Docling support for AI Accelerators #609
nikos-livathinos
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
🚀 Get ready for the next update! As of Docling 2.12.0, there is support for AI accelerators (
AUTO
,CPU
,CUDA
,MPS
). Thedevice
,num_threads
API/CLI parameters and their corresponding envvarsDOCLING_DEVICE
,DOCLING_NUM_THREADS
allow to control the hardware settings used to run Docling. TheAUTO
option automatically selects the best device available in the system.👉 This example demonstrates how to use Docling with accelerators.
Beta Was this translation helpful? Give feedback.
All reactions