What do the completion strategies mean?

[Praj-17]

these completion strategies what do they mean?

class CompletionStrategy(Enum):
    CONCATENATE = "concatenate"
    PAGINATE = "paginate"
    FORBIDDEN = "forbidden"

Is it something related to Chunking? or the way the requests are sent?

[enoch3712]

Hello @Praj-17 !

or the way the requests are sent?
Yes

completion strategies are used if the output goes over the token length, in this case, if the LLM doesnt return "end" but "length"

So, imagine that you are extracting a 50 page document. Will not work, because by default ExtractThinker uses Forbidden, if the result is too large. So you have this 2 options:

• CONCATENATE: Adds the output result until it finishes. Let's say you want to 100k output token, and gpt4o-mini only return 16k at the time, you will add the result to the prompt and ask again, until its fiished.
  Info here: https://enoch3712.github.io/ExtractThinker/core-concepts/completion-strategies/concatenate/

• PAGINATE: Makes the request per page, and at the end merges the results together. done in parallel and faster
  info here: https://enoch3712.github.io/ExtractThinker/core-concepts/completion-strategies/paginate/

Is related to chunking? In the RAG sense no, if that is your question.

[Praj-17]

Thankyou for the clarification.