Code

LLamaBatch Logit Tracking#624

Code

Merged

martindevans merged 1 commit intoSciSharp:masterSciSharp/LLamaSharp:masterfrom martindevans:llama_batch_logit_trackingmartindevans/LLamaSharp:llama_batch_logit_trackingCopy head branch name to clipboardMar 25, 2024

+33-1

Commits

Commits on Mar 25, 2024

• Keeping track of positions where logits will be generated in a batch and what sequence those logits are associated with.

  martindevans

  committed
  339aea0

  Copy full SHA for 339aea0