Code

Classifier Free Guidance#536

Code

Merged

martindevans merged 10 commits intoSciSharp:masterSciSharp/LLamaSharp:masterfrom martindevans:guidance_in_token_data_arraymartindevans/LLamaSharp:guidance_in_token_data_arrayCopy head branch name to clipboardFeb 26, 2024

+250-34

Commits

Commits on Feb 25, 2024

• Added a Guidance method to LLamaTokenDataArray which applies classifier free guidance

  martindevans

  committed
  62381ab

  Copy full SHA for 62381ab

• Factored out a safer llama_sample_apply_guidance method based on spans

  martindevans

  committed
  528bb01

  Copy full SHA for 528bb01

• Created a guided sampling demo using the batched executor

  martindevans

  committed
  80d1080

  Copy full SHA for 80d1080

• fixed comment, "classifier free" not "context free"

  martindevans

  committed
  8526d6b

  Copy full SHA for 8526d6b

• Rebased onto master and fixed breakage due to changes in BaseSamplingPipeline

  martindevans

  committed
  879c62e

  Copy full SHA for 879c62e

• Asking user for guidance weight

  martindevans

  committed
  d509968

  Copy full SHA for d509968

• Progress bar in batched fork demo

  martindevans

  committed
  d50fe79

  Copy full SHA for d50fe79

Commits on Feb 26, 2024

• Improved fork example (using tree display)

  martindevans

  committed
  cec4d65

  Copy full SHA for cec4d65

• Added proper disposal of resources in batched examples

  martindevans

  committed
  29e043d

  Copy full SHA for 29e043d

• Added some more comments in BatchedExecutorGuidance

  martindevans

  committed
  6c8dea9

  Copy full SHA for 6c8dea9