Code

[TextGeneration] max token refactor#1217

Code

Merged

dsikka merged 14 commits intomainneuralmagic/deepsparse:mainfrom update_max_tokenneuralmagic/deepsparse:update_max_tokenCopy head branch name to clipboardSep 12, 2023

+94-25

Commits

Commits on Sep 8, 2023

• Update TextGeneration Inputs and Constructor

  Show description for 9fc7aa4
  dsikka

  committed
  9fc7aa4

  Copy full SHA for 9fc7aa4

• update description

  dsikka

  committed
  0679c4f

  Copy full SHA for 0679c4f

• quality

  dsikka

  committed
  08cb0bb

  Copy full SHA for 08cb0bb

• rebase

  dsikka

  committed
  57ecd7b

  Copy full SHA for 57ecd7b

• add comment explaining num_generated_predictions

  dsikka

  committed
  31de38c

  Copy full SHA for 31de38c

• update and add tests

  dsikka

  committed
  ccf127f

  Copy full SHA for ccf127f

• rebase

  dsikka

  committed
  b5de75f

  Copy full SHA for b5de75f

• move to helpers

  dsikka

  committed
  da7f7ef

  Copy full SHA for da7f7ef

Commits on Sep 12, 2023

• remove extra check for multiple prompts

  dsikka

  committed
  8fb72c4

  Copy full SHA for 8fb72c4

• Merge branch 'main' into update_max_token

  dsikka

  authored
  bb54ece

  Copy full SHA for bb54ece

• group generated outputs if num_generated_predictions > 1

  dsikka

  committed
  ecf12f3

  Copy full SHA for ecf12f3

• update docstring

  dsikka

  committed
  ec90ea6

  Copy full SHA for ec90ea6

• facepalm: updated input, not output

  dsikka

  committed
  770f4dc

  Copy full SHA for 770f4dc

• update tests

  dsikka

  committed
  a0d4dda

  Copy full SHA for a0d4dda