Code

Chunked prefill support#797

Code

Merged

hnyls2002 merged 13 commits intomainsgl-project/sglang:mainfrom chunked-prefillsgl-project/sglang:chunked-prefillCopy head branch name to clipboardJul 29, 2024

+160-54

Commits

Commits on Jul 28, 2024

• rename: forward_queue -> waiting_queue

  hnyls2002

  committed
  17392d3

  Copy full SHA for 17392d3

Commits on Jul 29, 2024

• organize

  hnyls2002

  committed
  954261f

  Copy full SHA for 954261f

• support chunked prefill

  hnyls2002

  committed
  fd7a9da

  Copy full SHA for fd7a9da

• fix log

  hnyls2002

  committed
  ecb4224

  Copy full SHA for ecb4224

• add server args checking

  hnyls2002

  committed
  ffc5ed5

  Copy full SHA for ffc5ed5

• fix logprobs

  hnyls2002

  committed
  7adb1a7

  Copy full SHA for 7adb1a7

• optimize

  hnyls2002

  committed
  92f72c0

  Copy full SHA for 92f72c0

• resolve

  hnyls2002

  committed
  cb4f4a3

  Copy full SHA for cb4f4a3

• resolve

  hnyls2002

  committed
  eaa3eba

  Copy full SHA for eaa3eba

• solve

  hnyls2002

  committed
  dbebc8d

  Copy full SHA for dbebc8d

• comment

  hnyls2002

  committed
  02eb87e

  Copy full SHA for 02eb87e

• default args

  hnyls2002

  committed
  7885e6d

  Copy full SHA for 7885e6d

• fix

  hnyls2002

  committed
  9c1be6a

  Copy full SHA for 9c1be6a