Code

Add GLM4 model#33729

Code

Closed

Cyrilvallez wants to merge 39 commits intohuggingface:mainhuggingface/transformers:mainfrom Cyrilvallez:glmCyrilvallez/transformers:glmCopy head branch name to clipboard

+3,245-62

Commits

Commits on Sep 30, 2024

• fix converter for function definitions

  ArthurZucker

  committed
  4403382

  Copy full SHA for 4403382

• Hqq serialization (huggingface#33141)

  Show description for 18b2c0c
  

  3 peopleauthored and

  Cyrilvallez

  committed
  18b2c0c

  Copy full SHA for 18b2c0c

• Create modular_glm.py

  Cyrilvallez

  committed
  30400c0

  Copy full SHA for 30400c0

• Update modular_glm.py

  Cyrilvallez

  committed
  5677a55

  Copy full SHA for 5677a55

• Finalize architecture without all attentions

  Cyrilvallez

  committed
  c4c9f5c

  Copy full SHA for c4c9f5c

• Add all attentions modules

  Cyrilvallez

  committed
  6443004

  Copy full SHA for 6443004

• Finalize modular

  Cyrilvallez

  committed
  ff01996

  Copy full SHA for ff01996

• Update given last version

  Cyrilvallez

  committed
  7584246

  Copy full SHA for 7584246

• Last update

  Cyrilvallez

  committed
  603421e

  Copy full SHA for 603421e

• Finalize model

  Cyrilvallez

  committed
  9e0dfee

  Copy full SHA for 9e0dfee

• Finalize converter

  Cyrilvallez

  committed
  414100d

  Copy full SHA for 414100d

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  b816507

  Copy full SHA for b816507

• style

  Cyrilvallez

  committed
  590321b

  Copy full SHA for 590321b

• style

  Cyrilvallez

  committed
  85cbd60

  Copy full SHA for 85cbd60

• Create __init__.py

  Cyrilvallez

  committed
  7ba2f3a

  Copy full SHA for 7ba2f3a

• Aff all inits

  Cyrilvallez

  committed
  fd727a6

  Copy full SHA for fd727a6

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  dfa54bb

  Copy full SHA for dfa54bb

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  ecd5bf4

  Copy full SHA for ecd5bf4

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  ccacc3b

  Copy full SHA for ccacc3b

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  bd9b9ee

  Copy full SHA for bd9b9ee

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  bba6b12

  Copy full SHA for bba6b12

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  13934a8

  Copy full SHA for 13934a8

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  678062d

  Copy full SHA for 678062d

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  967944f

  Copy full SHA for 967944f

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  2588ee7

  Copy full SHA for 2588ee7

• Correct the rotary embeddings

  Cyrilvallez

  committed
  8756c10

  Copy full SHA for 8756c10

• Remove apply_residual_connection_post_layernorm (always false)

  Cyrilvallez

  committed
  e633c22

  Copy full SHA for e633c22

• remove use_rms_norm (always true)

  Cyrilvallez

  committed
  ea3ee4e

  Copy full SHA for ea3ee4e

• remove past_layer_norm (always true)

  Cyrilvallez

  committed
  c2f0a8d

  Copy full SHA for c2f0a8d

• Update __init__.py

  Cyrilvallez

  committed
  e251352

  Copy full SHA for e251352

• Update config and license

  Cyrilvallez

  committed
  4fbcfce

  Copy full SHA for 4fbcfce

• start adding tests and doc

  Cyrilvallez

  committed
  a1692ab

  Copy full SHA for a1692ab

• Add doc + style

  Cyrilvallez

  committed
  3c80274

  Copy full SHA for 3c80274

• Update test_modeling_glm.py

  Cyrilvallez

  committed
  73ecb14

  Copy full SHA for 73ecb14

• Add dummies

  Cyrilvallez

  committed
  d15d0e5

  Copy full SHA for d15d0e5

• Update back init (because __all__ is not generated from modular)

  Cyrilvallez

  committed
  eacc0ad

  Copy full SHA for eacc0ad

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  499f7a5

  Copy full SHA for 499f7a5

• Update convert_glm_weights_to_hf.py

  Cyrilvallez

  committed
  65085d2

  Copy full SHA for 65085d2

• apply corrected modular

  Cyrilvallez

  committed
  d273a11

  Copy full SHA for d273a11