Code

NeVa token fusion#9245

Code

Merged

yaoyu-33 merged 22 commits intoNVIDIA:mainNVIDIA/NeMo:mainfrom paul-gibbons:neva-token-fusionpaul-gibbons/NeMo:neva-token-fusionCopy head branch name to clipboardJun 3, 2024

+127-36

Commits

Commits on May 10, 2024

• token fusion via mlp downsampling + media_type default fix

  Show description for 2d910bd
  paul-gibbons

  committed
  2d910bd

Commits on May 17, 2024

• inference update

  Show description for ca06dfb
  paul-gibbons

  committed
  ca06dfb

• adapter fix

  Show description for 2800ad6
  paul-gibbons

  committed
  2800ad6

Commits on May 29, 2024

• Merge NeMo main branch into neva-token-fusion

  Show description for 53ca7a1
  paul-gibbons

  committed
  53ca7a1

Commits on May 30, 2024

• config refactor, remove image_token_len dependency, transpose mlp_downsample height and weight

  Show description for 76beb9b
  paul-gibbons

  committed
  76beb9b

• Apply isort and black reformatting

  Show description for 438376f
  paul-gibbons

  committed
  438376f

• removing image_token_len in text generation strategy

  Show description for 27a6ffe
  paul-gibbons

  committed
  27a6ffe

• fix patch_dim text generation

  Show description for 87aed0a
  paul-gibbons

  committed
  87aed0a

• crop-size fix

  Show description for a1e4af0
  paul-gibbons

  committed
  a1e4af0

• fixing RGB reversal bug

  Show description for 06b285b
  paul-gibbons

  committed
  06b285b

• Apply isort and black reformatting

  Show description for 4f3acce
  paul-gibbons

  committed
  4f3acce

• Merge branch 'main' into neva-token-fusion

  paul-gibbons

  authored
  666ab44

Commits on May 31, 2024

• crop_size default -> None in text_generation_strategy

  Show description for b3d5414
  paul-gibbons

  committed
  b3d5414

• Apply isort and black reformatting

  Show description for 2cbbc8a
  paul-gibbons

  committed
  2cbbc8a

• patch_dim padding for mlp_downsample

  Show description for f0ef62d
  paul-gibbons

  committed
  f0ef62d

• Merge branch 'neva-token-fusion' of https://github.com/paul-gibbons/NeMo into neva-token-fusion

  paul-gibbons

  committed
  f6ba50b

• Apply isort and black reformatting

  Show description for ed4e9eb
  paul-gibbons

  committed
  ed4e9eb

• patch_dim padding update

  Show description for 352f2bb
  paul-gibbons

  committed
  352f2bb

• patch_dim padding update

  Show description for 3eb1201
  paul-gibbons

  committed
  3eb1201

• Apply isort and black reformatting

  Show description for e052dcd
  paul-gibbons

  committed
  e052dcd

• updating h/w patch_dim naming convention

  Show description for fa0eeb2
  paul-gibbons

  committed
  fa0eeb2

• Apply isort and black reformatting

  Show description for b552e92
  paul-gibbons

  committed
  b552e92