Code

Evo2 merge 20250214#12263

Code

Merged

jstjohn merged 67 commits intomainNVIDIA/NeMo:mainfrom evo2-merge-20250214NVIDIA/NeMo:evo2-merge-20250214Copy head branch name to clipboardMar 3, 2025

+7,265-24

Commits

Commits on Feb 14, 2025

• Initial commit of Hyena model needed for Evo2

  Show description for 995dc9c
  

  JRD971000

  authored and

  jstjohn

  committed
  995dc9c

  Copy full SHA for 995dc9c

• Delete attention.py

  Show description for 55d6548
  jstjohn

  committed
  55d6548

  Copy full SHA for 55d6548

• Add missing imports and update forward of gpt model

  Show description for b2a4e19
  jstjohn

  committed
  b2a4e19

  Copy full SHA for b2a4e19

• Add in blended dataset config test for evo2

  Show description for e1b8b20
  jstjohn

  committed
  e1b8b20

  Copy full SHA for e1b8b20

Commits on Feb 15, 2025

• Add ability to change dataset class

  Show description for c0c4bbd
  jstjohn

  committed
  c0c4bbd

  Copy full SHA for c0c4bbd

Commits on Feb 17, 2025

• Alit/evo2 merge 20250214

  JRD971000

  committed
  688e8ce

  Copy full SHA for 688e8ce

• Merge branch 'alit/evo2-merge-20250214' into 'evo2-merge-20250214'

  Show description for c28efaf
  JRD971000

  committed
  c28efaf

  Copy full SHA for c28efaf

Commits on Feb 18, 2025

• Performance improvement and fix for masking test

  Show description for 733a79d
  jstjohn

  committed
  733a79d

  Copy full SHA for 733a79d

• Remove no grad decorator

  Show description for 363c015
  jstjohn

  committed
  363c015

  Copy full SHA for 363c015

• Fixup and simplify token mask logic

  Show description for 54a361b
  jstjohn

  committed
  54a361b

  Copy full SHA for 54a361b

• Update tests and code for non-dna safety

  Show description for a32ac16
  jstjohn

  committed
  a32ac16

  Copy full SHA for a32ac16

• More tests on masking logic

  Show description for 33d8957
  jstjohn

  committed
  33d8957

  Copy full SHA for 33d8957

• Switch renormlization to be per row rather than per micro-batch

  jstjohn

  committed
  9816ff1

  Copy full SHA for 9816ff1

Commits on Feb 19, 2025

• Safe handling of divide by zero and handle control chars in phylo tag logic

  jstjohn

  committed
  fadacc3

  Copy full SHA for fadacc3

• Apply isort and black reformatting

  Show description for 020a508
  JRD971000

  committed
  020a508

  Copy full SHA for 020a508

• Apply isort and black reformatting

  Show description for a7a5092
  artbataev

  committed
  a7a5092

  Copy full SHA for a7a5092

• Add profiling benchmarking to our evo2 dataset tests

  Show description for 9c3fb74
  jstjohn

  committed
  9c3fb74

  Copy full SHA for 9c3fb74

Commits on Feb 21, 2025

• Address formatting and linting errors

  Show description for 3df19a7
  jstjohn

  committed
  3df19a7

  Copy full SHA for 3df19a7

• Merge branch 'main' of github.com:NVIDIA/NeMo into evo2-merge-20250214

  Show description for 7d52494
  jstjohn

  committed
  7d52494

  Copy full SHA for 7d52494

• Address more pylint warnings

  Show description for dd14d63
  jstjohn

  committed
  dd14d63

  Copy full SHA for dd14d63

• Address pylance errors

  Show description for 02a4e35
  jstjohn

  committed
  02a4e35

  Copy full SHA for 02a4e35

• Merge branch 'main' of github.com:NVIDIA/NeMo into evo2-merge-20250214

  Show description for d50f267
  jstjohn

  committed
  d50f267

  Copy full SHA for d50f267

• More pylint fixes

  Show description for 25e0ce0
  jstjohn

  committed
  25e0ce0

  Copy full SHA for 25e0ce0

• DCO Sign-off for previous commits

  Show description for e83d7bb
  jstjohn

  committed
  e83d7bb

  Copy full SHA for e83d7bb

• Address PR feedback

  Show description for fc0bf3b
  jstjohn

  committed
  fc0bf3b

  Copy full SHA for fc0bf3b

• Address copilot PR feedback

  Show description for c081ba3
  jstjohn

  committed
  c081ba3

  Copy full SHA for c081ba3

• Adding hyena L2 test to CI/CD

  Show description for 4480311
  jstjohn

  committed
  4480311

  Copy full SHA for 4480311

• Address import error exception issue

  Show description for 04eba8e
  jstjohn

  committed
  04eba8e

  Copy full SHA for 04eba8e

• Update kingdom -> domain in evo2 taxonomy token string

  Show description for 4b55408
  jstjohn

  committed
  4b55408

  Copy full SHA for 4b55408

• Merge branch 'main' of github.com:NVIDIA/NeMo into evo2-merge-20250214

  Show description for 8b9fdb2
  jstjohn

  committed
  8b9fdb2

  Copy full SHA for 8b9fdb2

• Create dictionary of standard string representations of hyena models to be used across projects

  Show description for 4d1fe01
  jstjohn

  committed
  4d1fe01

  Copy full SHA for 4d1fe01

Commits on Feb 22, 2025

• Merge branch 'main' into evo2-merge-20250214

  ko3n1g

  authored
  266c722

  Copy full SHA for 266c722

• Adding a hugging face importer and 1b model configs for lighter testing

  Show description for c83ef09
  jstjohn

  committed
  c83ef09

  Copy full SHA for c83ef09

• Merge branch 'evo2-merge-20250214' of github.com:NVIDIA/NeMo into evo2-merge-20250214

  Show description for 21300b0
  jstjohn

  committed
  21300b0

  Copy full SHA for 21300b0

• Fix missing import

  Show description for a9867cc
  jstjohn

  committed
  a9867cc

  Copy full SHA for a9867cc

• Merge branch 'main' into evo2-merge-20250214

  jstjohn

  authored
  9111382

  Copy full SHA for 9111382

• fix dist sampler

  Show description for 471c9bf
  JRD971000

  authored
  471c9bf

  Copy full SHA for 471c9bf

Commits on Feb 24, 2025

• revert dist sampler true

  Show description for 5d2b612
  JRD971000

  authored
  5d2b612

  Copy full SHA for 5d2b612

• Merge branch 'main' of github.com:NVIDIA/NeMo into evo2-merge-20250214

  Show description for d280df1
  jstjohn

  committed
  d280df1

  Copy full SHA for d280df1

• Fix the multi-part download naming in savanna

  Show description for fe99a49
  jstjohn

  committed
  fe99a49

  Copy full SHA for fe99a49

• Adding 1b models to main llm import

  Show description for fa3fac0
  jstjohn

  committed
  fa3fac0

  Copy full SHA for fa3fac0

Commits on Feb 25, 2025

• Merge branch 'main' of github.com:NVIDIA/NeMo into evo2-merge-20250214

  Show description for d8ac417
  jstjohn

  committed
  d8ac417

  Copy full SHA for d8ac417

• Fix failing LLM CPU unit tests

  Show description for 30a7824
  jstjohn

  committed
  30a7824

  Copy full SHA for 30a7824

• Addressing PR feedback

  Show description for 2be3af5
  jstjohn

  committed
  2be3af5

  Copy full SHA for 2be3af5

Commits on Feb 26, 2025

• bug fixing

  dorotat-nv

  committed
  7921c44

  Copy full SHA for 7921c44

• Apply isort and black reformatting

  Show description for 081ae40
  JRD971000

  committed
  081ae40

  Copy full SHA for 081ae40

• Merge branch 'main' into evo2-merge-20250214

  Show description for 8f32cbf
  JRD971000

  authored
  8f32cbf

  Copy full SHA for 8f32cbf

• add header to test_flops_callback.py

  Show description for 8b8b515
  JRD971000

  authored
  8b8b515

  Copy full SHA for 8b8b515

Commits on Feb 27, 2025

• Add hyena stage to CI/CD requirements and address flops callback unused imports

  Show description for ae7a387
  jstjohn

  committed
  ae7a387

  Copy full SHA for ae7a387

• Merge branch 'main' of github.com:NVIDIA/NeMo into evo2-merge-20250214

  Show description for 8ca01eb
  jstjohn

  committed
  8ca01eb

  Copy full SHA for 8ca01eb

• Use the custom eos/bos tokens passed to the bytelevel tokenizer

  Show description for 44d08b5
  jstjohn

  committed
  44d08b5

  Copy full SHA for 44d08b5

• Add back TE import guards so CI passes

  Show description for 3c1b74e
  jstjohn

  committed
  3c1b74e

  Copy full SHA for 3c1b74e

• Merge branch 'main' of github.com:NVIDIA/NeMo into evo2-merge-20250214

  Show description for 5ced598
  jstjohn

  committed
  5ced598

  Copy full SHA for 5ced598

Commits on Mar 2, 2025

• use cache

  Show description for 353d346
  akoumpa

  committed
  353d346

  Copy full SHA for 353d346

• Apply isort and black reformatting

  Show description for 8a7fa12
  akoumpa

  committed
  8a7fa12

  Copy full SHA for 8a7fa12

• fix no te

  Show description for a6971ca
  akoumpa

  committed
  a6971ca

  Copy full SHA for a6971ca

• Apply isort and black reformatting

  Show description for 9b4737b
  akoumpa

  committed
  9b4737b

  Copy full SHA for 9b4737b

• Update test_save_restore.py

  Show description for bc69b7a
  akoumpa

  authored
  bc69b7a

  Copy full SHA for bc69b7a

• David Guzman review of Evo2 (#12440)

  Show description for 3ea659b
  jstjohn

  authored
  3ea659b

  Copy full SHA for 3ea659b

• Fix pylint and flake8 issues

  Show description for 1db1d3b
  jstjohn

  committed
  1db1d3b

  Copy full SHA for 1db1d3b

• fix cli args for pretraining test

  Show description for c77f262
  jstjohn

  committed
  c77f262

  Copy full SHA for c77f262

• Move conv init into rng tracker

  Show description for 7fc0637
  jstjohn

  committed
  7fc0637

  Copy full SHA for 7fc0637

• Address flake8 issues and remove unused function

  Show description for faf8f3f
  jstjohn

  committed
  faf8f3f

  Copy full SHA for faf8f3f

• Merge branch 'main' into evo2-merge-20250214

  jstjohn

  authored
  b0e1d74

  Copy full SHA for b0e1d74

• Handle TE not being installed test a bit better

  Show description for 917271c
  jstjohn

  committed
  917271c

  Copy full SHA for 917271c

• define even if TE missing

  Show description for aee348c
  akoumpa

  committed
  aee348c

  Copy full SHA for aee348c

• fix

  Show description for 31c132f
  akoumpa

  committed
  31c132f

  Copy full SHA for 31c132f