Skip to content

BLOOM - Quantized Inference and QLoRA Finetuning on Nvidia T4

License

Notifications You must be signed in to change notification settings

lwieske/bloom-and-qlora

Repository files navigation

BLOOM - Quantized Inference + QLoRA Finetuning on T4

Inference

Model Notebook Links
BLOOM 7B1/4bit bloom_7b1_4bit_inference.ipynb Open In Colab Open in SageMaker Studio Lab
BLOOM 3B/4bit bloom_3b_4bit_inference.ipynb Open In Colab Open in SageMaker Studio Lab
BLOOM 1B7 bloom_1b7_inference.ipynb Open In Colab Open in SageMaker Studio Lab

Finetuning

Model Dataset Notebook Links
BLOOM 3B/4bit Dolly bloom_3b_4bit_qlora_finetuning_with_dolly.ipynb Open In Colab Open in SageMaker Studio Lab

Task List

  • Finetuning with Tim Dettmers OASST
  • Finetuning with Nvidia HelpSteer
  • DeepSpeed
  • GPTQ

About

BLOOM - Quantized Inference and QLoRA Finetuning on Nvidia T4

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published