Skip to content

Commit

Permalink
Tweak params
Browse files Browse the repository at this point in the history
  • Loading branch information
@yuiseki
yuiseki committed Mar 21, 2024
1 parent 11074cd commit 0fade7c
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions recipes/A5000_24GB_x8/sentiment-analyzer.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -11,8 +11,8 @@ dataset_train_split_test_size: 0.2
lora_r: 8
lora_alpha: 16
lora_dropout: 0.05
train_per_device_train_batch_size: 8
train_gradient_accumulation_steps: 4
train_per_device_train_batch_size: 6
train_gradient_accumulation_steps: 2
train_num_train_epochs: 4
train_max_steps: 1000
train_fp16: True
Expand Down

0 comments on commit 0fade7c

Please sign in to comment.