split: allow --split-max-size option #6259
Labels
enhancement
New feature or request
good first issue
Good for newcomers
help wanted
Extra attention is needed
split
GGUF split model sharding
Motivation
we support
--split-max-tensors
since:As mentionned by @Artefact2 in this comment:
Proposition:
Introduce
--split-max-size N(M|G)
split strategy to split files in file with a max size of N Megabytes or Gigabytes.As it is not possible to have less than 1 tensor per GGUF, this size is a soft limit.
The text was updated successfully, but these errors were encountered: