You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
It seems like trying to load a LoRA in llama-cpp-python with mmap enabled causes a segmentation fault. Probably this package should copy the default behavior of llama.cpp and disable mmap when loading LoRAs.
The text was updated successfully, but these errors were encountered:
In the issue that implemented LoRAs in llama.cpp they say "Using --lora disables mmap since the models have to be modified anyway."
It seems like trying to load a LoRA in llama-cpp-python with mmap enabled causes a segmentation fault. Probably this package should copy the default behavior of llama.cpp and disable mmap when loading LoRAs.
The text was updated successfully, but these errors were encountered: