Skip to content

Issues: ggerganov/llama.cpp

examples : add configuration presets
#10932 opened Dec 21, 2024 by ggerganov
Open 3
changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 4
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 12
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

260 Open 4,002 Closed
260 Open 4,002 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Eval bug: input is too large to process. increase the physical batch size bug-unconfirmed
#11105 opened Jan 6, 2025 by Tian14267
Feature Request: RuntimeError: Unsloth: The file 'llama.cpp/llama-quantize' or 'llama.cpp/quantize' does not exist. But we expect this file to exist! Maybe the llama.cpp developers changed the name? enhancement New feature or request
#11100 opened Jan 6, 2025 by San-Jain18
4 tasks done
Vulkan related question: what's the different between server and cli?
#11099 opened Jan 6, 2025 by FNsi
3
Compile bug: Compilation fails due to -D_XOPEN_SOURCE=600: error: use of undeclared identifier 'strnlen' bug-unconfirmed
#11095 opened Jan 6, 2025 by yurivict
1
Again, the releases don't have the libraries.
#11091 opened Jan 5, 2025 by 0wwafa
4
Misc. bug: gguf pypy package dumps /scripts/ and /examples/ into site-packages bug-unconfirmed
#11089 opened Jan 5, 2025 by Ph0rk0z
1
Misc. bug: ggml_backend_sycl_graph_compute: error: op not supported node_1586 (FLASH_ATTN_EXT) bug-unconfirmed
#11084 opened Jan 5, 2025 by alfrentgen
1
Misc. bug: [Mac M4]llama-server cannot run in release-4409 but can run in 4406 bug-unconfirmed
#11083 opened Jan 5, 2025 by bobleer
Eval bug: Segmentation fault with docker aarch64 on MacOS M1 using a small test model stories15M_MOE-Q8_0.gguf bug-unconfirmed
#11082 opened Jan 5, 2025 by marcindulak
1
Compile bug: Trying to compile on a raspi w v2 and failing to compile bug-unconfirmed
#11079 opened Jan 4, 2025 by RichNeese
Eval bug: ggml_sycl_cpy: unsupported type combination (q8_0 to f32) bug-unconfirmed
#11078 opened Jan 4, 2025 by paoletto
2
Misc. exploratory: Possible false positives on CI release caused by c4ai-r7b template or unrelated? bug-unconfirmed
#11077 opened Jan 4, 2025 by Aetherarchio
4
Feature Request: Add Parameters Section To change parameters in llama-android enhancement New feature or request
#11073 opened Jan 4, 2025 by Dhruvanand24
4 tasks done
Compile bug: Error Domain=MTLLibraryErrorDomain Code=3 bug-unconfirmed
#11071 opened Jan 3, 2025 by p-w-rs
7
Misc. bug: Package llama-b4409-bin-ubuntu-x64.zip is defective bug-unconfirmed
#11068 opened Jan 3, 2025 by T-Shilov
3
Feature Request: Top-nσ sampler enhancement New feature or request
#11057 opened Jan 3, 2025 by FellowTraveler
4 tasks done
Feature Request: Add Chat Template In Llama-Android enhancement New feature or request
#11056 opened Jan 3, 2025 by Dhruvanand24
4 tasks done
Misc. bug: bug-unconfirmed
#11055 opened Jan 3, 2025 by Dhruvanand24
Misc. bug: installation bug bug-unconfirmed
#11051 opened Jan 3, 2025 by a120092009
Feature Request: Add support for Kokoro TTS enhancement New feature or request
#11050 opened Jan 3, 2025 by broke-end-dev
4 tasks done
2
Feature Request: Snap package version of llama.cpp for testing and where compilation may not be possible on the target machine. enhancement New feature or request
#11048 opened Jan 2, 2025 by QuickHare
4 tasks done
Misc. bug: SYCL out of memory error bug-unconfirmed
#11044 opened Jan 2, 2025 by BenPortner
8
Eval bug: <| <|end_of_text|> token on the end of output bug-unconfirmed
#11043 opened Jan 2, 2025 by gnusupport
Misc. bug: RISCV output bug when using rvv with vlen > 256bit bug-unconfirmed
#11041 opened Jan 2, 2025 by grigohas
Misc. bug: Testsuite always says that test-eval-callback fails with SEGFAULT but no actual segfault occurs bug-unconfirmed
#11036 opened Jan 2, 2025 by yurivict
ProTip! Follow long discussions with comments:>50.