Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build failed on macOS with concedo_experimental branch #915

Closed
beebopkim opened this issue Jun 11, 2024 · 5 comments
Closed

Build failed on macOS with concedo_experimental branch #915

beebopkim opened this issue Jun 11, 2024 · 5 comments

Comments

@beebopkim
Copy link

Commit hash: 4fddbab

Build log:

koboldcpp_dev % LLAMA_METAL=1 make
I llama.cpp build info: 
I UNAME_S:  Darwin
I UNAME_P:  arm
I UNAME_M:  arm64
I CFLAGS:   -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./include/vulkan -O3 -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG
I CXXFLAGS: -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./include/vulkan -O3 -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL
I LDFLAGS:   -ld_classic -framework Accelerate -framework Foundation -framework Metal -framework MetalKit -framework MetalPerformanceShaders
I CC:       Apple clang version 15.0.0 (clang-1500.3.9.4)
I CXX:      Apple clang version 15.0.0 (clang-1500.3.9.4)

Makefile:277: warning: overriding commands for target `ggml-metal.o'
/Users/******/test/koboldcpp_dev/Makefile.local:264: warning: ignoring old commands for target `ggml-metal.o'
I llama.cpp build info: 
I UNAME_S:  Darwin
I UNAME_P:  arm
I UNAME_M:  arm64
I CFLAGS:   -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL
I CXXFLAGS: -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL
I LDFLAGS:   -ld_classic -framework Accelerate -framework Foundation -framework Metal -framework MetalKit -framework MetalPerformanceShaders
I CC:       Apple clang version 15.0.0 (clang-1500.3.9.4)
I CXX:      Apple clang version 15.0.0 (clang-1500.3.9.4)

Makefile:398: warning: overriding commands for target `ggml.o'
/Users/******/test/koboldcpp_dev/Makefile.local:383: warning: ignoring old commands for target `ggml.o'
Makefile:400: warning: overriding commands for target `ggml_v4_openblas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:385: warning: ignoring old commands for target `ggml_v4_openblas.o'
Makefile:402: warning: overriding commands for target `ggml_v4_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:387: warning: ignoring old commands for target `ggml_v4_failsafe.o'
Makefile:404: warning: overriding commands for target `ggml_v4_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:389: warning: ignoring old commands for target `ggml_v4_noavx2.o'
Makefile:406: warning: overriding commands for target `ggml_v4_clblast.o'
/Users/******/test/koboldcpp_dev/Makefile.local:391: warning: ignoring old commands for target `ggml_v4_clblast.o'
Makefile:408: warning: overriding commands for target `ggml_v4_cublas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:393: warning: ignoring old commands for target `ggml_v4_cublas.o'
Makefile:410: warning: overriding commands for target `ggml_v4_clblast_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:395: warning: ignoring old commands for target `ggml_v4_clblast_noavx2.o'
Makefile:412: warning: overriding commands for target `ggml_v4_vulkan.o'
/Users/******/test/koboldcpp_dev/Makefile.local:397: warning: ignoring old commands for target `ggml_v4_vulkan.o'
Makefile:418: warning: overriding commands for target `ggml-quants.o'
/Users/******/test/koboldcpp_dev/Makefile.local:401: warning: ignoring old commands for target `ggml-quants.o'
Makefile:420: warning: overriding commands for target `ggml-quants_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:403: warning: ignoring old commands for target `ggml-quants_noavx2.o'
Makefile:422: warning: overriding commands for target `ggml-quants_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:405: warning: ignoring old commands for target `ggml-quants_failsafe.o'
Makefile:434: warning: overriding commands for target `ggml-alloc.o'
/Users/******/test/koboldcpp_dev/Makefile.local:410: warning: ignoring old commands for target `ggml-alloc.o'
Makefile:456: warning: overriding commands for target `ggml_v3.o'
/Users/******/test/koboldcpp_dev/Makefile.local:416: warning: ignoring old commands for target `ggml_v3.o'
Makefile:458: warning: overriding commands for target `ggml_v3_openblas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:418: warning: ignoring old commands for target `ggml_v3_openblas.o'
Makefile:460: warning: overriding commands for target `ggml_v3_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:420: warning: ignoring old commands for target `ggml_v3_failsafe.o'
Makefile:462: warning: overriding commands for target `ggml_v3_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:422: warning: ignoring old commands for target `ggml_v3_noavx2.o'
Makefile:464: warning: overriding commands for target `ggml_v3_clblast.o'
/Users/******/test/koboldcpp_dev/Makefile.local:424: warning: ignoring old commands for target `ggml_v3_clblast.o'
Makefile:466: warning: overriding commands for target `ggml_v3_cublas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:426: warning: ignoring old commands for target `ggml_v3_cublas.o'
Makefile:468: warning: overriding commands for target `ggml_v3_clblast_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:428: warning: ignoring old commands for target `ggml_v3_clblast_noavx2.o'
Makefile:472: warning: overriding commands for target `ggml_v2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:432: warning: ignoring old commands for target `ggml_v2.o'
Makefile:474: warning: overriding commands for target `ggml_v2_openblas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:434: warning: ignoring old commands for target `ggml_v2_openblas.o'
Makefile:476: warning: overriding commands for target `ggml_v2_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:436: warning: ignoring old commands for target `ggml_v2_failsafe.o'
Makefile:478: warning: overriding commands for target `ggml_v2_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:438: warning: ignoring old commands for target `ggml_v2_noavx2.o'
Makefile:480: warning: overriding commands for target `ggml_v2_clblast.o'
/Users/******/test/koboldcpp_dev/Makefile.local:440: warning: ignoring old commands for target `ggml_v2_clblast.o'
Makefile:482: warning: overriding commands for target `ggml_v2_cublas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:442: warning: ignoring old commands for target `ggml_v2_cublas.o'
Makefile:484: warning: overriding commands for target `ggml_v2_clblast_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:444: warning: ignoring old commands for target `ggml_v2_clblast_noavx2.o'
Makefile:488: warning: overriding commands for target `ggml_v1.o'
/Users/******/test/koboldcpp_dev/Makefile.local:448: warning: ignoring old commands for target `ggml_v1.o'
Makefile:490: warning: overriding commands for target `ggml_v1_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:450: warning: ignoring old commands for target `ggml_v1_failsafe.o'
Makefile:494: warning: overriding commands for target `ggml-opencl.o'
/Users/******/test/koboldcpp_dev/Makefile.local:454: warning: ignoring old commands for target `ggml-opencl.o'
Makefile:496: warning: overriding commands for target `ggml_v2-opencl.o'
/Users/******/test/koboldcpp_dev/Makefile.local:456: warning: ignoring old commands for target `ggml_v2-opencl.o'
Makefile:498: warning: overriding commands for target `ggml_v2-opencl-legacy.o'
/Users/******/test/koboldcpp_dev/Makefile.local:458: warning: ignoring old commands for target `ggml_v2-opencl-legacy.o'
Makefile:500: warning: overriding commands for target `ggml_v3-opencl.o'
/Users/******/test/koboldcpp_dev/Makefile.local:460: warning: ignoring old commands for target `ggml_v3-opencl.o'
Makefile:504: warning: overriding commands for target `ggml-vulkan.o'
/Users/******/test/koboldcpp_dev/Makefile.local:464: warning: ignoring old commands for target `ggml-vulkan.o'
Makefile:508: warning: overriding commands for target `llama.o'
/Users/******/test/koboldcpp_dev/Makefile.local:468: warning: ignoring old commands for target `llama.o'
Makefile:510: warning: overriding commands for target `common.o'
/Users/******/test/koboldcpp_dev/Makefile.local:470: warning: ignoring old commands for target `common.o'
Makefile:514: warning: overriding commands for target `console.o'
/Users/******/test/koboldcpp_dev/Makefile.local:472: warning: ignoring old commands for target `console.o'
Makefile:516: warning: overriding commands for target `grammar-parser.o'
/Users/******/test/koboldcpp_dev/Makefile.local:474: warning: ignoring old commands for target `grammar-parser.o'
Makefile:518: warning: overriding commands for target `expose.o'
/Users/******/test/koboldcpp_dev/Makefile.local:476: warning: ignoring old commands for target `expose.o'
Makefile:535: warning: overriding commands for target `gpttype_adapter_failsafe.o'
/Users/******/test/koboldcpp_dev/Makefile.local:481: warning: ignoring old commands for target `gpttype_adapter_failsafe.o'
Makefile:537: warning: overriding commands for target `gpttype_adapter.o'
/Users/******/test/koboldcpp_dev/Makefile.local:483: warning: ignoring old commands for target `gpttype_adapter.o'
Makefile:539: warning: overriding commands for target `gpttype_adapter_clblast.o'
/Users/******/test/koboldcpp_dev/Makefile.local:485: warning: ignoring old commands for target `gpttype_adapter_clblast.o'
Makefile:541: warning: overriding commands for target `gpttype_adapter_cublas.o'
/Users/******/test/koboldcpp_dev/Makefile.local:487: warning: ignoring old commands for target `gpttype_adapter_cublas.o'
Makefile:543: warning: overriding commands for target `gpttype_adapter_clblast_noavx2.o'
/Users/******/test/koboldcpp_dev/Makefile.local:489: warning: ignoring old commands for target `gpttype_adapter_clblast_noavx2.o'
Makefile:545: warning: overriding commands for target `gpttype_adapter_vulkan.o'
/Users/******/test/koboldcpp_dev/Makefile.local:491: warning: ignoring old commands for target `gpttype_adapter_vulkan.o'
Makefile:550: warning: overriding commands for target `clean'
/Users/******/test/koboldcpp_dev/Makefile.local:494: warning: ignoring old commands for target `clean'
Makefile:556: warning: overriding commands for target `main'
/Users/******/test/koboldcpp_dev/Makefile.local:497: warning: ignoring old commands for target `main'
Makefile:565: warning: overriding commands for target `gguf'
/Users/******/test/koboldcpp_dev/Makefile.local:503: warning: ignoring old commands for target `gguf'
Makefile:572: warning: overriding commands for target `koboldcpp_default'
/Users/******/test/koboldcpp_dev/Makefile.local:508: warning: ignoring old commands for target `koboldcpp_default'
Makefile:576: warning: overriding commands for target `koboldcpp_openblas'
/Users/******/test/koboldcpp_dev/Makefile.local:512: warning: ignoring old commands for target `koboldcpp_openblas'
Makefile:587: warning: overriding commands for target `koboldcpp_failsafe'
/Users/******/test/koboldcpp_dev/Makefile.local:523: warning: ignoring old commands for target `koboldcpp_failsafe'
Makefile:595: warning: overriding commands for target `koboldcpp_noavx2'
/Users/******/test/koboldcpp_dev/Makefile.local:531: warning: ignoring old commands for target `koboldcpp_noavx2'
Makefile:610: warning: overriding commands for target `koboldcpp_clblast'
/Users/******/test/koboldcpp_dev/Makefile.local:546: warning: ignoring old commands for target `koboldcpp_clblast'
Makefile:612: warning: overriding commands for target `koboldcpp_clblast_noavx2'
/Users/******/test/koboldcpp_dev/Makefile.local:548: warning: ignoring old commands for target `koboldcpp_clblast_noavx2'
Makefile:620: warning: overriding commands for target `koboldcpp_cublas'
/Users/******/test/koboldcpp_dev/Makefile.local:556: warning: ignoring old commands for target `koboldcpp_cublas'
Makefile:628: warning: overriding commands for target `koboldcpp_hipblas'
/Users/******/test/koboldcpp_dev/Makefile.local:564: warning: ignoring old commands for target `koboldcpp_hipblas'
Makefile:643: warning: overriding commands for target `koboldcpp_vulkan'
/Users/******/test/koboldcpp_dev/Makefile.local:572: warning: ignoring old commands for target `koboldcpp_vulkan'
Makefile:652: warning: overriding commands for target `quantize_gptj'
/Users/******/test/koboldcpp_dev/Makefile.local:579: warning: ignoring old commands for target `quantize_gptj'
Makefile:654: warning: overriding commands for target `quantize_gpt2'
/Users/******/test/koboldcpp_dev/Makefile.local:581: warning: ignoring old commands for target `quantize_gpt2'
Makefile:656: warning: overriding commands for target `quantize_neox'
/Users/******/test/koboldcpp_dev/Makefile.local:583: warning: ignoring old commands for target `quantize_neox'
Makefile:658: warning: overriding commands for target `quantize_mpt'
/Users/******/test/koboldcpp_dev/Makefile.local:585: warning: ignoring old commands for target `quantize_mpt'
Makefile:664: warning: overriding commands for target `simpleclinfo'
/Users/******/test/koboldcpp_dev/Makefile.local:589: warning: ignoring old commands for target `simpleclinfo'
Makefile:667: warning: overriding commands for target `build-info.h'
/Users/******/test/koboldcpp_dev/Makefile.local:593: warning: ignoring old commands for target `build-info.h'
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -Ofast -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL  -c ggml.c -o ggml.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -Ofast -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL  -c otherarch/ggml_v3.c -o ggml_v3.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -Ofast -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL  -c otherarch/ggml_v2.c -o ggml_v2.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -Ofast -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL  -c otherarch/ggml_v1.c -o ggml_v1.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c expose.cpp -o expose.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
expose.cpp:208:24: warning: 'generate' has C-linkage specified, but returns user-defined type 'generation_outputs' which is incompatible with C [-Wreturn-type-c-linkage]
    generation_outputs generate(const generation_inputs inputs)
                       ^
expose.cpp:217:27: warning: 'sd_generate' has C-linkage specified, but returns user-defined type 'sd_generation_outputs' which is incompatible with C [-Wreturn-type-c-linkage]
    sd_generation_outputs sd_generate(const sd_generation_inputs inputs)
                          ^
expose.cpp:226:32: warning: 'whisper_generate' has C-linkage specified, but returns user-defined type 'whisper_generation_outputs' which is incompatible with C [-Wreturn-type-c-linkage]
    whisper_generation_outputs whisper_generate(const whisper_generation_inputs inputs)
                               ^
expose.cpp:278:25: warning: 'token_count' has C-linkage specified, but returns user-defined type 'token_count_outputs' which is incompatible with C [-Wreturn-type-c-linkage]
    token_count_outputs token_count(const char * input, bool addbos)
                        ^
4 warnings generated.
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c gpttype_adapter.cpp -o gpttype_adapter.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
In file included from gpttype_adapter.cpp:18:
In file included from ./otherarch/llama_v2.cpp:9:
./otherarch/llama_v2.h:171:33: warning: 'legacy_llama_v2_tokenize' has C-linkage specified, but returns user-defined type 'std::vector<llama_v2_token>' (aka 'vector<int>') which is incompatible with C [-Wreturn-type-c-linkage]
    std::vector<llama_v2_token> legacy_llama_v2_tokenize(struct llama_v2_context * ctx, const std::string & text, bool add_bos);
                                ^
In file included from gpttype_adapter.cpp:23:
./otherarch/gptj_v2.cpp:298:52: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                            __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                                   ^~~~~~~~~~~~~
./otherarch/gptj_v2.cpp:298:67: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                            __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                                                  ^~~~~~~~~~~~~
In file included from gpttype_adapter.cpp:24:
./otherarch/gptj_v3.cpp:308:52: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                            __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                                   ^~~~~~~~~~~~~
./otherarch/gptj_v3.cpp:308:67: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                            __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                                                  ^~~~~~~~~~~~~
In file included from gpttype_adapter.cpp:26:
./otherarch/gpt2_v2.cpp:291:48: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                        __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                               ^~~~~~~~~~~~~
./otherarch/gpt2_v2.cpp:291:63: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
                        __func__, name.data(), tensor->ne[0], tensor->ne[1], ne[0], ne[1]);
                                                              ^~~~~~~~~~~~~
In file included from gpttype_adapter.cpp:28:
./otherarch/rwkv_v2.cpp:370:103: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    RWKV_V2_ASSERT_NULL(emb->ne[0] == model->n_embed, "Unexpected dimension of embedding matrix %ld", emb->ne[0]);
                                                                                                ~~~   ^~~~~~~~~~
                                                                                                %lld
./otherarch/rwkv_v2.cpp:39:29: note: expanded from macro 'RWKV_V2_ASSERT_NULL'
            fprintf(stderr, __VA_ARGS__); \
                            ^~~~~~~~~~~
./otherarch/rwkv_v2.cpp:371:103: warning: format specifies type 'long' but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    RWKV_V2_ASSERT_NULL(emb->ne[1] == model->n_vocab, "Unexpected dimension of embedding matrix %ld", emb->ne[1]);
                                                                                                ~~~   ^~~~~~~~~~
                                                                                                %lld
./otherarch/rwkv_v2.cpp:39:29: note: expanded from macro 'RWKV_V2_ASSERT_NULL'
            fprintf(stderr, __VA_ARGS__); \
                            ^~~~~~~~~~~
9 warnings generated.
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c otherarch/sdcpp/sdtype_adapter.cpp -o sdcpp_default.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
In file included from otherarch/sdcpp/sdtype_adapter.cpp:15:
In file included from ./otherarch/sdcpp/stable-diffusion.cpp:1:
./otherarch/sdcpp/ggml_extend.hpp:84:43: warning: format specifies type 'size_t' (aka 'unsigned long') but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    printf("shape(%zu, %zu, %zu, %zu)\n", tensor->ne[0], tensor->ne[1], tensor->ne[2], tensor->ne[3]);
                  ~~~                     ^~~~~~~~~~~~~
                  %lld
./otherarch/sdcpp/ggml_extend.hpp:84:58: warning: format specifies type 'size_t' (aka 'unsigned long') but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    printf("shape(%zu, %zu, %zu, %zu)\n", tensor->ne[0], tensor->ne[1], tensor->ne[2], tensor->ne[3]);
                       ~~~                               ^~~~~~~~~~~~~
                       %lld
./otherarch/sdcpp/ggml_extend.hpp:84:73: warning: format specifies type 'size_t' (aka 'unsigned long') but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    printf("shape(%zu, %zu, %zu, %zu)\n", tensor->ne[0], tensor->ne[1], tensor->ne[2], tensor->ne[3]);
                            ~~~                                         ^~~~~~~~~~~~~
                            %lld
./otherarch/sdcpp/ggml_extend.hpp:84:88: warning: format specifies type 'size_t' (aka 'unsigned long') but the argument has type 'int64_t' (aka 'long long') [-Wformat]
    printf("shape(%zu, %zu, %zu, %zu)\n", tensor->ne[0], tensor->ne[1], tensor->ne[2], tensor->ne[3]);
                                 ~~~                                                   ^~~~~~~~~~~~~
                                 %lld
In file included from otherarch/sdcpp/sdtype_adapter.cpp:15:
In file included from ./otherarch/sdcpp/stable-diffusion.cpp:14:
./otherarch/sdcpp/tae.hpp:194:17: warning: field 'decode_only' is uninitialized when used here [-Wuninitialized]
          taesd(decode_only),
                ^
In file included from otherarch/sdcpp/sdtype_adapter.cpp:34:
./otherarch/sdcpp/thirdparty/stb_image_resize.h:760:31: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(scale <= 1);
                        ~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:778:31: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(scale <= 1);
                        ~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1041:56: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(in_last_pixel - in_first_pixel <= (int)ceil(stbir__filter_info_table[filter].support(1/scale) * 2)); // Taken directly from stbir__get_coefficient_width() which we can't call because we don't know if we're horizontal or vertical.
                        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1046:41: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(contributor->n1 >= contributor->n0);
                        ~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1064:128: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(stbir__filter_info_table[filter].kernel((float)(in_last_pixel + 1) + 0.5f - in_center_of_out, 1/scale) == 0);
                        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1066:38: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(total_filter > 0.9);
                        ~~~~~~~~~~~~ ^ ~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1067:38: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(total_filter < 1.1f); // Make sure it's not way off.
                        ~~~~~~~~~~~~ ^ ~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1089:59: warning: expression result unused [-Wunused-value]
     STBIR__DEBUG_ASSERT(out_last_pixel - out_first_pixel <= (int)ceil(stbir__filter_info_table[filter].support(scale_ratio) * 2)); // Taken directly from stbir__get_coefficient_width() which we can't call because we don't know if we're horizontal or vertical.
                         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1094:41: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(contributor->n1 >= contributor->n0);
                        ~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1103:133: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(stbir__filter_info_table[filter].kernel((float)(out_last_pixel + 1) + 0.5f - out_center_of_in, scale_ratio) == 0);
                        ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1138:35: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(total > 0.9f);
                            ~~~~~ ^ ~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1139:35: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(total < 1.1f);
                            ~~~~~ ^ ~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1427:47: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(ring_buffer_index != stbir_info->ring_buffer_begin_index);
                            ~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1459:32: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(n1 >= n0);
                            ~~ ^  ~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1460:32: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(n0 >= -stbir_info->horizontal_filter_pixel_margin);
                            ~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1461:32: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(n1 >= -stbir_info->horizontal_filter_pixel_margin);
                            ~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1462:32: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(n0 < stbir_info->input_w + stbir_info->horizontal_filter_pixel_margin);
                            ~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1463:32: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(n1 < stbir_info->input_w + stbir_info->horizontal_filter_pixel_margin);
                            ~~ ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1471:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1480:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1490:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1501:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1514:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1537:25: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(!stbir__use_width_upsampling(stbir_info));
                        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1555:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1576:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1598:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1621:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:1646:53: warning: expression result unused [-Wunused-value]
                    STBIR__DEBUG_ASSERT(coefficient != 0);
                                        ~~~~~~~~~~~ ^  ~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2005:25: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(!stbir__use_height_upsampling(stbir_info));
                        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2079:66: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(in_last_scanline - in_first_scanline <= stbir_info->vertical_filter_pixel_width);
                            ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2171:25: warning: expression result unused [-Wunused-value]
    STBIR__DEBUG_ASSERT(!stbir__use_height_upsampling(stbir_info));
                        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2180:68: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT(out_last_scanline - out_first_scanline <= stbir_info->vertical_filter_pixel_width);
                            ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2382:92: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT((size_t)STBIR__NEXT_MEMPTR(info->encode_buffer, unsigned char) == (size_t)tempmem + tempmem_size_in_bytes);
                            ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
./otherarch/sdcpp/thirdparty/stb_image_resize.h:2390:90: warning: expression result unused [-Wunused-value]
        STBIR__DEBUG_ASSERT((size_t)STBIR__NEXT_MEMPTR(info->ring_buffer, unsigned char) == (size_t)tempmem + tempmem_size_in_bytes);
                            ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ ^  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
otherarch/sdcpp/sdtype_adapter.cpp:267:73: warning: result of comparison of constant 244 with expression of type 'char' is always true [-Wtautological-constant-out-of-range-compare]
        if (static_cast<unsigned char>(ch) <= 0x7F || (ch >= 0xC2 && ch <= 0xF4)) {
                                                                     ~~ ^  ~~~~
otherarch/sdcpp/sdtype_adapter.cpp:267:59: warning: result of comparison of constant 194 with expression of type 'char' is always false [-Wtautological-constant-out-of-range-compare]
        if (static_cast<unsigned char>(ch) <= 0x7F || (ch >= 0xC2 && ch <= 0xF4)) {
                                                       ~~ ^  ~~~~
42 warnings generated.
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c otherarch/whispercpp/whisper_adapter.cpp -o whispercpp_default.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c examples/llava/clip.cpp -o llavaclip_default.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c examples/llava/llava.cpp -o llava.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL -c ggml-backend.c -o ggml-backend_default.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL -c ggml-alloc.c -o ggml-alloc.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL  -c ggml-quants.c -o ggml-quants.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c unicode.cpp -o unicode.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c unicode-data.cpp -o unicode-data.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL  -c sgemm.cpp -o sgemm.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c common/common.cpp -o common.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c common/sampling.cpp -o sampling.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL -c common/grammar-parser.cpp -o grammar-parser.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
== Preparing merged Metal file ==
cc -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL -c ggml-metal.m -o ggml-metal.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
cc  -I.            -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c11   -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG -DSD_USE_METAL -c ggml-backend.c -o ggml-backend.o
clang: warning: argument unused during compilation: '-s' [-Wunused-command-line-argument]
c++ -I. -I./common -I./include -I./include/CL -I./otherarch -I./otherarch/tools -I./otherarch/sdcpp -I./otherarch/sdcpp/thirdparty -I./include/vulkan -O3 -fno-finite-math-only -DNDEBUG -std=c++11 -fPIC -DLOG_DISABLE_LOGS -D_GNU_SOURCE -DGGML_USE_LLAMAFILE -pthread -s -Wno-multichar -Wno-write-strings -Wno-deprecated -Wno-deprecated-declarations -pthread -DGGML_USE_METAL -DSD_USE_METAL  ggml.o ggml_v3.o ggml_v2.o ggml_v1.o expose.o gpttype_adapter.o sdcpp_default.o whispercpp_default.o llavaclip_default.o llava.o ggml-backend_default.o ggml-alloc.o ggml-quants.o unicode.o unicode-data.o sgemm.o common.o sampling.o grammar-parser.o ggml-metal.o ggml-backend.o -shared -o koboldcpp_default.so  -ld_classic -framework Accelerate -framework Foundation -framework Metal -framework MetalKit -framework MetalPerformanceShaders
ld: warning: -s is obsolete
ld: warning: option -s is obsolete and being ignored
duplicate symbol '_ggml_backend_tensor_copy' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_copy' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_event_new' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_new' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_is_cpu' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_is_host' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_is_host' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_get_count' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_get_alignment' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_alignment' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_get_alignment' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_view_init' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_cpu_init' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_init' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_event_wait' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_reset' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_reset' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_set' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_get' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_get_n_splits' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_get_n_copies' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_cpu_set_n_threads' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_init_backend_from_str' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_cpu_buffer_from_ptr' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_copy_tensor' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_init_tensor' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_register' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_is_multi_buffer' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_alloc_buffer' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_multi_buffer_alloc_buffer' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_alloc_buffer' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_alloc_buffer' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_clear' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_supports_op' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_offload_op' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_cpu_set_abort_callback' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_set_eval_callback' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_alloc_graph' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_get_max_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_max_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_get_max_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_get_buffer_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_get_alloc_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_alloc_size' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_event_synchronize' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_synchronize' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_synchronize' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_reserve' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_plan_compute' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_compute' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_graph_compute' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_plan_create' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_base' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_get_type' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_cpu_buffer_type' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_get_default_buffer_type' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_get_default_buffer_type' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_find_by_name' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_name' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_get_name' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_name' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_name' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_multi_buffer_set_usage' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_set_usage' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_copy_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_event_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buffer_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_plan_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_free' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_event_record' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_reg_init_backend' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_buft_supports_backend' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_set_tensor_backend' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_get_tensor_backend' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_compare_graph_backend' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_guid' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_alloc' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_copy_async' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_set_async' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_tensor_get_async' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_graph_compute_async' in:
    ggml-backend_default.o
    ggml-backend.o
duplicate symbol '_ggml_backend_sched_graph_compute_async' in:
    ggml-backend_default.o
    ggml-backend.o
ld: 84 duplicate symbols for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
make: *** [koboldcpp_default] Error 1
koboldcpp_dev % 

Same error was happend with LLAMA_METAL=1 make koboldcpp_default too.

@beebopkim
Copy link
Author

Oh my bad. This is my fault. I happened to create a backup file called Makefile.local a while ago, but it was so old that I forgot about it, and it became a problem this time.

@LostRuins
Copy link
Owner

Ah alright. This was probably triggered because of #896

Is it working fine for you now then?

@LostRuins
Copy link
Owner

Hi @beebopkim , could I trouble you to see if the latest concedo_experimental builds and works on macOS with both regular Accelerate and also LLAMA_METAL=1?

llama.cpp recently restructured openblas/accelerate out to a different backend, and also removed clblast in ggerganov#7735, so I've had to do a little bit of changes myself to preserve CLBlast. Just want to confirm that I didn't accidentally break macOS builds in the process.

@beebopkim
Copy link
Author

I have no problems now. I renamed the backup in Makefile and the problem went away. There is no problem building with LLAMA_METAL=1 on macOS.

@LostRuins
Copy link
Owner

okay great, that means the Accelerate refactor works

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants