[Bug]: Building AOSP - clang++: error: clang frontend command failed with exit code 139

[rockaport]

Description

Building AOSP panther with the following configuration and compilation command on Ubuntu 23.04 with AMD Ryzen Threadripper 3970X 32-Core Processor and 128 GB of memory and kernel Linux rips 6.2.0-20-generic #20-Ubuntu SMP PREEMPT_DYNAMIC Thu Apr 6 07:48:48 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux.

Configuration

make dist DIST_DIR=$PWD/android-13.0.0_r43-aosp_panther-user-release

PLATFORM_VERSION_CODENAME=REL
PLATFORM_VERSION=13
TARGET_PRODUCT=aosp_panther
TARGET_BUILD_VARIANT=user
TARGET_BUILD_TYPE=release
TARGET_ARCH=arm64
TARGET_ARCH_VARIANT=armv8-2a
TARGET_CPU_VARIANT=cortex-a55
TARGET_2ND_ARCH=arm
TARGET_2ND_ARCH_VARIANT=armv8-a
TARGET_2ND_CPU_VARIANT=generic
HOST_ARCH=x86_64
HOST_2ND_ARCH=x86
HOST_OS=linux
HOST_OS_EXTRA=Linux-6.2.0-20-generic-x86_64-Ubuntu-23.04
HOST_CROSS_OS=windows
HOST_CROSS_ARCH=x86
HOST_CROSS_2ND_ARCH=x86_64
HOST_BUILD_TYPE=release
BUILD_ID=TQ2A.230505.002
OUT_DIR=out

Build Output

FAILED: out/soong/.intermediates/external/aac/libFraunhoferAAC/android_arm64_armv8-2a_cortex-a55_static_scs_apex33/obj/external/aac/libFDK/src/mdct.o
PWD=/proc/self/cwd prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++ -c -D__ANDROID_APEX__ -D__ANDROID_APEX_MIN_SDK_VERSION__=33  -Werror=implicit-function-declaration -DANDROID
 -fmessage-length=0 -W -Wall -Wno-unused -Winit-self -Wpointer-arith -Wunreachable-code-loop-increment -no-canonical-prefixes -DNDEBUG -UDEBUG -fno-exceptions -Wno-multichar -O2 -g -fde
bug-default-version=5 -fno-strict-aliasing -Werror=date-time -Werror=pragma-pack -Werror=pragma-pack-suspicious-include -Werror=string-plus-int -Werror=unreachable-code-loop-increment -
D__compiler_offsetof=__builtin_offsetof -faddrsig -fcommon -Werror=int-conversion -fexperimental-new-pass-manager -Wno-reserved-id-macro -fcolor-diagnostics -Wno-sign-compare -Wno-defau
lted-function-deleted -Wno-inconsistent-missing-override -Wno-c99-designator -Wno-gnu-designator -Wno-gnu-folding-constant -Wunguarded-availability -D__ANDROID_UNAVAILABLE_SYMBOLS_ARE_W
EAK__ -ffp-contract=off -fdebug-prefix-map=/proc/self/cwd= -ftrivial-auto-var-init=zero -enable-trivial-auto-var-init-zero-knowing-it-will-be-removed-from-clang -ffunction-sections -fda
ta-sections -fno-short-enums -funwind-tables -fstack-protector-strong -Wa,--noexecstack -D_FORTIFY_SOURCE=2 -Wstrict-aliasing=2 -Werror=return-type -Werror=non-virtual-dtor -Werror=addr
ess -Werror=sequence-point -Werror=format-security -nostdlibinc -fdebug-info-for-profiling -Wno-enum-compare -Wno-enum-compare-switch -Wno-null-pointer-arithmetic -Wno-null-dereference 
-Wno-pointer-compare -Wno-xor-used-as-pow -Wno-final-dtor-non-final-class -Wno-psabi -Wno-null-pointer-subtraction -Wno-string-concatenation -march=armv8.2-a -mcpu=cortex-a55 -target aa
rch64-linux-android29 -fPIC -Wsign-promo -Wimplicit-fallthrough -D_LIBCPP_ENABLE_THREAD_SAFETY_ANNOTATIONS -Wno-gnu-include-next -fvisibility-inlines-hidden  -Iexternal/aac/libAACdec/in
clude -Iexternal/aac/libAACenc/include -Iexternal/aac/libPCMutils/include -Iexternal/aac/libFDK/include -Iexternal/aac/libSYS/include -Iexternal/aac/libMpegTPDec/include -Iexternal/aac/
libMpegTPEnc/include -Iexternal/aac/libSBRdec/include -Iexternal/aac/libSBRenc/include -Iexternal/aac/libArithCoding/include -Iexternal/aac/libDRCdec/include -Iexternal/aac/libSACdec/in
clude -Iexternal/aac/libSACenc/include -Iexternal/aac -D__LIBLOG_API__=10000 -D__LIBC_API__=10000 -D__LIBM_API__=10000 -D__LIBDL_API__=10000 -Iexternal/libcxx/include -Iexternal/libcxxa
bi/include -Isystem/logging/liblog/include -Ibionic/libc/async_safe/include -Ibionic/libc/system_properties/include -Isystem/core/property_service/libpropertyinfoparser/include -isystem
 bionic/libc/include -isystem bionic/libc/kernel/uapi/asm-arm64 -isystem bionic/libc/kernel/uapi -isystem bionic/libc/kernel/android/scsi -isystem bionic/libc/kernel/android/uapi -Werro
r -Wno-unused-parameter '-Wno-#warnings' -Wuninitialized -Wno-self-assign -Wno-implicit-fallthrough -DSUPPRESS_BUILD_DATE_INFO -fsanitize=unsigned-integer-overflow,signed-integer-overfl
ow,bounds,shadow-call-stack -fsanitize-minimal-runtime -fno-sanitize-trap=integer,undefined -fno-sanitize-recover=integer,undefined -fsanitize-trap=all -ftrap-function=abort -fno-saniti
ze=implicit-integer-sign-change -fno-sanitize=unsigned-shift-base -std=gnu++17 -fno-rtti -Isystem/core/include -Isystem/logging/liblog/include -Isystem/media/audio/include -Ihardware/li
bhardware/include -Ihardware/libhardware_legacy/include -Ihardware/ril/include -Iframeworks/native/include -Iframeworks/native/opengl/include -Iframeworks/av/include  -Werror=bool-opera
tion -Werror=implicit-int-float-conversion -Werror=int-in-bool-context -Werror=int-to-pointer-cast -Werror=pointer-to-int-cast -Werror=string-compare -Werror=xor-used-as-pow -Wno-void-p
ointer-to-enum-cast -Wno-void-pointer-to-int-cast -Wno-pointer-to-int-cast -Werror=fortify-source -Werror=address-of-temporary -Werror=return-type -Wno-tautological-constant-compare -Wn
o-tautological-type-limit-compare -Wno-reorder-init-list -Wno-implicit-int-float-conversion -Wno-sizeof-array-div -Wno-tautological-overlap-compare -Wno-deprecated-copy -Wno-range-loop-
construct -Wno-misleading-indentation -Wno-zero-as-null-pointer-constant -Wno-deprecated-anon-enum-enum-conversion -Wno-string-compare -Wno-pessimizing-move -Wno-non-c-typedef-for-linka
ge -Wno-align-mismatch -Wno-error=unused-but-set-variable -Wno-error=unused-but-set-parameter -Wno-unused-but-set-variable -Wno-unused-but-set-parameter -Wno-bitwise-instead-of-logical 
-MD -MF out/soong/.intermediates/external/aac/libFraunhoferAAC/android_arm64_armv8-2a_cortex-a55_static_scs_apex33/obj/external/aac/libFDK/src/mdct.o.d -o out/soong/.intermediates/exter
nal/aac/libFraunhoferAAC/android_arm64_armv8-2a_cortex-a55_static_scs_apex33/obj/external/aac/libFDK/src/mdct.o external/aac/libFDK/src/mdct.cpp
PLEASE submit a bug report to https://github.com/android-ndk/ndk/issues and include the crash backtrace, preprocessed source, and associated run script.
Stack dump:
0.	Program arguments: prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real -c -D__ANDROID_APEX__ -D__ANDROID_APEX_MIN_SDK_VERSION__=33 -Werror=implicit-function-declarati
on -DANDROID -fmessage-length=0 -W -Wall -Wno-unused -Winit-self -Wpointer-arith -Wunreachable-code-loop-increment -no-canonical-prefixes -DNDEBUG -UDEBUG -fno-exceptions -Wno-multichar
 -O2 -g -fdebug-default-version=5 -fno-strict-aliasing -Werror=date-time -Werror=pragma-pack -Werror=pragma-pack-suspicious-include -Werror=string-plus-int -Werror=unreachable-code-loop
-increment -D__compiler_offsetof=__builtin_offsetof -faddrsig -fcommon -Werror=int-conversion -fexperimental-new-pass-manager -Wno-reserved-id-macro -fcolor-diagnostics -Wno-sign-compar
e -Wno-defaulted-function-deleted -Wno-inconsistent-missing-override -Wno-c99-designator -Wno-gnu-designator -Wno-gnu-folding-constant -Wunguarded-availability -D__ANDROID_UNAVAILABLE_S
YMBOLS_ARE_WEAK__ -ffp-contract=off -fdebug-prefix-map=/proc/self/cwd= -ftrivial-auto-var-init=zero -enable-trivial-auto-var-init-zero-knowing-it-will-be-removed-from-clang -ffunction-s
ections -fdata-sections -fno-short-enums -funwind-tables -fstack-protector-strong -Wa,--noexecstack -D_FORTIFY_SOURCE=2 -Wstrict-aliasing=2 -Werror=return-type -Werror=non-virtual-dtor 
-Werror=address -Werror=sequence-point -Werror=format-security -nostdlibinc -fdebug-info-for-profiling -Wno-enum-compare -Wno-enum-compare-switch -Wno-null-pointer-arithmetic -Wno-null-
dereference -Wno-pointer-compare -Wno-xor-used-as-pow -Wno-final-dtor-non-final-class -Wno-psabi -Wno-null-pointer-subtraction -Wno-string-concatenation -march=armv8.2-a -mcpu=cortex-a5
5 -target aarch64-linux-android29 -fPIC -Wsign-promo -Wimplicit-fallthrough -D_LIBCPP_ENABLE_THREAD_SAFETY_ANNOTATIONS -Wno-gnu-include-next -fvisibility-inlines-hidden -Iexternal/aac/l
ibAACdec/include -Iexternal/aac/libAACenc/include -Iexternal/aac/libPCMutils/include -Iexternal/aac/libFDK/include -Iexternal/aac/libSYS/include -Iexternal/aac/libMpegTPDec/include -Iex
ternal/aac/libMpegTPEnc/include -Iexternal/aac/libSBRdec/include -Iexternal/aac/libSBRenc/include -Iexternal/aac/libArithCoding/include -Iexternal/aac/libDRCdec/include -Iexternal/aac/l
ibSACdec/include -Iexternal/aac/libSACenc/include -Iexternal/aac -D__LIBLOG_API__=10000 -D__LIBC_API__=10000 -D__LIBM_API__=10000 -D__LIBDL_API__=10000 -Iexternal/libcxx/include -Iexter
nal/libcxxabi/include -Isystem/logging/liblog/include -Ibionic/libc/async_safe/include -Ibionic/libc/system_properties/include -Isystem/core/property_service/libpropertyinfoparser/inclu
de -isystem bionic/libc/include -isystem bionic/libc/kernel/uapi/asm-arm64 -isystem bionic/libc/kernel/uapi -isystem bionic/libc/kernel/android/scsi -isystem bionic/libc/kernel/android/
uapi -Werror -Wno-unused-parameter -Wno-#warnings -Wuninitialized -Wno-self-assign -Wno-implicit-fallthrough -DSUPPRESS_BUILD_DATE_INFO -fsanitize=unsigned-integer-overflow,signed-integ
er-overflow,bounds,shadow-call-stack -fsanitize-minimal-runtime -fno-sanitize-trap=integer,undefined -fno-sanitize-recover=integer,undefined -fsanitize-trap=all -ftrap-function=abort -f
no-sanitize=implicit-integer-sign-change -fno-sanitize=unsigned-shift-base -std=gnu++17 -fno-rtti -Isystem/core/include -Isystem/logging/liblog/include -Isystem/media/audio/include -Iha
rdware/libhardware/include -Ihardware/libhardware_legacy/include -Ihardware/ril/include -Iframeworks/native/include -Iframeworks/native/opengl/include -Iframeworks/av/include -Werror=bo
ol-operation -Werror=implicit-int-float-conversion -Werror=int-in-bool-context -Werror=int-to-pointer-cast -Werror=pointer-to-int-cast -Werror=string-compare -Werror=xor-used-as-pow -Wn
o-void-pointer-to-enum-cast -Wno-void-pointer-to-int-cast -Wno-pointer-to-int-cast -Werror=fortify-source -Werror=address-of-temporary -Werror=return-type -Wno-tautological-constant-com
pare -Wno-tautological-type-limit-compare -Wno-reorder-init-list -Wno-implicit-int-float-conversion -Wno-sizeof-array-div -Wno-tautological-overlap-compare -Wno-deprecated-copy -Wno-ran
ge-loop-construct -Wno-misleading-indentation -Wno-zero-as-null-pointer-constant -Wno-deprecated-anon-enum-enum-conversion -Wno-string-compare -Wno-pessimizing-move -Wno-non-c-typedef-f
or-linkage -Wno-align-mismatch -Wno-error=unused-but-set-variable -Wno-error=unused-but-set-parameter -Wno-unused-but-set-variable -Wno-unused-but-set-parameter -Wno-bitwise-instead-of-
logical -MD -MF out/soong/.intermediates/external/aac/libFraunhoferAAC/android_arm64_armv8-2a_cortex-a55_static_scs_apex33/obj/external/aac/libFDK/src/mdct.o.d -o out/soong/.intermediat
es/external/aac/libFraunhoferAAC/android_arm64_armv8-2a_cortex-a55_static_scs_apex33/obj/external/aac/libFDK/src/mdct.o external/aac/libFDK/src/mdct.cpp
1.	<eof> parser at end of file
2.	Code generation
3.	Running pass 'Function Pass Manager' on module 'external/aac/libFDK/src/mdct.cpp'.
4.	Running pass 'Greedy Register Allocator' on function '@_Z10imlt_blockP6mdct_tPiS1_PKsiiiPK8FIXP_SPKiS6_iii'
 #0 0x00000000047d3da8 llvm::sys::PrintStackTrace(llvm::raw_ostream&, int) (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x47d3da8)
 #1 0x00000000047d2f10 llvm::sys::RunSignalHandlers() (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x47d2f10)
 #2 0x000000000479e993 (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x479e993)
 #3 0x000000000479eb71 (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x479eb71)
 #4 0x00007f2af423c4b0 (/lib/x86_64-linux-gnu/libc.so.6+0x3c4b0)
 #5 0x000000000646dcd6 (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x646dcd6)
 #6 0x0000000006172dc4 (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x6172dc4)
 #7 0x000000000617281d (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x617281d)
 #8 0x00000000061720d3 llvm::RegAllocBase::allocatePhysRegs() (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x61720d3)
 #9 0x00000000063a72df (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x63a72df)
#10 0x0000000005d9f8aa llvm::MachineFunctionPass::runOnFunction(llvm::Function&) (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x5d9f8aa)
#11 0x0000000005d9fed3 llvm::FPPassManager::runOnFunction(llvm::Function&) (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x5d9fed3)
#12 0x0000000005d9fa2f llvm::FPPassManager::runOnModule(llvm::Module&) (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x5d9fa2f)
#13 0x0000000006388494 llvm::legacy::PassManagerImpl::run(llvm::Module&) (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x6388494)
#14 0x00000000065b5328 clang::EmitBackendOutput(clang::DiagnosticsEngine&, clang::HeaderSearchOptions const&, clang::CodeGenOptions const&, clang::TargetOptions const&, clang::LangOptio
ns const&, llvm::StringRef, llvm::Module*, clang::BackendAction, std::__1::unique_ptr<llvm::raw_pwrite_stream, std::__1::default_delete<llvm::raw_pwrite_stream> >) (prebuilts/clang/host
/linux-x86/clang-r450784d/bin/clang++.real+0x65b5328)
#15 0x0000000006053215 (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x6053215)
#16 0x0000000005ea22e9 clang::ParseAST(clang::Sema&, bool, bool) (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x5ea22e9)
#17 0x000000000639ee0d clang::FrontendAction::Execute() (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x639ee0d)
#18 0x000000000639ecad clang::CompilerInstance::ExecuteAction(clang::FrontendAction&) (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x639ecad)
#19 0x000000000639f0c1 clang::ExecuteCompilerInvocation(clang::CompilerInstance*) (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x639f0c1)
#20 0x0000000006687454 cc1_main(llvm::ArrayRef<char const*>, char const*, void*) (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x6687454)
#21 0x00000000066842e3 (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x66842e3)
#22 0x0000000006684192 (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x6684192)
#23 0x0000000006684161 llvm::CrashRecoveryContext::RunSafely(llvm::function_ref<void ()>) (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x6684161)
#24 0x0000000006683ef4 clang::driver::CC1Command::Execute(llvm::ArrayRef<llvm::Optional<llvm::StringRef> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator
<char> >*, bool*) const (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x6683ef4)
#25 0x0000000006683d5f clang::driver::Compilation::ExecuteCommand(clang::driver::Command const&, clang::driver::Command const*&) const (prebuilts/clang/host/linux-x86/clang-r450784d/bin
/clang++.real+0x6683d5f)
#26 0x0000000006683bf2 clang::driver::Driver::ExecuteCompilation(clang::driver::Compilation&, llvm::SmallVectorImpl<std::__1::pair<int, clang::driver::Command const*> >&) (prebuilts/cla
ng/host/linux-x86/clang-r450784d/bin/clang++.real+0x6683bf2)
#27 0x0000000006655f2e main (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x6655f2e)
#28 0x00007f2af4223a90 __libc_start_call_main ./csu/../sysdeps/nptl/libc_start_call_main.h:74:3
#29 0x00007f2af4223b49 call_init ./csu/../csu/libc-start.c:128:20
#30 0x00007f2af4223b49 __libc_start_main ./csu/../csu/libc-start.c:347:5
#31 0x00000000064b2f69 _start (prebuilts/clang/host/linux-x86/clang-r450784d/bin/clang++.real+0x64b2f69)
clang++: error: clang frontend command failed with exit code 139 (use -v to see invocation)
Android (8490178, based on r450784d) clang version 14.0.6 (https://android.googlesource.com/toolchain/llvm-project 4c603efb0cca074e9238af8b4106c30add4418f6)
Target: aarch64-unknown-linux-android29
Thread model: posix
InstalledDir: prebuilts/clang/host/linux-x86/clang-r450784d/bin
clang++: note: diagnostic msg: 
********************

PLEASE ATTACH THE FOLLOWING FILES TO THE BUG REPORT:
Preprocessed source(s) and associated run script(s) are located at:
clang++: note: diagnostic msg: /home/andrew/work/aosp/out/soong/.temp/mdct-d71a84.cpp
clang++: note: diagnostic msg: /home/andrew/work/aosp/out/soong/.temp/mdct-d71a84.sh
clang++: note: diagnostic msg: 

********************
[  4% 6821/151550] //bionic/libc:common_libc versioner preprocess include
warning: attempted to generate guard with empty availability: obsoleted = 21
warning: attempted to generate guard with empty availability: obsoleted = 23
06:26:34 ninja failed with: exit status 1

#### failed to build some targets (02:44 (mm:ss)) ####

mdct-d71a84.zip

Upstream bug

No response

Commit to cherry-pick

No response

Affected versions

r24, Canary

Canary version

Android (8490178, based on r450784d) clang version 14.0.6 (https://android.googlesource.com/toolchain/llvm-project 4c603efb0cca074e9238af8b4106c30add4418f6)

Host OS

Linux

Host OS version

Ubuntu 23.04

Affected ABIs

arm64-v8a

[DanAlbert]

Android (8490178, based on r450784d) clang version 14.0.6 (https://android.googlesource.com/toolchain/llvm-project 4c603efb0cca074e9238af8b4106c30add4418f6)

This is not a canary version (which would be the build number from ci.android.com), nor is this the version of clang that's in the r26 canary. Which canary did you try?

[pirama-arumuga-nainar]

We have seen several errors when building AOSP that end up being crashes when the system is under memory pressure. Please re-run reproducer on idle system and see if it fails.

[rockaport]

Android (8490178, based on r450784d) clang version 14.0.6 (https://android.googlesource.com/toolchain/llvm-project 4c603efb0cca074e9238af8b4106c30add4418f6)

This is not a canary version (which would be the build number from ci.android.com), nor is this the version of clang that's in the r26 canary. Which canary did you try?

Sorry, I was quickly digging around to match up r450784d with the NDK version and I didn't see it. According to the r25 changelog it's r25c -> "Updated LLVM to clang-r450784d1, based on LLVM 14 development."

[rockaport]

We have seen several errors when building AOSP that end up being crashes when the system is under memory pressure. Please re-run reproducer on idle system and see if it fails.

Weird, it looks like it's not crashing on an idle system. I was inspecting top while building AOSP and I didn't see it run out of memory or get close to the max of 128GB. I'll pay more attention to system resources next time and see if i'm mistaken.

➜  aosp ls -lh mdct-d71a84.*
-rw-rw-r-- 1 andrew andrew 556K May 28 06:26 mdct-d71a84.cpp
-rwxrwxr-x 1 andrew andrew  16K May 28 06:26 mdct-d71a84.sh
-rw-rw-r-- 1 andrew andrew  85K May 31 05:41 mdct-d71a84.zip
➜  aosp ./mdct-d71a84.sh 
➜  aosp ls -lh mdct-d71a84.*
-rw-rw-r-- 1 andrew andrew 556K May 28 06:26 mdct-d71a84.cpp
-rw-rw-r-- 1 andrew andrew  40K May 31 05:59 mdct-d71a84.o
-rwxrwxr-x 1 andrew andrew  16K May 28 06:26 mdct-d71a84.sh
-rw-rw-r-- 1 andrew andrew  85K May 31 05:41 mdct-d71a84.zip
➜  aosp file mdct-d71a84.o 
mdct-d71a84.o: ELF 64-bit LSB relocatable, ARM aarch64, version 1 (SYSV), with debug_info, not stripped