Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Getting Kernel panic "Asynchronous SError Interrupt" after upgrading to 6.12.0-1002.2 #160

Open
Rad0van opened this issue Jan 19, 2025 · 24 comments

Comments

@Rad0van
Copy link

Rad0van commented Jan 19, 2025

Getting kernel panic on boot after upgrading to 6.12.0-1002.2. However this happens also if 6.10.0-1001.1 is chosen and even in recovery mode. It is 24.10 KDE desktop upgraded from 24.04. Clueless what to do here. MacBook Pro Max M2.

@tobhe
Copy link
Member

tobhe commented Jan 20, 2025

Sorry for that. Can you share the crash log? The more info we have the easier it will be to track down.

@Rad0van
Copy link
Author

Rad0van commented Jan 20, 2025

Sorry for that. Can you share the crash log? The more info we have the easier it will be to track down.

Gladly but I do not know how. It starts booting and then crashes to that pink screen. Is there some key sequence to show the boot log?

@theoparis
Copy link

theoparis commented Jan 20, 2025

I encountered the same issue here on a M2 MBP after updating Ubuntu. I do not know how to access the crash logs either, it shows a screen with a ASCII linux penguin at the top left and then says something along the lines of "kernel panic" and "reboot your computer". This seems to be the new DRM panic screen: https://www.phoronix.com/news/Linux-DRM-Panic-BSoD-Picture

@jmurudi
Copy link

jmurudi commented Jan 20, 2025

I have also encountered same issue now.

@tobhe
Copy link
Member

tobhe commented Jan 20, 2025

Working on a fix, I have removed the update from the PPA for now. The fact that selecting an older kernel doesn't work suggests that it might be a device tree problem. I'll let you all know once I know more.

@tobhe
Copy link
Member

tobhe commented Jan 20, 2025

@theoparis @jmurudi are your devices also MacBook Pro Max M2?

@tobhe
Copy link
Member

tobhe commented Jan 20, 2025

You could try restoring your previous m1n1 from macos for now and see if that helps.

  1. Find your EFI partition:
diskutil list | grep EFI
   4:                        EFI EFI - UBUNT             500.2 MB   disk0s4
  1. Mount it (don't copy verbatim, make sure the name is matches the partition found in the previous step)
diskutil mount /dev/disk0s4
  1. Backup m1n1
cd /Volumes/EFI\ -\ UBUNT/m1n1
cp boot.bin* ~/
  1. Restore boot.bin.old
mv boot.bin.old boot.bin
  1. Reboot and see if Ubuntu boots now

@Rad0van
Copy link
Author

Rad0van commented Jan 20, 2025

You could try restoring your previous m1n1 from macos for now and see if that helps.

  1. Find your EFI partition:
diskutil list | grep EFI
   4:                        EFI EFI - UBUNT             500.2 MB   disk0s4
  1. Mount it (don't copy verbatim, make sure the name is matches the partition found in the previous step)
diskutil mount /dev/disk0s4
  1. Backup m1n1
cd /Volumes/EFI\ -\ UBUNT/m1n1
cp boot.bin* ~/
  1. Restore boot.bin.old
mv boot.bin.old boot.bin
  1. Reboot and see if Ubuntu boots now

It does NOT unfortunately :-( Not even with older kernel. I have even tried upgrading MacOS to latest one.

Image

@tobhe
Copy link
Member

tobhe commented Jan 20, 2025

@Rad0van Looking at the drm panic documentation it looks like adding drm.panic_screen=kmsg to your kernel command line (via grub) might give us some more info.

I have a suspicion what might be causing it. There have been reports of similar errros caused by the controller for the sd-card reader. Try adding module_blacklist=sdhci_pci on the command line, that might fix it.

@Rad0van
Copy link
Author

Rad0van commented Jan 20, 2025

@Rad0van Looking at the drm panic documentation it looks like adding drm.panic_screen=kmsg to your kernel command line (via grub) might give us some more info.

I have a suspicion what might be causing it. There have been reports of similar errros caused by the controller for the sd-card reader. Try adding module_blacklist=sdhci_pci on the command line, that might fix it.

Blacklisting sdhci_pci does not help. DRM panic screen works, here's what it shows:

Image

@tobhe
Copy link
Member

tobhe commented Jan 20, 2025

So it isn't what I initially suspected. Do you think you can restore boot.bin from your macos home directory and see if the error is the same (to make sure we didn't break it by switching to the old one)?

@Rad0van
Copy link
Author

Rad0van commented Jan 20, 2025

So it isn't what I initially suspected. Do you think you can restore boot.bin from your macos home directory and see if the error is the same (to make sure we didn't break it by switching to the old one)?

AFAICT the same

Image

@Rad0van
Copy link
Author

Rad0van commented Jan 20, 2025

I'm wondering what could have changed in a way it affects the system even if old(er) m1n1 and kernel is being used. What part of the system is affected / modified as well?

@nbosb
Copy link

nbosb commented Jan 20, 2025

I upgraded from Ubuntu 23.10 today and get exactly the same error on a Mac mini M2

Image

@tobhe
Copy link
Member

tobhe commented Jan 20, 2025

Thanks for all the help! I think we found the issue and are working on a fix to test. Issue seems to be related to AsahiLinux/linux@90356e1

@Rad0van I don't really have an explanation for why the old dtb and kernel don't work either but let's hope the fix still works.

@Rad0van
Copy link
Author

Rad0van commented Jan 20, 2025

Thanks for all the help! I think we found the issue and are working on a fix to test. Issue seems to be related to AsahiLinux/linux@90356e1

@Rad0van I don't really have an explanation for why the old dtb and kernel don't work either but let's hope the fix still works.

Nice. Would be happy to test. But would be curious on how to actually apply the fix...

@tobhe
Copy link
Member

tobhe commented Jan 20, 2025

Our fix is an updated m1n1binary with the new device-trees included. You can test it by either manually downloading https://files.tobhe.de/ubuntu/m1n1.bin and copying it to your ESP as boot.bin as described above or simply run:
curl -F https://files.tobhe.de/ubuntu/fix-m1n1 | sh (from macos) which should do the same with less typing.

@Rad0van
Copy link
Author

Rad0van commented Jan 20, 2025

Our fix is an updated m1n1binary with the new device-trees included. You can test it by either manually downloading https://files.tobhe.de/ubuntu/m1n1.bin and copying it to your ESP as boot.bin as described above or simply run: curl -F https://files.tobhe.de/ubuntu/fix-m1n1 | sh (from macos) which should do the same with less typing.

Nice. Is the fix already available? Should I try it?

@tobhe
Copy link
Member

tobhe commented Jan 20, 2025

This should already work, if you can test it that would be very helpful because we can't reproduce it locally (none of us has an m2 max). Once Ubuntu boots again it will probably want to downgrade the kernel. If everything goes well we will push another update including the fix.

@Rad0van
Copy link
Author

Rad0van commented Jan 20, 2025

And it WORKS! I needed to apply it manually as my partition is named EFI - ASAHI not EFI - UBUNTU but it works. Thanks a lot!

@tobhe
Copy link
Member

tobhe commented Jan 20, 2025

Great :) I'll try to adjust that script and we will make sure to ship an updated kernel later today. Thank you so much for your help debugging this!

@john-cabaj
Copy link
Member

@Rad0van @nbosb @jmurudi @theoparis - just published a new kernel, 6.12.0-1004.4. It should be available for releases 24.04 and newer. Let me know if you have any issues with it, and thanks for the issue reports!

@nbosb
Copy link

nbosb commented Jan 21, 2025

i just updated to the new kernel. it seems to work fine on my machine. thanks for the support and the quick fix!

@Rad0van
Copy link
Author

Rad0van commented Jan 21, 2025

Works fine for me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

6 participants