Kernel update causes grub to hang at UEFI logo

[cameron]

When I select grub from my laptops F12 boot menu (or let it boot) since yesterday (with the recent kernel update), the entire laptop hangs. I’ve let it sit for over 10 minutes and nothing happens. (And only Control Alt Delete works to warm reboot.)

Could it be the recent kernel update? The install still works, but downgrading the kernel or even uninstalling timeshift doesn’t work. When I try to run a grun-install, I get this:

Summary

[liveuser@eos-2023.02.08 ~]$ sudo arch-chroot /mnt
[root@EndeavourOS /]# grub-mkconfig -o /boot/grub/grub.cfg
Generating grub configuration file …
Found background: /usr/share/endeavouros/splash.png
Found linux image: /boot/vmlinuz-linux
Found initrd image: /boot/amd-ucode.img /boot/initramfs-linux.img
Found fallback initrd image(s) in /boot: amd-ucode.img initramfs-linux-fallback.img
Detecting snapshots …
Found snapshot: 2023-03-15 18:54:22 | timeshift-btrfs/snapshots/2023-03-15_18-54-22/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-15 13:34:32 | timeshift-btrfs/snapshots/2023-03-15_13-34-32/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-14 20:08:06 | timeshift-btrfs/snapshots/2023-03-14_20-08-06/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-13 18:53:45 | timeshift-btrfs/snapshots/2023-03-13_18-53-45/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-13 11:30:48 | timeshift-btrfs/snapshots/2023-03-13_11-30-48/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 21:56:25 | timeshift-btrfs/snapshots/2023-03-12_21-56-25/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 14:01:50 | timeshift-btrfs/snapshots/2023-03-12_14-01-50/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 13:52:08 | timeshift-btrfs/snapshots/2023-03-12_13-52-07/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-11 19:42:33 | timeshift-btrfs/snapshots/2023-03-11_19-42-33/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-11 11:45:04 | timeshift-btrfs/snapshots/2023-03-11_11-45-04/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-02-15 11:28:49 | timeshift-btrfs/snapshots/2023-02-15_11-28-49/@ | ondemand | Timeshift 2023-02-15 Created After Swap File Changes |
Found snapshot: 2023-01-25 16:21:13 | timeshift-btrfs/snapshots/2023-01-25_16-21-13/@ | ondemand | Timeshift 2023-01-25 |
Found snapshot: 2023-01-23 22:09:01 | timeshift-btrfs/snapshots/2023-01-23_22-09-00/@ | ondemand | My First Btrfs Snapshot |
Found 13 snapshot(s)
Unmount /tmp/grub-btrfs.HNnk0whUXU … Success
Warning: os-prober will not be executed to detect other bootable partitions.
Systems on them will not be added to the GRUB boot configuration.
Check GRUB_DISABLE_OS_PROBER documentation entry.
Adding boot menu entry for UEFI Firmware Settings …
Adding boot menu entry for UEFI Firmware Settings …
Detecting snapshots …
Found snapshot: 2023-03-15 18:54:22 | timeshift-btrfs/snapshots/2023-03-15_18-54-22/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-15 13:34:32 | timeshift-btrfs/snapshots/2023-03-15_13-34-32/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-14 20:08:06 | timeshift-btrfs/snapshots/2023-03-14_20-08-06/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-13 18:53:45 | timeshift-btrfs/snapshots/2023-03-13_18-53-45/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-13 11:30:48 | timeshift-btrfs/snapshots/2023-03-13_11-30-48/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 21:56:25 | timeshift-btrfs/snapshots/2023-03-12_21-56-25/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 14:01:50 | timeshift-btrfs/snapshots/2023-03-12_14-01-50/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 13:52:08 | timeshift-btrfs/snapshots/2023-03-12_13-52-07/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-11 19:42:33 | timeshift-btrfs/snapshots/2023-03-11_19-42-33/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-11 11:45:04 | timeshift-btrfs/snapshots/2023-03-11_11-45-04/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-02-15 11:28:49 | timeshift-btrfs/snapshots/2023-02-15_11-28-49/@ | ondemand | Timeshift 2023-02-15 Created After Swap File Changes |
Found snapshot: 2023-01-25 16:21:13 | timeshift-btrfs/snapshots/2023-01-25_16-21-13/@ | ondemand | Timeshift 2023-01-25 |
Found snapshot: 2023-01-23 22:09:01 | timeshift-btrfs/snapshots/2023-01-23_22-09-00/@ | ondemand | My First Btrfs Snapshot |
Found 13 snapshot(s)
Unmount /tmp/grub-btrfs.2V1EcwC4aF … Success

And then it hangs. Is there a way to reinstall grub, to replace it with systemd-boot, or should I just do a reinstall?

Edit: I am literally typing this from an EndeavourOS Live USB (a Cassini Neo live CD because I have no other USB because I’m on vacation…).

[Kresimir]

@cameron

should I just do a reinstall?

Definitely not.

[cameron]

Then what the heck happened to GRUB (AGAIN!?). This is getting to be a load of barnacles… (I do have to use it because Btrfs, but come on GRUB team.

Literally nobody I’ve seen on the forums had THIS happen; everybody else affected got at least something on the screen. I didn’t.

Edit: inxi yielded

12CPU 8-core AMD Ryzen 7 6800H with Radeon Graphics (-MT MCP-) 12speed/min/max 2100/1600/4784 MHz
12Kernel 6.1.9-arch1-2 x86_64 12Up 21m 12Mem 3135.2/63490.2 MiB (4.9%) 12Storage 9.12 TiB (20.7% used)
12Procs 407 12Client Unknown Client: systemd 12inxi 3.3.25

[Kresimir]

Did you run grub-install after updating GRUB?

[cameron]

Yes. But now it just hangs with that message and doesn’t return to the terminal after running sudo grub-mkconfig -o /boot/grub/grub.cfg

[Kresimir]

And what was the output from it?

[cameron]

[liveuser@eos-2023.02.08 ~]$ sudo arch-chroot /mnt
[root@EndeavourOS /]# grub-mkconfig -o /boot/grub/grub.cfg
Generating grub configuration file …
Found background: /usr/share/endeavouros/splash.png
Found linux image: /boot/vmlinuz-linux
Found initrd image: /boot/amd-ucode.img /boot/initramfs-linux.img
Found fallback initrd image(s) in /boot: amd-ucode.img initramfs-linux-fallback.img
Detecting snapshots …
Found snapshot: 2023-03-15 18:54:22 | timeshift-btrfs/snapshots/2023-03-15_18-54-22/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-15 13:34:32 | timeshift-btrfs/snapshots/2023-03-15_13-34-32/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-14 20:08:06 | timeshift-btrfs/snapshots/2023-03-14_20-08-06/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-13 18:53:45 | timeshift-btrfs/snapshots/2023-03-13_18-53-45/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-13 11:30:48 | timeshift-btrfs/snapshots/2023-03-13_11-30-48/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 21:56:25 | timeshift-btrfs/snapshots/2023-03-12_21-56-25/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 14:01:50 | timeshift-btrfs/snapshots/2023-03-12_14-01-50/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 13:52:08 | timeshift-btrfs/snapshots/2023-03-12_13-52-07/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-11 19:42:33 | timeshift-btrfs/snapshots/2023-03-11_19-42-33/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-11 11:45:04 | timeshift-btrfs/snapshots/2023-03-11_11-45-04/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-02-15 11:28:49 | timeshift-btrfs/snapshots/2023-02-15_11-28-49/@ | ondemand | Timeshift 2023-02-15 Created After Swap File Changes |
Found snapshot: 2023-01-25 16:21:13 | timeshift-btrfs/snapshots/2023-01-25_16-21-13/@ | ondemand | Timeshift 2023-01-25 |
Found snapshot: 2023-01-23 22:09:01 | timeshift-btrfs/snapshots/2023-01-23_22-09-00/@ | ondemand | My First Btrfs Snapshot |
Found 13 snapshot(s)
Unmount /tmp/grub-btrfs.HNnk0whUXU … Success
Warning: os-prober will not be executed to detect other bootable partitions.
Systems on them will not be added to the GRUB boot configuration.
Check GRUB_DISABLE_OS_PROBER documentation entry.
Adding boot menu entry for UEFI Firmware Settings …
Adding boot menu entry for UEFI Firmware Settings …
Detecting snapshots …
Found snapshot: 2023-03-15 18:54:22 | timeshift-btrfs/snapshots/2023-03-15_18-54-22/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-15 13:34:32 | timeshift-btrfs/snapshots/2023-03-15_13-34-32/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-14 20:08:06 | timeshift-btrfs/snapshots/2023-03-14_20-08-06/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-13 18:53:45 | timeshift-btrfs/snapshots/2023-03-13_18-53-45/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-13 11:30:48 | timeshift-btrfs/snapshots/2023-03-13_11-30-48/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 21:56:25 | timeshift-btrfs/snapshots/2023-03-12_21-56-25/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 14:01:50 | timeshift-btrfs/snapshots/2023-03-12_14-01-50/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-12 13:52:08 | timeshift-btrfs/snapshots/2023-03-12_13-52-07/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-11 19:42:33 | timeshift-btrfs/snapshots/2023-03-11_19-42-33/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-03-11 11:45:04 | timeshift-btrfs/snapshots/2023-03-11_11-45-04/@ | ondemand | {timeshift-autosnap} {created before upgrade} |
Found snapshot: 2023-02-15 11:28:49 | timeshift-btrfs/snapshots/2023-02-15_11-28-49/@ | ondemand | Timeshift 2023-02-15 Created After Swap File Changes |
Found snapshot: 2023-01-25 16:21:13 | timeshift-btrfs/snapshots/2023-01-25_16-21-13/@ | ondemand | Timeshift 2023-01-25 |
Found snapshot: 2023-01-23 22:09:01 | timeshift-btrfs/snapshots/2023-01-23_22-09-00/@ | ondemand | My First Btrfs Snapshot |
Found 13 snapshot(s)
Unmount /tmp/grub-btrfs.2V1EcwC4aF … Success

And then it indefinitely hangs.

[cameron]

Could it be due to timeshift or btrfs?

[Kresimir]

Where is the part where you run grub-install?

[cameron]

Here:

# grub-install --bootloader-id=endeavouros
Installing for x86_64-efi platform.
Installation finished. No error reported.

Obviously there is something wrong, because grub-mkconfig (the next command) hangs.

[petsam]

@cameron

Obviously there is something wrong, because grub-mkconfig (the next command) hangs.

Post contents of /etc/grub.d/, for example:

ls -l /etc/grub.d

or with another method.

[cameron]

[root@EndeavourOS grub.d]# ls -lia
total 88
 203057 drwxr-xr-x 1 root root   482 Mar  5 18:10 .
    267 drwxr-xr-x 1 root root  4524 Mar 16 17:41 ..
2328080 -rwxr-xr-x 1 root root  8905 Feb  3 12:49 00_header
 327588 -rwxr-xr-x 1 root root   270 Jan 23 21:52 01_grub-customizer_menu_color_helper
3177518 -rwxr-xr-x 1 root root   951 Mar  5 18:10 10_linux_proxy
2328082 -rwxr-xr-x 1 root root 14287 Feb  3 12:49 20_linux_xen
2328083 -rwxr-xr-x 1 root root 12289 Feb  3 12:49 30_os-prober
3177519 -rwxr-xr-x 1 root root   188 Mar  5 18:10 31_uefi-firmware_proxy
 326184 -rwxr-xr-x 1 root root   286 Jan 23 21:44 45_eos_windows
3177520 -rwxr-xr-x 1 root root   188 Mar  5 18:10 46_uefi-firmware_proxy
2929802 -rwxr-xr-x 1 root root   722 Feb 24 14:42 48_fwupd
2328085 -rwxr-xr-x 1 root root   214 Feb  3 12:49 49_custom
2328086 -rwxr-xr-x 1 root root   215 Feb  3 12:49 50_custom
3177517 -rwxr-xr-x 1 root root   196 Mar  5 18:10 51_snapshots-btrfs_proxy
 327211 drwxr-xr-x 1 root root   102 Jan 23 21:52 backup
3177462 drwxr-xr-x 1 root root    26 Mar  5 18:09 bin
3177456 drwxr-xr-x 1 root root    66 Mar  5 18:10 proxifiedScripts
2328087 -rw-r--r-- 1 root root   483 Feb  3 12:49 README
 327590 -rw-r--r-- 1 root root   321 Mar  5 18:10 .script_sources.txt

[BluishHumility]

@cameron

grub-customizer

Ah, the smoking gun.

@cameron I hope this helps, it includes instructions for back-tracking from Grub Customizer damage:

[FAQ] Why you should NOT use grub-customizer

First of all the name is misleading it is not a customizer for the grub setup, it is instead a customized grub! You do not change grub settings every day, and in 99,999% of cases you change something and never touch it again till something go south with it. And when this happens you have long time forgot about installing grub-customizer and used it to change … boot menu size or something… And if you start using Grub-Customizer you can not really use grub itself anymore in the same way… So …

[petsam]

@cameron

Is there a way to reinstall grub

If you can successfully chroot into the installation

1. Remove grub-customizer

pacman -Rcns grub-customizer

2. Locate files and folders that are unknown to pacman and delete them

pacman -Qqo /etc/grub.d/* 

3. Re-install grub package

pacman -S grub

If during (3) you don’t watch grub-mkconfig output, run explicitly

grub-mkconfig -o /boot/grub/grub.cfg

[cameron]

I followed the instructions, ran the grub-mkconfig commands… And it still doesnt work…

[petsam]

@cameron

And it still doesnt work…

If you want to help, please, give better descriptions of the situation. Why should I hack your eyes vision in order to see what you have watched?
Did you delete any files or folders? Which ones? (more questions I could think later…)

[Kresimir]

@cameron

I followed the instructions,

My bet would be that you didn’t.

If I were to guess, I would say you didn’t do step 2. It’s not sufficient to just run the command

pacman -Qqo /etc/grub.d/*

But to delete (manually) every file that this command outputs. This is the junk left behind when removing grub-customizer.

Of course, this is just a guess, based perhaps unfairly on past experience with people just blindly following commands and not actually bothering to read or understand the instructions. If I am wrong, I apologize.

@cameron

Then what the heck happened to GRUB (AGAIN!?). This is getting to be a load of barnacles… (I do have to use it because Btrfs, but come on GRUB team.

It seems that the GRUB team has been redeemed (AGAIN!).

[ricklinux]

I use grub with btrfs and actually on KDE! I don’t need grub customizer nor do i want it.

[Kresimir]

The user nobody needs grub-customizer.

[cameron]

It wants me to delete grub?