I recently started to experience a kernel crash when trying to resume from hibernation: Failure to resume from hibernate with kernel 6.15 . The problem remained unsolved after my first post, so I tried to gather more info. This is what I found:
installed EOS LTS kernel: hibernation works;
installed other versions of the kernel: apparently all versions < 6.15.1 properly work, all versions >= 6.15.1 crash;
tried to install another distro (Gentoo Linux) on a USB pen drive, with both kernel 6.12.x and 6.15.9: everything properly works, the system can hibernate and resume without crashing;
tried to install EOS on the same USB pen drive: resuming from hibernation in a fresh installation crashes.
From my tests, it seems to be an issue specific of EOS and of kernel versions >= 6.15.1, but probably specific of my hardware. Cannot reproduce in other distros (actually I only tested one other distro).
Anyone who could think of anything that I could do to investigate the problem further? I cannot report the issue to the kernel devs as it works properly in Gentoo. Any other place where I could report this?
I suspect that may be a hardware/BIOS issue, might even be caused by Microsoft forcing hardware manufacturers to support crazy modes like that “fastboot” (never really shutdown but secretly only suspend). I even found an “s2idle” mode “needed for Windows” in one BIOS.
I have two nearly identical EOS installations on laptops here: One Toshiba Satellite L-70B and one Lenovo Thinkpad T14 Gen 1. The Thinkpad has a BIOS setting for suspend mode which you can set to “Windows” or “Linux”, the Toshiba has a much older BIOS and none of that.
The Toshiba will often be stuck on resume, the Thinkpad never.
Now I run both Timeshift and Back in Time in a “1 automated snapshot per day” mode and apparently just sometimes close the lid when one of these is still running.
Result: On both, suspending takes much longer (maybe it finishes the snapshot first, maybe it aborts after some time, don’t really know), then they suspend.
When this happens, the Toshiba will regularly wake up to a frozen LightDM screen (time of suspend shown, not current) without any means to log in, and I have to REISUB it,
The Thinkpad comes back normally, and all is well.
Don’t really know if this is a problem when processes like Timeshift are still running or an actual hardware/BIOS problem.
But I do suspect the hardware or BIOS. I did a quick check on my 12-year-old Dell Latitude E6510 (on which I updated the BIOS to the latest available from some years back), and that also showed no suspend/resume problems.
Kernel 6.15.9 works in Gentoo but crashes in EOS. Also works on EOS 6.12 and crashes with 6.15. I have no idea what is inside this firmware, but it does sound to be pretty specific of this setup more than firmware-specific. I should probably test other distros, but it would take more time.
this is the otuput. Please note that a few commands returned a lot of text. I pasted the portions that seemed to report errors. Other portions did not show errors and are probably related to kernel 6.12 which properly works.
$ free -m total used free shared buff/cache available Mem: 64053 5357 51953 392 7845 58696 Swap: 66932 0 66932
$ cat /proc/sys/vm/swappiness
60
$ sudo journalctl -r -u hibernate.target
-- Boot c58d02b72e504cbf9d7baf99a9fb1d03 --
May 01 12:21:58 luca-lenovo systemd[1]: hibernate.target: Job hibernate.target/start failed with result 'dependency'.
May 01 12:21:58 luca-lenovo systemd[1]: Dependency failed for System Hibernation.
May 01 12:21:33 luca-lenovo systemd[1]: hibernate.target: Job hibernate.target/start failed with result 'dependency'.
May 01 12:21:33 luca-lenovo systemd[1]: Dependency failed for System Hibernation.
-- Boot af272d6c8ca246fc80a041361c1bbd5f --
Apr 24 22:36:30 luca-lenovo systemd[1]: hibernate.target: Job hibernate.target/start failed with result 'dependency'.
Apr 24 22:36:30 luca-lenovo systemd[1]: Dependency failed for System Hibernation.
Apr 24 19:56:56 luca-lenovo systemd[1]: hibernate.target: Job hibernate.target/start failed with result 'dependency'.
Apr 24 19:56:56 luca-lenovo systemd[1]: Dependency failed for System Hibernation.
$ sudo journalctl -r -u systemd-hibernate.service
-- Boot 3969d0e5021749c0a9c849ef8b3fceeb --
May 03 02:43:07 luca-lenovo systemd[1]: systemd-hibernate.service: Consumed 3.003s CPU time, 971.4M memory peak.
May 03 02:43:07 luca-lenovo systemd[1]: Failed to start System Hibernate.
May 03 02:43:07 luca-lenovo systemd[1]: systemd-hibernate.service: Failed with result 'exit-code'.
May 03 02:43:07 luca-lenovo systemd[1]: systemd-hibernate.service: Main process exited, code=exited, status=1/FAILURE
May 03 02:43:07 luca-lenovo systemd-sleep[3261]: Successfully thawed unit 'user.slice'.
May 03 02:43:07 luca-lenovo systemd-sleep[3261]: Failed to put system to sleep. System resumed again: Connection timed out
May 03 02:43:02 luca-lenovo systemd-sleep[3261]: Performing sleep operation 'hibernate'...
May 03 02:43:02 luca-lenovo systemd-sleep[3261]: Successfully froze unit 'user.slice'.
May 03 02:43:02 luca-lenovo systemd[1]: Starting System Hibernate...
-- Boot 556bbc38838541d38c232e94961a662c --
May 03 02:23:43 luca-lenovo systemd[1]: systemd-hibernate.service: Consumed 2.979s CPU time, 1.3G memory peak.
May 03 02:23:43 luca-lenovo systemd[1]: Failed to start System Hibernate.
May 03 02:23:43 luca-lenovo systemd[1]: systemd-hibernate.service: Failed with result 'exit-code'.
May 03 02:23:43 luca-lenovo systemd[1]: systemd-hibernate.service: Main process exited, code=exited, status=1/FAILURE
May 03 02:23:34 luca-lenovo systemd-sleep[3921]: Performing sleep operation 'hibernate'...
May 03 02:23:34 luca-lenovo systemd-sleep[3921]: Successfully froze unit 'user.slice'.
May 03 02:23:34 luca-lenovo systemd[1]: Starting System Hibernate...
$ sudo systemctl status systemd-hibernate.service
○ systemd-hibernate.service - System Hibernate
Loaded: loaded (/usr/lib/systemd/system/systemd-hibernate.service; static)
Active: inactive (dead)
Docs: man:systemd-hibernate.service(8)
$ systemctl status systemd-hibernate
○ systemd-hibernate.service - System Hibernate
Loaded: loaded (/usr/lib/systemd/system/systemd-hibernate.service; static)
Active: inactive (dead)
Docs: man:systemd-hibernate.service(8)
$ sudo cat /var/log/syslog
cat: /var/log/syslog: No such file or directory
$ sudo fwupdmgr get-updates
Firmware metadata has not been updated for 30 days and may not be up to date.
Update now? (Requires internet connection) [y|N]: y
Updating lvfs
Downloading… [************************************* ]
Successfully downloaded new metadata: Updates have been published for 4 of 27 local devices
Devices with no available firmware updates:
• ELAN0685:00 04F3:320B
• Integrated RGB Camera
• KEK CA
• KEK CA
• Prometheus
• Prometheus IOTA Config
• SKHynix HFS001TEJ9X162N
• ThinkPad Product CA
• UEFI CA
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• UEFI Device Firmware
• USB4 host controller
• Windows UEFI CA
Devices with the latest available firmware version:
• Embedded Controller
• System Firmware
[...]
The last command freezed the system and I had to reset.
Could it be that your sleep.target is missing? The journalctl results and the listed dependencies (with sleep.target not a filled circle) point to that.
cat ./usr/lib/systemd/system/sleep.target
# SPDX-License-Identifier: LGPL-2.1-or-later
#
# This file is part of systemd.
#
# systemd is free software; you can redistribute it and/or modify it
# under the terms of the GNU Lesser General Public License as published by
# the Free Software Foundation; either version 2.1 of the License, or
# (at your option) any later version.
[Unit]
Description=Sleep
Documentation=man:systemd.special(7)
DefaultDependencies=no
RefuseManualStart=yes
StopWhenUnneeded=yes
Also note that, as said at the beginning, this is reproducible with a fresh install of EOS.
I found nothing related in the firmware setup. And I would reasonably think that such a setup that worked in 6.12 should also work in 6.15, which in fact does in Gentoo Linux.
I’m new to EOS, but my understanding is that EOS is based on Arch in such a way that binaries are actually the same. So I’m wondering if this is a problem related to the kernel Arch binaries themselves or related to something else in the setup. To know this, I should probably install a fresh Arch on the USB and test that
I tried to get more logs in many ways, but I couldn’t and logs are not even saved to disk (maybe filesystem is not mounted yet?). What I can see is that the last log is simply “resuming from hibernation…”, at that point caps lock starts blinking.
In a working situation, after that log, I get some kind of progress percentage that indicates the kernel is probably loading data into RAM. Progress is never printed.
Setting loglevel to 7 did not provide more logs. journalctl does not show logs from the “resume” boot.
Ah I see. Do you have a log from when the system goes into hibernation? If you posted one I missed it. Not that anything in there should cause a kernel panic.
Unfortunately it seems that increasing loglevel to 7 does not show anything more in there. Also logs from the boot in which the crash occurs are not stored for some reason, so I cannot read those afterwards. I can only record the screen. Not sure if there is another way to get more logs.
I mean the log of going from the running system into hibernation. Before booting again and the crash occurs. Maybe something fails going into hibernation. Don’t expect to gain much insight, but worth having a look.
I see what you are asking, sorry. This is what I have:
Aug 05 01:39:51 luca-lenovo cat[4280]: About to hibernate
Aug 05 01:39:54 luca-lenovo chrome[3347]: [3347:3367:0805/013954.727252:INFO:chrome/browser/extensions/extension_garbage_collector.cc:184] Garbage collection for extensions on file thread is complete.
Aug 05 01:39:54 luca-lenovo brave[3347]: [3347:3465:0805/013954.855696:ERROR:../src/content/browser/browser_main_loop.cc:276] GLib: g_main_context_pop_thread_default: assertion 'stack != NULL' failed
Aug 05 01:39:54 luca-lenovo brave[3347]: [3347:3466:0805/013954.855697:ERROR:../src/content/browser/browser_main_loop.cc:276] GLib: g_main_context_pop_thread_default: assertion 'stack != NULL' failed
Aug 05 01:39:54 luca-lenovo brave[3347]: [3347:3464:0805/013954.855697:ERROR:../src/content/browser/browser_main_loop.cc:278] GLib: g_main_context_pop_thread_default: assertion 'stack != NULL' failed
Aug 05 01:40:11 luca-lenovo sudo[4432]: luca : TTY=pts/0 ; PWD=/home/luca ; USER=root ; COMMAND=/usr/bin/journalctl -b -1
Aug 05 01:40:11 luca-lenovo sudo[4432]: pam_unix(sudo:session): session opened for user root(uid=0) by luca(uid=1000)
Aug 05 01:40:32 luca-lenovo sudo[4432]: pam_unix(sudo:session): session closed for user root
Aug 05 01:40:35 luca-lenovo sudo[4512]: luca : TTY=pts/0 ; PWD=/home/luca ; USER=root ; COMMAND=/usr/bin/journalctl
Aug 05 01:40:35 luca-lenovo sudo[4512]: pam_unix(sudo:session): session opened for user root(uid=0) by luca(uid=1000)
Aug 05 01:40:51 luca-lenovo sudo[4512]: pam_unix(sudo:session): session closed for user root
Aug 05 01:41:01 luca-lenovo sudo[4613]: luca : TTY=pts/0 ; PWD=/home/luca ; USER=root ; COMMAND=/usr/bin/journalctl --no-pager
Aug 05 01:41:01 luca-lenovo sudo[4613]: pam_unix(sudo:session): session opened for user root(uid=0) by luca(uid=1000)
Aug 05 01:41:14 luca-lenovo sudo[4613]: pam_unix(sudo:session): session closed for user root
Aug 05 01:41:18 luca-lenovo sudo[4693]: luca : TTY=pts/0 ; PWD=/home/luca ; USER=root ; COMMAND=/usr/bin/journalctl --no-pager --tail=100
Aug 05 01:41:18 luca-lenovo sudo[4693]: pam_unix(sudo:session): session opened for user root(uid=0) by luca(uid=1000)
Aug 05 01:41:18 luca-lenovo sudo[4693]: pam_unix(sudo:session): session closed for user root
Aug 05 01:41:34 luca-lenovo sudo[4858]: luca : TTY=pts/0 ; PWD=/home/luca ; USER=root ; COMMAND=/usr/bin/journalctl --no-pager --reverse
Aug 05 01:41:34 luca-lenovo sudo[4858]: pam_unix(sudo:session): session opened for user root(uid=0) by luca(uid=1000)
Aug 05 01:41:36 luca-lenovo sudo[4858]: pam_unix(sudo:session): session closed for user root
Aug 05 01:42:25 luca-lenovo sudo[4988]: luca : TTY=pts/0 ; PWD=/home/luca ; USER=root ; COMMAND=/usr/bin/journalctl --no-pager --pager-end
Aug 05 01:42:25 luca-lenovo sudo[4988]: pam_unix(sudo:session): session opened for user root(uid=0) by luca(uid=1000)
Aug 05 01:42:26 luca-lenovo sudo[4988]: pam_unix(sudo:session): session closed for user root
Aug 05 01:42:33 luca-lenovo sudo[5066]: luca : TTY=pts/0 ; PWD=/home/luca ; USER=root ; COMMAND=/usr/bin/journalctl --pager-end
Aug 05 01:42:33 luca-lenovo sudo[5066]: pam_unix(sudo:session): session opened for user root(uid=0) by luca(uid=1000)
Aug 05 01:42:50 luca-lenovo sudo[5066]: pam_unix(sudo:session): session closed for user root
Aug 05 01:42:53 luca-lenovo plasmashell[2209]: IFFChunk::innerFromDevice: unkwnown chunk "\x89PNG"
Aug 05 01:42:56 luca-lenovo systemd-logind[1111]: The system will hibernate now!
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.7205] manager: sleep: sleep requested (sleeping: no enabled: yes)
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.7206] device (E4:92:82:3A:E6:26): state change: disconnected -> unmanaged (reason 'unmanaged-sleeping', managed-type: 'full')
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.7209] device (p2p-dev-wlan0): state change: disconnected -> unmanaged (reason 'unmanaged-sleeping', managed-type: 'full')
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.7212] manager: NetworkManager state is now ASLEEP
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.7217] device (wlan0): state change: activated -> deactivating (reason 'sleeping', managed-type: 'full')
Aug 05 01:42:56 luca-lenovo plasmashell[2209]: file:///usr/share/plasma/plasmoids/org.kde.plasma.systemtray/contents/ui/items/PlasmoidItem.qml:208: TypeError: Cannot read property 'fullRepresentationItem' of null
Aug 05 01:42:56 luca-lenovo plasmashell[2209]: file:///usr/share/plasma/plasmoids/org.kde.plasma.systemtray/contents/ui/items/PlasmoidItem.qml:201: TypeError: Cannot read property 'compactRepresentationItem' of null
Aug 05 01:42:56 luca-lenovo plasmashell[2209]: file:///usr/share/plasma/plasmoids/org.kde.plasma.systemtray/contents/ui/items/PlasmoidItem.qml:24: TypeError: Cannot read property 'toolTipMainText' of null
Aug 05 01:42:56 luca-lenovo plasmashell[2209]: file:///usr/share/plasma/plasmoids/org.kde.plasma.systemtray/contents/ui/items/PlasmoidItem.qml:208: TypeError: Cannot read property 'fullRepresentationItem' of null
Aug 05 01:42:56 luca-lenovo plasmashell[2209]: file:///usr/share/plasma/plasmoids/org.kde.plasma.systemtray/contents/ui/items/PlasmoidItem.qml:201: TypeError: Cannot read property 'compactRepresentationItem' of null
Aug 05 01:42:56 luca-lenovo plasmashell[2209]: file:///usr/share/plasma/plasmoids/org.kde.plasma.systemtray/contents/ui/items/PlasmoidItem.qml:24: TypeError: Cannot read property 'toolTipMainText' of null
Aug 05 01:42:56 luca-lenovo systemd[1]: Starting Network Manager Script Dispatcher Service...
Aug 05 01:42:56 luca-lenovo dbus-broker[1103]: A security policy denied :1.38 to send method call /org/freedesktop/login1/seat/seat0:org.freedesktop.login1.Seat.Inhibit to org.freedesktop.login1.
Aug 05 01:42:56 luca-lenovo kwin_wayland[2020]: kwin_core: Failed to delay sleep: Sender is not authorized to send message
Aug 05 01:42:56 luca-lenovo dbus-broker[1103]: A security policy denied :1.38 to send method call /org/freedesktop/login1/seat/seat0:org.freedesktop.login1.Seat.Inhibit to org.freedesktop.login1.
Aug 05 01:42:56 luca-lenovo kwin_wayland[2020]: kwin_core: Failed to delay sleep: Sender is not authorized to send message
Aug 05 01:42:56 luca-lenovo systemd[1]: Started Network Manager Script Dispatcher Service.
Aug 05 01:42:56 luca-lenovo kernel: wlan0: deauthenticating from b0:39:56:55:9e:ac by local choice (Reason: 3=DEAUTH_LEAVING)
Aug 05 01:42:56 luca-lenovo wpa_supplicant[1256]: nl80211: send_event_marker failed: Source based routing not supported
Aug 05 01:42:56 luca-lenovo wpa_supplicant[1256]: wlan0: CTRL-EVENT-DISCONNECTED bssid=b0:39:56:55:9e:ac reason=3 locally_generated=1
Aug 05 01:42:56 luca-lenovo wpa_supplicant[1256]: wlan0: CTRL-EVENT-DSCP-POLICY clear_all
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.8434] device (wlan0): supplicant interface state: completed -> disconnected
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.8436] device (wlan0): state change: deactivating -> disconnected (reason 'sleeping', managed-type: 'full')
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: Withdrawing address record for fe80::792e:c8b8:14b9:9f05 on wlan0.
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: Leaving mDNS multicast group on interface wlan0.IPv6 with address fe80::792e:c8b8:14b9:9f05.
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: Interface wlan0.IPv6 no longer relevant for mDNS.
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.8446] dhcp4 (wlan0): canceled DHCP transaction
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.8446] dhcp4 (wlan0): activation: beginning transaction (timeout in 45 seconds)
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.8447] dhcp4 (wlan0): state changed no lease
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: Interface wlan0.IPv4 no longer relevant for mDNS.
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: Leaving mDNS multicast group on interface wlan0.IPv4 with address 192.168.0.120.
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: Withdrawing address record for 192.168.0.120 on wlan0.
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.8583] device (wlan0): set-hw-addr: set MAC address to 66:CD:69:54:8C:30 (scanning)
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: Joining mDNS multicast group on interface wlan0.IPv4 with address 192.168.0.120.
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: New relevant interface wlan0.IPv4 for mDNS.
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: Registering new address record for 192.168.0.120 on wlan0.IPv4.
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: Withdrawing address record for 192.168.0.120 on wlan0.
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: Leaving mDNS multicast group on interface wlan0.IPv4 with address 192.168.0.120.
Aug 05 01:42:56 luca-lenovo avahi-daemon[1104]: Interface wlan0.IPv4 no longer relevant for mDNS.
Aug 05 01:42:56 luca-lenovo NetworkManager[1240]: <info> [1754350976.8961] device (wlan0): state change: disconnected -> unmanaged (reason 'unmanaged-sleeping', managed-type: 'full')
Aug 05 01:42:57 luca-lenovo NetworkManager[1240]: <info> [1754350977.1367] device (wlan0): set-hw-addr: reset MAC address to 00:72:EE:76:FC:78 (unmanage)
Aug 05 01:42:57 luca-lenovo wpa_supplicant[1256]: p2p-dev-wlan0: CTRL-EVENT-DSCP-POLICY clear_all
Aug 05 01:42:57 luca-lenovo wpa_supplicant[1256]: p2p-dev-wlan0: CTRL-EVENT-DSCP-POLICY clear_all
Aug 05 01:42:57 luca-lenovo wpa_supplicant[1256]: nl80211: deinit ifname=p2p-dev-wlan0 disabled_11b_rates=0
Aug 05 01:42:57 luca-lenovo wpa_supplicant[1256]: wlan0: CTRL-EVENT-DSCP-POLICY clear_all
Aug 05 01:42:57 luca-lenovo wpa_supplicant[1256]: wlan0: CTRL-EVENT-DSCP-POLICY clear_all
Aug 05 01:42:57 luca-lenovo wpa_supplicant[1256]: nl80211: deinit ifname=wlan0 disabled_11b_rates=0
Aug 05 01:42:58 luca-lenovo kernel: pci_bus 0000:02: Allocating resources
Aug 05 01:42:58 luca-lenovo kernel: pci_bus 0000:02: Allocating resources
Aug 05 01:42:58 luca-lenovo systemd[1]: Reached target Sleep.
Aug 05 01:42:58 luca-lenovo systemd[1]: Starting System Hibernate...
Aug 05 01:42:58 luca-lenovo systemd[1]: user@1000.service: Unit now frozen-by-parent.
Aug 05 01:42:58 luca-lenovo systemd[1]: session-2.scope: Unit now frozen-by-parent.
Aug 05 01:42:58 luca-lenovo systemd[1]: user.slice: Unit now frozen.
Aug 05 01:42:58 luca-lenovo systemd[1]: user-1000.slice: Unit now frozen-by-parent.
Aug 05 01:42:58 luca-lenovo systemd-sleep[5181]: Successfully froze unit 'user.slice'.
Aug 05 01:42:58 luca-lenovo systemd-sleep[5181]: Performing sleep operation 'hibernate'...
Aug 05 01:42:58 luca-lenovo kernel: PM: hibernation: hibernation entry
This log:
Aug 05 01:39:51 luca-lenovo cat[4280]: About to hibernate
Strange. How did you try to build? And what do you mean by ‘crash’? Compile error? Machine crashes and freezes during compile?
In the meantime, you could try with a live flash drive of CachyOS and with (K)Ubuntu daily (with kernel 6.15) to see if they have the same behavior. I have also kernel 6.15 and hibernation works with EndeavourOS and with Kubuntu.
And what do you mean by ‘crash’? Compile error? Machine crashes and freezes during compile?
No, I do not mean that the build failed. The build succeeded. I then installed the resulting package using pacman -U and I booted running the new kernel with systemd-boot. I hibernated the system, which succeeded (at least apparently). Then booted again and the crash occurred, as usual.
In the meantime, you could try with a live flash drive of CachyOS and with (K)Ubuntu daily (with kernel 6.15) to see if they have the same behavior.
Why CachyOS and Kubuntu? I tried Gentoo on a flash already and it worked with the same exact kernel version I have in EOS. I also tried fresh EOS on the same USB flash drive and it still crashed. I was evaluating to invest more time to test Arch itself, to see how specific the issue is.
