Systemd-modules-load.service failing to load kernel modules during startup

So my pc takes a good 2m to start. I ran -

systemd-analyze blame

and turns out -

1min 30.101s systemd-modules-load.service

The status of systemd-modules-load.service is as follows -

sudo systemctl status systemd-modules-load.service
systemd-modules-load.service - Load Kernel Modules
     Loaded: loaded (/usr/lib/systemd/system/systemd-modules-load.service; static)
     Active: failed (Result: timeout) since Sat 2023-01-07 12:04:18 IST; 2h 0min ago
       Docs: man:systemd-modules-load.service(8)
             man:modules-load.d(5)
   Main PID: 480 (code=killed, signal=TERM)
        CPU: 263ms

Jan 07 12:02:48 MyLittleWarMachine systemd[1]: Starting Load Kernel Modules...
Jan 07 12:04:18 MyLittleWarMachine systemd[1]: systemd-modules-load.service: start operation timed out. Terminating.
Jan 07 12:04:18 MyLittleWarMachine systemd[1]: systemd-modules-load.service: Main process exited, code=killed, status=15/TERM
Jan 07 12:04:18 MyLittleWarMachine systemd[1]: systemd-modules-load.service: Failed with result 'timeout'.
Jan 07 12:04:18 MyLittleWarMachine systemd[1]: Failed to start Load Kernel Modules.

I went digging into boot journal. The following catches the exact error. The uuid mentioned happens to be my /boot/local

Jan 07 12:02:46 MyLittleWarMachine audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-fsck@dev-disk-by\x2duuid-2F3A\x2d4E54 comm="systemd" exe="/usr/lib/sy>
Jan 07 12:02:46 MyLittleWarMachine systemd[1]: systemd-modules-load.service: Main process exited, code=killed, status=11/SEGV
Jan 07 12:02:46 MyLittleWarMachine systemd[1]: systemd-modules-load.service: Failed with result 'signal'.
Jan 07 12:02:46 MyLittleWarMachine systemd[1]: Failed to start Load Kernel Modules.

Although, this happens to take the most amount of time.

Jan 07 12:02:54 MyLittleWarMachine audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-rfkill comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=?>
Jan 07 12:02:54 MyLittleWarMachine kernel: audit: type=1131 audit(1673073174.200:30): pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-rfkill comm="systemd" exe="/usr/lib/system>
Jan 07 12:03:47 MyLittleWarMachine systemd-udevd[313]: 0000:01:00.0: Worker [319] processing SEQNUM=3149 is taking a long time
Jan 07 12:04:18 MyLittleWarMachine systemd[1]: systemd-modules-load.service: start operation timed out. Terminating.
Jan 07 12:04:18 MyLittleWarMachine systemd[1]: systemd-modules-load.service: Main process exited, code=killed, status=15/TERM
Jan 07 12:04:18 MyLittleWarMachine systemd[1]: systemd-modules-load.service: Failed with result 'timeout'.
Jan 07 12:04:18 MyLittleWarMachine systemd[1]: Failed to start Load Kernel Modules.

Apart from that, one critical warning in boot journal was from nvidia-nvlink.

Jan 07 12:02:46 MyLittleWarMachine kernel: wmi_bus wmi_bus-PNP0C14:01: WQ data block query control method not found
Jan 07 12:02:46 MyLittleWarMachine kernel: wmi_bus wmi_bus-PNP0C14:01: WQ data block query control method not found
Jan 07 12:02:46 MyLittleWarMachine kernel: wmi_bus wmi_bus-PNP0C14:01: WQ data block query control method not found
Jan 07 12:02:46 MyLittleWarMachine kernel: wmi_bus wmi_bus-PNP0C14:01: WQ data block query control method not found
Jan 07 12:02:46 MyLittleWarMachine kernel: nvidia-nvlink: Nvlink Core is being initialized, major device number 236
Jan 07 12:02:46 MyLittleWarMachine kernel: 
Jan 07 12:02:46 MyLittleWarMachine kernel: traps: Missing ENDBR: _nv012292rm+0x0/0x10 [nvidia]
Jan 07 12:02:46 MyLittleWarMachine kernel: ------------[ cut here ]------------
Jan 07 12:02:46 MyLittleWarMachine kernel: kernel BUG at arch/x86/kernel/traps.c:255!
Jan 07 12:02:46 MyLittleWarMachine kernel: invalid opcode: 0000 [#1] PREEMPT SMP NOPTI
Jan 07 12:02:46 MyLittleWarMachine kernel: CPU: 0 PID: 296 Comm: systemd-modules Tainted: P           OE      6.1.1-arch1-1 #1 9bd09188b430be630e611f984454e4f3c489be77
Jan 07 12:02:46 MyLittleWarMachine kernel: Hardware name: LENOVO 82FG/LNVNB161216, BIOS FHCN41WW 05/17/2021
Jan 07 12:02:46 MyLittleWarMachine kernel: RIP: 0010:exc_control_protection+0xc2/0xd0
Jan 07 12:02:46 MyLittleWarMachine systemd-fsck[368]: fsck.fat 4.2 (2021-01-31)
Jan 07 12:02:46 MyLittleWarMachine systemd-fsck[368]: /dev/nvme0n1p3: 199 files, 87942/98304 clusters
Jan 07 12:02:46 MyLittleWarMachine kernel: Code: fa ff 45 31 c9 49 89 d8 b9 09 00 00 00 48 8b 93 80 00 00 00 be fc 00 00 00 48 c7 c7 21 d3 83 86 e8 73 24 48 ff e9 64 ff ff ff <0f> 0b 66 66 >
Jan 07 12:02:46 MyLittleWarMachine kernel: RSP: 0018:ffffa73340bd7b78 EFLAGS: 00010002
Jan 07 12:02:46 MyLittleWarMachine kernel: RAX: 0000000000000033 RBX: ffffa73340bd7b98 RCX: 0000000000000027
Jan 07 12:02:46 MyLittleWarMachine kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff947ae7a21660
Jan 07 12:02:46 MyLittleWarMachine kernel: RBP: 0000000000000003 R08: 0000000000000000 R09: ffffa73340bd7a10
Jan 07 12:02:46 MyLittleWarMachine kernel: R10: 0000000000000003 R11: ffffffff870cb768 R12: 0000000000000000
Jan 07 12:02:46 MyLittleWarMachine kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
Jan 07 12:02:46 MyLittleWarMachine kernel: FS:  00007fd258c513c0(0000) GS:ffff947ae7a00000(0000) knlGS:0000000000000000
Jan 07 12:02:46 MyLittleWarMachine kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 07 12:02:46 MyLittleWarMachine kernel: CR2: 00007fcfdd5c4de0 CR3: 0000000100244005 CR4: 0000000000f70ef0
Jan 07 12:02:46 MyLittleWarMachine kernel: PKRU: 55555554
Jan 07 12:02:46 MyLittleWarMachine kernel: Call Trace:
Jan 07 12:02:46 MyLittleWarMachine kernel:  <TASK>
Jan 07 12:02:46 MyLittleWarMachine kernel:  asm_exc_control_protection+0x26/0x30
Jan 07 12:02:46 MyLittleWarMachine kernel: RIP: 0010:_nv012292rm+0x0/0x10 [nvidia]
Jan 07 12:02:46 MyLittleWarMachine kernel: Code: 66 2e 0f 1f 84 00 00 00 00 00 48 83 ec 08 e8 27 c2 1f 00 48 83 c4 08 48 89 c7 e9 bb ff ff ff 66 2e 0f 1f 84 00 00 00 00 00 90 <48> 89 f7 e9 >
Jan 07 12:02:46 MyLittleWarMachine kernel: RSP: 0018:ffffa73340bd7c48 EFLAGS: 00010202
Jan 07 12:02:46 MyLittleWarMachine kernel: RAX: ffffffffc1072ee0 RBX: ffffffffc40a66d0 RCX: 0000000000000000
Jan 07 12:02:46 MyLittleWarMachine kernel: RDX: 000000000006195b RSI: 0000000000000010 RDI: ffffffffc40a66d0
Jan 07 12:02:46 MyLittleWarMachine kernel: RBP: ffff94794a142fe0 R08: ffffa73340bd7bd8 R09: ffffffffc40a6710
Jan 07 12:02:46 MyLittleWarMachine kernel: R10: ffffffffc40715b0 R11: 0000000000000000 R12: 0000000000000010
Jan 07 12:02:46 MyLittleWarMachine kernel: R13: ffff94794a140000 R14: 00007fd259505343 R15: ffffa73340bd7dc8
Jan 07 12:02:46 MyLittleWarMachine kernel:  ? _nv038334rm+0x20/0x20 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  _nv012290rm+0x24/0xe0 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  _nv038335rm+0xe/0xa0 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  _nv038338rm+0x1d/0x30 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  _nv038340rm+0x2f/0x40 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  _nv017011rm+0x15/0x70 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  _nv000690rm+0x9/0x20 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  ? cdev_add+0x50/0x70
Jan 07 12:02:46 MyLittleWarMachine kernel:  rm_init_rm+0x17/0x60 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  nvidia_init_module+0x24e/0x622 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  ? nvidia_init_module+0x622/0x622 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  nvidia_frontend_init_module+0x50/0x94 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  ? nvidia_init_module+0x622/0x622 [nvidia d81fd0201e2f3475d9699ae21bad0503f558f5a8]
Jan 07 12:02:46 MyLittleWarMachine kernel:  do_one_initcall+0x5a/0x220
Jan 07 12:02:46 MyLittleWarMachine kernel:  do_init_module+0x4a/0x1e0
Jan 07 12:02:46 MyLittleWarMachine kernel:  __do_sys_init_module+0x17f/0x1b0
Jan 07 12:02:46 MyLittleWarMachine kernel:  do_syscall_64+0x5c/0x90
Jan 07 12:02:46 MyLittleWarMachine kernel:  ? syscall_exit_to_user_mode+0x1b/0x40
Jan 07 12:02:46 MyLittleWarMachine kernel:  ? do_syscall_64+0x6b/0x90
Jan 07 12:02:46 MyLittleWarMachine kernel:  ? do_user_addr_fault+0x1e0/0x6a0
Jan 07 12:02:46 MyLittleWarMachine kernel:  ? exc_page_fault+0x74/0x170
Jan 07 12:02:46 MyLittleWarMachine kernel:  entry_SYSCALL_64_after_hwframe+0x63/0xcd
Jan 07 12:02:46 MyLittleWarMachine kernel: RIP: 0033:0x7fd258f21eae
Jan 07 12:02:46 MyLittleWarMachine kernel: Code: 48 8b 0d dd ee 0c 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 90 f3 0f 1e fa 49 89 ca b8 af 00 00 00 0f 05 <48> 3d 01 f0 >
Jan 07 12:02:46 MyLittleWarMachine kernel: RSP: 002b:00007fffc0494c58 EFLAGS: 00000246 ORIG_RAX: 00000000000000af
Jan 07 12:02:46 MyLittleWarMachine kernel: RAX: ffffffffffffffda RBX: 0000563a78736eb0 RCX: 00007fd258f21eae
Jan 07 12:02:46 MyLittleWarMachine kernel: RDX: 00007fd259505343 RSI: 0000000004e347dd RDI: 00007fd2511cc010
Jan 07 12:02:46 MyLittleWarMachine kernel: RBP: 00007fd259505343 R08: 0000000002061000 R09: 85ebca77c2b2ae63
Jan 07 12:02:46 MyLittleWarMachine kernel: R10: 00000000000176e1 R11: 0000000000000246 R12: 0000000000020000
Jan 07 12:02:46 MyLittleWarMachine kernel: R13: 0000563a78736f80 R14: 0000563a78736eb0 R15: 0000563a787370e0
Jan 07 12:02:46 MyLittleWarMachine kernel:  </TASK>
Jan 07 12:02:46 MyLittleWarMachine kernel: Modules linked in: wmi acpi_pad fjes(-) acpi_tad acpi_cpufreq(-) acpi_thermal_rel mac_hid nvidia(POE+) crypto_user fuse bpf_preload ip_tables x_ta>
Jan 07 12:02:46 MyLittleWarMachine kernel: ---[ end trace 0000000000000000 ]---
Jan 07 12:02:46 MyLittleWarMachine kernel: RIP: 0010:exc_control_protection+0xc2/0xd0
Jan 07 12:02:46 MyLittleWarMachine kernel: Code: fa ff 45 31 c9 49 89 d8 b9 09 00 00 00 48 8b 93 80 00 00 00 be fc 00 00 00 48 c7 c7 21 d3 83 86 e8 73 24 48 ff e9 64 ff ff ff <0f> 0b 66 66 >
Jan 07 12:02:46 MyLittleWarMachine kernel: RSP: 0018:ffffa73340bd7b78 EFLAGS: 00010002
Jan 07 12:02:46 MyLittleWarMachine kernel: RAX: 0000000000000033 RBX: ffffa73340bd7b98 RCX: 0000000000000027
Jan 07 12:02:46 MyLittleWarMachine kernel: RDX: 0000000000000000 RSI: 0000000000000001 RDI: ffff947ae7a21660
Jan 07 12:02:46 MyLittleWarMachine kernel: RBP: 0000000000000003 R08: 0000000000000000 R09: ffffa73340bd7a10
Jan 07 12:02:46 MyLittleWarMachine kernel: R10: 0000000000000003 R11: ffffffff870cb768 R12: 0000000000000000
Jan 07 12:02:46 MyLittleWarMachine kernel: R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
Jan 07 12:02:46 MyLittleWarMachine kernel: FS:  00007fd258c513c0(0000) GS:ffff947ae7a00000(0000) knlGS:0000000000000000
Jan 07 12:02:46 MyLittleWarMachine kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jan 07 12:02:46 MyLittleWarMachine kernel: CR2: 00007fcfdd5c4de0 CR3: 0000000100244005 CR4: 0000000000f70ef0
Jan 07 12:02:46 MyLittleWarMachine kernel: PKRU: 55555554
Jan 07 12:02:46 MyLittleWarMachine kernel: Consider using thermal netlink events interface
Jan 07 12:02:46 MyLittleWarMachine systemd[1]: Finished File System Check on /dev/disk/by-uuid/2F3A-4E54.

I’m unable to figure out what is causing this. I switched back to main kernel because my LTS kernel has issues with sound. I just replaced dkms nvidia to arch’s nvidia, if that will be useful. Although, the issue has been persisting from even before I started using LTS ( that was the reason I went to LTS ). Please help me determine the issue. Let me know if additional logs are required. Thanks in advance!

Add ibt=off to your kernel command line and reboot.

1 Like

Hey, thanks for the reply. I actually stumbled across this right now. Sorry for re-posting a known bug.

1 Like

This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.