Can't boot after update - stuck on BTRFS line

So I updated about an hour or two ago and my system won’t reboot…

I run in a VM and use remote desktop to work from my laptop.

While updating my desktop background suddenly became “green” which I figured was walyand acting up because of something changing. I rebooted and now my system gets stuck at boot. To get more info, I press “e” to edit the entry here:

And edit the line as follows:

  • Remove set gfxpayload=keep
  • Remove “quiet” parameter
  • Change to loglevel=9 (instead of 3)

So this ends up with:

The messages I see now are:

What was supposed to happen at this point after the BTRFS line was logged? System sits there for several minutes doing nothing (I’ve waited 20 minutes or so) which seems to me like it’s literally stuck…

I have backed up the VM in Proxmox and I could just create another VM, attach the disk to it and copy files I guess… But I am quite perplexed as to what broke my system. This happened yesterday about 12 hours ago. If I manage to mount the system I could try and get the pacman log to see exactly what was updated.

Thanks!

I managed to boot using the EndeavourOS ISO image. It turns out there are errors on the BTRFS file-system!

[liveuser@eos-2023.08.05 ~]$ sudo btrfs check /dev/sda2
Opening filesystem to check...
Checking filesystem on /dev/sda2
UUID: 10840302-2838-4187-842a-eee8f883ed50
[1/7] checking root items
[2/7] checking extents
[3/7] checking free space tree
[4/7] checking fs roots
[5/7] checking only csums items (without verifying data)
[6/7] checking root refs
[7/7] checking quota groups
Counts for qgroup id: 0/257 are different
our:		referenced 106093592576 referenced compressed 106093592576
disk:		referenced 106092388352 referenced compressed 106092388352
diff:		referenced 1204224 referenced compressed 1204224
our:		exclusive 106086100992 exclusive compressed 106086100992
disk:		exclusive 106084896768 exclusive compressed 106084896768
diff:		exclusive 1204224 exclusive compressed 1204224
Counts for qgroup id: 0/258 are different
our:		referenced 4731138048 referenced compressed 4731138048
disk:		referenced 4731072512 referenced compressed 4731072512
diff:		referenced 65536 referenced compressed 65536
our:		exclusive 4731138048 exclusive compressed 4731138048
disk:		exclusive 4731072512 exclusive compressed 4731072512
diff:		exclusive 65536 exclusive compressed 65536
Counts for qgroup id: 0/259 are different
our:		referenced 1294737408 referenced compressed 1294737408
disk:		referenced 1303121920 referenced compressed 1303121920
diff:		referenced -8384512 referenced compressed -8384512
our:		exclusive 1294737408 exclusive compressed 1294737408
disk:		exclusive 1303121920 exclusive compressed 1303121920
diff:		exclusive -8384512 exclusive compressed -8384512
Counts for qgroup id: 0/402 are different
our:		referenced 15164743680 referenced compressed 15164743680
disk:		referenced 15164694528 referenced compressed 15164694528
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 1208320 exclusive compressed 1208320
disk:		exclusive 1208320 exclusive compressed 1208320
Counts for qgroup id: 0/1454 are different
our:		referenced 16659726336 referenced compressed 16659726336
disk:		referenced 16659677184 referenced compressed 16659677184
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 6236217344 exclusive compressed 6236217344
disk:		exclusive 6236217344 exclusive compressed 6236217344
Counts for qgroup id: 0/1706 are different
our:		referenced 17686585344 referenced compressed 17686585344
disk:		referenced 17686536192 referenced compressed 17686536192
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 2128203776 exclusive compressed 2128203776
disk:		exclusive 2128203776 exclusive compressed 2128203776
Counts for qgroup id: 0/1803 are different
our:		referenced 14873559040 referenced compressed 14873559040
disk:		referenced 14873509888 referenced compressed 14873509888
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 35688448 exclusive compressed 35688448
disk:		exclusive 35688448 exclusive compressed 35688448
Counts for qgroup id: 0/1807 are different
our:		referenced 14880366592 referenced compressed 14880366592
disk:		referenced 14880317440 referenced compressed 14880317440
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 708608 exclusive compressed 708608
disk:		exclusive 708608 exclusive compressed 708608
Counts for qgroup id: 0/1827 are different
our:		referenced 14925123584 referenced compressed 14925123584
disk:		referenced 14925074432 referenced compressed 14925074432
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 22388736 exclusive compressed 22388736
disk:		exclusive 22388736 exclusive compressed 22388736
Counts for qgroup id: 0/1851 are different
our:		referenced 14925225984 referenced compressed 14925225984
disk:		referenced 14925176832 referenced compressed 14925176832
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 22482944 exclusive compressed 22482944
disk:		exclusive 22482944 exclusive compressed 22482944
Counts for qgroup id: 0/1875 are different
our:		referenced 15011524608 referenced compressed 15011524608
disk:		referenced 15011475456 referenced compressed 15011475456
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 97812480 exclusive compressed 97812480
disk:		exclusive 97812480 exclusive compressed 97812480
Counts for qgroup id: 0/1897 are different
our:		referenced 15074222080 referenced compressed 15074222080
disk:		referenced 15074172928 referenced compressed 15074172928
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 331776 exclusive compressed 331776
disk:		exclusive 331776 exclusive compressed 331776
Counts for qgroup id: 0/1898 are different
our:		referenced 15074222080 referenced compressed 15074222080
disk:		referenced 15074172928 referenced compressed 15074172928
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1899 are different
our:		referenced 15074222080 referenced compressed 15074222080
disk:		referenced 15074172928 referenced compressed 15074172928
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 348160 exclusive compressed 348160
disk:		exclusive 348160 exclusive compressed 348160
Counts for qgroup id: 0/1900 are different
our:		referenced 15074226176 referenced compressed 15074226176
disk:		referenced 15074177024 referenced compressed 15074177024
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1901 are different
our:		referenced 15074226176 referenced compressed 15074226176
disk:		referenced 15074177024 referenced compressed 15074177024
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1902 are different
our:		referenced 15074226176 referenced compressed 15074226176
disk:		referenced 15074177024 referenced compressed 15074177024
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1903 are different
our:		referenced 15074226176 referenced compressed 15074226176
disk:		referenced 15074177024 referenced compressed 15074177024
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1904 are different
our:		referenced 15074189312 referenced compressed 15074189312
disk:		referenced 15074140160 referenced compressed 15074140160
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 315392 exclusive compressed 315392
disk:		exclusive 315392 exclusive compressed 315392
Counts for qgroup id: 0/1905 are different
our:		referenced 15074189312 referenced compressed 15074189312
disk:		referenced 15074140160 referenced compressed 15074140160
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 282624 exclusive compressed 282624
disk:		exclusive 282624 exclusive compressed 282624
Counts for qgroup id: 0/1906 are different
our:		referenced 15074205696 referenced compressed 15074205696
disk:		referenced 15074156544 referenced compressed 15074156544
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1907 are different
our:		referenced 15074205696 referenced compressed 15074205696
disk:		referenced 15074156544 referenced compressed 15074156544
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1908 are different
our:		referenced 15074205696 referenced compressed 15074205696
disk:		referenced 15074156544 referenced compressed 15074156544
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1909 are different
our:		referenced 15074205696 referenced compressed 15074205696
disk:		referenced 15074156544 referenced compressed 15074156544
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1910 are different
our:		referenced 15074205696 referenced compressed 15074205696
disk:		referenced 15074156544 referenced compressed 15074156544
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1911 are different
our:		referenced 15074205696 referenced compressed 15074205696
disk:		referenced 15074156544 referenced compressed 15074156544
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1912 are different
our:		referenced 15074205696 referenced compressed 15074205696
disk:		referenced 15074156544 referenced compressed 15074156544
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1913 are different
our:		referenced 15074205696 referenced compressed 15074205696
disk:		referenced 15074156544 referenced compressed 15074156544
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 266240 exclusive compressed 266240
disk:		exclusive 266240 exclusive compressed 266240
Counts for qgroup id: 0/1914 are different
our:		referenced 15143198720 referenced compressed 15143198720
disk:		referenced 15143149568 referenced compressed 15143149568
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 385024 exclusive compressed 385024
disk:		exclusive 385024 exclusive compressed 385024
Counts for qgroup id: 0/1915 are different
our:		referenced 15143198720 referenced compressed 15143198720
disk:		referenced 15143149568 referenced compressed 15143149568
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 315392 exclusive compressed 315392
disk:		exclusive 315392 exclusive compressed 315392
Counts for qgroup id: 0/1916 are different
our:		referenced 15143198720 referenced compressed 15143198720
disk:		referenced 15143149568 referenced compressed 15143149568
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 315392 exclusive compressed 315392
disk:		exclusive 315392 exclusive compressed 315392
Counts for qgroup id: 0/1917 are different
our:		referenced 15143198720 referenced compressed 15143198720
disk:		referenced 15143149568 referenced compressed 15143149568
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 315392 exclusive compressed 315392
disk:		exclusive 315392 exclusive compressed 315392
Counts for qgroup id: 0/1918 are different
our:		referenced 15143198720 referenced compressed 15143198720
disk:		referenced 15143149568 referenced compressed 15143149568
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 315392 exclusive compressed 315392
disk:		exclusive 315392 exclusive compressed 315392
Counts for qgroup id: 0/1919 are different
our:		referenced 15142924288 referenced compressed 15142924288
disk:		referenced 15142875136 referenced compressed 15142875136
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 397312 exclusive compressed 397312
disk:		exclusive 397312 exclusive compressed 397312
Counts for qgroup id: 0/1920 are different
our:		referenced 15142924288 referenced compressed 15142924288
disk:		referenced 15142875136 referenced compressed 15142875136
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 397312 exclusive compressed 397312
disk:		exclusive 397312 exclusive compressed 397312
Counts for qgroup id: 0/1921 are different
our:		referenced 15164649472 referenced compressed 15164649472
disk:		referenced 15164600320 referenced compressed 15164600320
diff:		referenced 49152 referenced compressed 49152
our:		exclusive 618496 exclusive compressed 618496
disk:		exclusive 618496 exclusive compressed 618496
found 170312507392 bytes used, error(s) found
total csum bytes: 145278064
total tree bytes: 2949971968
total fs tree bytes: 2599190528
total extent tree bytes: 159088640
btree space waste bytes: 622461325
file data blocks allocated: 390277832704
 referenced 217969471488

Are these serious errors that might cause the boot failure?

I was able to mount the file-system and an initial check of files in @home sub-volume seem to be fine…

Actually this issue seemed to be a red herring, I disabled quotas and the fs is error-free now.

Now, after rebooting, I left the default options and while the system got stuck again at:

For no specific reason, I reacted by pressing Ctrl-C and to my surprise the boot resumed!!!

I have tried this again and again and it keeps happening:

For some reason my system pauses waiting after the “Loading initial ramdisk” message and only proceeds to boot after I press Ctrl-C

Any idea why this has started happening?

I’m not sure how this is fixed. After some updates the system is back to booting straight away (without me having to hit Ctrl-C). Very weird situation…

This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.