Kernel panics due to mce hardware error

Nick · October 2, 2020, 9:24pm

Hi everyone!
I’m a longtime Antergos user from back in the day that decided to revert my system to vanilla Arch when the project ended. I’m hoping you guys can help with an issue I’m having recently…

This week I began having kernel panics and I’m trying to pinpoint the cause. Seems to me to be related to CPU overheating? This is just an observation though; the panic happens within 20 minutes of a cold boot, then subsequent boots/restarts immediately after result in another panic. Only when I wait an hour or so can I boot again. Here are my laptop specs:

Toshiba Qosmio
Intel Core i7 2670QM 2.2 GHz

Terminal output when these panics happen:
IMG_20201001_101807

Unfortunately mcelog is a deprecated tool to analyze these, so I have rasdaemon instead but it doesn’t record these panics because they tend to happen after a successful boot.

Can anyone help interpret what is causing the panic? My only other thought is to post this on the Intel support forum as well…

Let me know what other information I can provide.
Thanks!

joekamprad · October 2, 2020, 9:36pm

journal could tell something

journalctl --since "30 minutes ago"

but if you talk about may overheating it could be hardware failing for real, you could check if you can replace thermalpaste/pad on the CPU and clean ventilation

Nick · October 2, 2020, 11:43pm

Ah, thanks for that. I was only looking under the boot flag; no wonder why I didn’t see anything useful there. I’ll try that the next time it panics.

I was also thinking about needing to take a look at the actual hardware itself. That’s next on my list.

jonathon · October 3, 2020, 12:08am

On a slightly different note, you might photograph landscape things in a landscape orientation (i.e. turn your phone around so it’s horizontal), and think about whether the resolution of the photo you upload is appropriate:

“Zoom! Enhance!”

ricklinux · October 3, 2020, 1:58am

Machine Check Exception (MCE) is an error that occurs when a computer’s CPU detects a hardware problem. Typically, the impending hardware failure will cause the kernel to panic to protect against data corruption. Machine checks can indicate failing hardware, system overheats, bad DIMMs, or other problems.

I would do a memory check also because I see that in the log too. Cpu’s don’t often go bad even overheating. So if it’s not overheating it could be bad memory or reading from the slot.

Nick · October 6, 2020, 5:51pm

Yikes! Sorry about that…the kernel panic borked a pacman update that I’ve only now fixed, so snapping a pic was my fast and easy way to document the issue. I’ll use code tags from here on out…

Nick · October 6, 2020, 6:20pm

Update: Sorry for the delay in reply all…I decided to try replacing the memory and it seems to have solved the issue. No kernel panics as of yet, so for the moment I’ll mark this post as “Solved”. Thanks for the assistance all!

ricklinux · October 7, 2020, 1:39am

Did you test the old memory or just replace it?

Nick · October 20, 2020, 3:49pm

Hi again everyone…quite foolishly I jumped the gun on what I thougth the solution would be…I’ve been experiencing the kernel panics again since my last post. I have, however, been able to reproduce the issue each time. It seems that my laptop runs perfectly fine when only running on battery power; however when I plug in my power supply I get the same kernel panic described in my first post within about 10 minutes.

I’ve tried taking the battery out completely and trying to run solely on AC from the power supply but get the kernel panic again within 10 minutes. The next thing I tried was ordering a replacement power supply as I thought maybe my OEM one was going bad. Same issue as before, with or without battery attached. I made doubly sure to order one that had the exact same power output as my OEM one (I can provide more info on the replacement if needed).

Here’s output of dmesg from earlier today:

https://pastebin.com/VK4a4R5h

Here’s also my output for lspci | grep VGA

00:02.0 VGA compatible controller: Intel Corporation 2nd Generation Core Processor Family Integrated Graphics Controller (rev 09)
01:00.0 VGA compatible controller: NVIDIA Corporation GF116M [GeForce GT 560M] (rev a1)

Maybe there are issues with the nvidia drivers I have causing problems with power management when I plug my power adapter in? Totally grasping at straws though with that. Besides that, the only other thing I can think of is opening up the laptop and inspecting the mobo for signs of physical damage.

@ricklinux, I did not end up doing any extensive memory testing due to my laptop power issue. Unfortunately the battery is pretty old (the laptop itself is nearly 10 years old), so I don’t get more than an hour and a half worth of life out of it anymore and plugging in the power adapter causes a panic quite quickly. I did run memtester, but it isn’t extensive by any means. Here’s the output of that for reference:

[nick@nicklaptop ~]$ sudo memtester 800 1
[sudo] password for nick: 
memtester version 4.5.0 (64-bit)
Copyright (C) 2001-2020 Charles Cazabon.
Licensed under the GNU General Public License version 2 (only).

pagesize is 4096
pagesizemask is 0xfffffffffffff000
want 800MB (838860800 bytes)
got  800MB (838860800 bytes), trying mlock ...locked.
Loop 1/1:
  Stuck Address       : ok         
  Random Value        : ok
  Compare XOR         : ok
  Compare SUB         : ok
  Compare MUL         : ok
  Compare DIV         : ok
  Compare OR          : ok
  Compare AND         : ok
  Sequential Increment: ok
  Solid Bits          : ok         
  Block Sequential    : ok         
  Checkerboard        : ok         
  Bit Spread          : ok         
  Bit Flip            : ok         
  Walking Ones        : ok         
  Walking Zeroes      : ok         
  8-bit Writes        : ok
  16-bit Writes       : ok

Done.

Sorry for raising the false victory flag, but everyone’s help has been much appreciated thus far…

Nick · October 21, 2020, 1:39pm

Just a quick update on some observable behavior that I can reproduce. The panic only seems to happen if I have the AC power plugged in, a browser open, and something streaming (i.e. Twitch, playing on Google Stadia, etc.). I’ve tried it across multiple browsers (Firefox and Chromium) and the result is the sameIf I simply boot the laptop, plug in AC power, and not run anything, I haven’t experienced any panics yet. I’ll keep researching and will try to find some more useful log outputs to post that might help.

anon31687413 · October 21, 2020, 2:00pm

Do you have tlp or other energy management daemon running?
If yes, could you try to disable it completely?

ricklinux · October 21, 2020, 3:54pm

I change my thought. Can you post the dmesg of the errors.

Edit: Here is some info for you on MCE.

Nick · October 21, 2020, 8:07pm

I am using tlp, yes. I disabled it per the man pages (editing /etc/tlp.conf, changing # TLP_ENABLE=1 to TLP_ENABLE=0, rebooted) but the problem persists. After about 10 minutes playing on Stadia and running on AC power I got another kernel panic.

While there are a number of other settings within that conf file that can be changed (as well as blacklisting certain devices) would it be worth it to dive into those since completely disabling tlp didn’t solve the problem?

Nick · October 21, 2020, 8:17pm

Thanks for the info - I think I might try mcelog (might as well). As I mentioned in my first post, I have rasdaemon running but it doesn’t seem to log anything particularly useful. Here’s my output of ras-mc-ctl ---errors:

No Memory errors.

No PCIe AER errors.

No Extlog errors.

No devlink errors.

Disk errors
1 2020-09-29 13:45:30 -0400 error: dev=0:2048, sector=784367600, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
2 2020-09-29 13:45:30 -0400 error: dev=0:2048, sector=814813496, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
3 2020-09-29 13:45:30 -0400 error: dev=0:2048, sector=814813504, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
4 2020-09-29 13:46:25 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
5 2020-09-29 13:46:25 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
6 2020-09-30 09:06:47 -0400 error: dev=0:2048, sector=784920928, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
7 2020-09-30 09:06:47 -0400 error: dev=0:2048, sector=785913504, nr_sector=144, error='unknown block error', rwbs='RA', cmd='', 
8 2020-09-30 09:06:47 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
9 2020-09-30 09:07:52 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
10 2020-09-30 09:07:52 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
11 2020-09-30 09:22:26 -0400 error: dev=0:2048, sector=782817240, nr_sector=112, error='unknown block error', rwbs='RA', cmd='', 
12 2020-09-30 09:22:26 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
13 2020-09-30 09:23:19 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
14 2020-09-30 09:23:19 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
15 2020-09-30 09:30:56 -0400 error: dev=0:2048, sector=789933680, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
16 2020-09-30 09:30:56 -0400 error: dev=0:2048, sector=789942112, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
17 2020-09-30 09:30:56 -0400 error: dev=0:2048, sector=789982424, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
18 2020-09-30 09:37:46 -0400 error: dev=0:2048, sector=789978104, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
19 2020-09-30 09:37:46 -0400 error: dev=0:2048, sector=789917304, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
20 2020-09-30 09:37:46 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
21 2020-09-30 09:38:43 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
22 2020-09-30 09:38:43 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
23 2020-09-30 10:24:57 -0400 error: dev=0:2048, sector=781209600, nr_sector=264, error='unknown block error', rwbs='RA', cmd='', 
24 2020-09-30 10:24:57 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='unknown block error', rwbs='N', cmd='', 
25 2020-09-30 10:24:57 -0400 error: dev=0:2048, sector=793840672, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
26 2020-09-30 10:24:57 -0400 error: dev=0:2048, sector=793840680, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
27 2020-09-30 10:24:57 -0400 error: dev=0:2048, sector=784917304, nr_sector=224, error='unknown block error', rwbs='RA', cmd='', 
28 2020-09-30 10:24:57 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
29 2020-09-30 10:26:30 -0400 error: dev=0:2048, sector=9845088, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
30 2020-09-30 10:26:30 -0400 error: dev=0:2048, sector=194675736, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
31 2020-09-30 10:30:25 -0400 error: dev=0:2048, sector=9503424, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
32 2020-09-30 11:03:26 -0400 error: dev=0:2048, sector=789860288, nr_sector=24, error='unknown block error', rwbs='RA', cmd='', 
33 2020-09-30 11:03:26 -0400 error: dev=0:2048, sector=784367600, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
34 2020-09-30 11:04:19 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
35 2020-09-30 11:04:19 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
36 2020-09-30 12:42:11 -0400 error: dev=0:2048, sector=789862208, nr_sector=40, error='unknown block error', rwbs='RA', cmd='', 
37 2020-09-30 12:42:11 -0400 error: dev=0:2048, sector=789954040, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
38 2020-09-30 12:43:06 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
39 2020-09-30 12:45:45 -0400 error: dev=0:2048, sector=729925216, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
40 2020-09-30 12:45:45 -0400 error: dev=0:2048, sector=729925472, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
41 2020-09-30 12:45:45 -0400 error: dev=0:2048, sector=789973608, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
42 2020-09-30 12:45:45 -0400 error: dev=0:2048, sector=729923840, nr_sector=96, error='unknown block error', rwbs='RA', cmd='', 
43 2020-09-30 12:46:37 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
44 2020-09-30 12:46:37 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
45 2020-09-30 13:00:42 -0400 error: dev=0:2048, sector=784917792, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
46 2020-09-30 13:00:42 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
47 2020-09-30 13:01:34 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
48 2020-09-30 13:01:34 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
49 2020-09-30 13:20:51 -0400 error: dev=0:2048, sector=781256488, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
50 2020-09-30 13:20:51 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
51 2020-09-30 13:20:51 -0400 error: dev=0:2048, sector=781218824, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
52 2020-09-30 13:29:41 -0400 error: dev=0:2048, sector=784920928, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
53 2020-09-30 13:29:41 -0400 error: dev=0:2048, sector=783946728, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
54 2020-09-30 13:29:41 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
55 2020-09-30 13:29:41 -0400 error: dev=0:2048, sector=784366408, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
56 2020-09-30 13:57:17 -0400 error: dev=0:2048, sector=789860288, nr_sector=24, error='unknown block error', rwbs='RA', cmd='', 
57 2020-09-30 13:57:17 -0400 error: dev=0:2048, sector=784366408, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
58 2020-09-30 13:59:44 -0400 error: dev=0:2048, sector=789993064, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
59 2020-09-30 13:59:44 -0400 error: dev=0:2048, sector=789934936, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
60 2020-09-30 13:59:44 -0400 error: dev=0:2048, sector=789994760, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
61 2020-09-30 14:35:43 -0400 error: dev=0:2048, sector=789993064, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
62 2020-09-30 14:35:43 -0400 error: dev=0:2048, sector=784917040, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
63 2020-09-30 14:35:43 -0400 error: dev=0:2048, sector=789934936, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
64 2020-09-30 14:35:43 -0400 error: dev=0:2048, sector=789647464, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
65 2020-09-30 14:36:27 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
66 2020-09-30 14:36:43 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
67 2020-09-30 14:46:07 -0400 error: dev=0:2048, sector=783920376, nr_sector=64, error='unknown block error', rwbs='RA', cmd='', 
68 2020-09-30 14:46:07 -0400 error: dev=0:2048, sector=789860832, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
69 2020-09-30 14:46:07 -0400 error: dev=0:2048, sector=789862248, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
70 2020-09-30 14:46:07 -0400 error: dev=0:2048, sector=785454224, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
71 2020-09-30 16:02:01 -0400 error: dev=0:2048, sector=789945464, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
72 2020-09-30 16:02:01 -0400 error: dev=0:2048, sector=789978104, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
73 2020-09-30 16:10:17 -0400 error: dev=0:2048, sector=785450976, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
74 2020-09-30 16:10:17 -0400 error: dev=0:2048, sector=784367008, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
75 2020-09-30 16:10:17 -0400 error: dev=0:2048, sector=789936432, nr_sector=16, error='unknown block error', rwbs='RA', cmd='', 
76 2020-09-30 16:10:17 -0400 error: dev=0:2048, sector=729924192, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
77 2020-09-30 16:10:17 -0400 error: dev=0:2048, sector=729924448, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
78 2020-10-01 09:43:55 -0400 error: dev=0:2048, sector=789917304, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
79 2020-10-01 09:43:55 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
80 2020-10-01 09:57:00 -0400 error: dev=0:2048, sector=789993064, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
81 2020-10-01 09:57:00 -0400 error: dev=0:2048, sector=789934936, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
82 2020-10-01 09:57:00 -0400 error: dev=0:2048, sector=784365632, nr_sector=64, error='unknown block error', rwbs='RA', cmd='', 
83 2020-10-01 09:57:00 -0400 error: dev=0:2048, sector=784367424, nr_sector=176, error='unknown block error', rwbs='RA', cmd='', 
84 2020-10-01 09:57:00 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
85 2020-10-01 10:19:32 -0400 error: dev=0:2048, sector=785911672, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
86 2020-10-01 10:19:32 -0400 error: dev=0:2048, sector=789860288, nr_sector=24, error='unknown block error', rwbs='RA', cmd='', 
87 2020-10-01 10:19:32 -0400 error: dev=0:2048, sector=784365696, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
88 2020-10-01 15:24:43 -0400 error: dev=0:2048, sector=789993064, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
89 2020-10-01 15:24:43 -0400 error: dev=0:2048, sector=789934936, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
90 2020-10-01 15:24:43 -0400 error: dev=0:2048, sector=789994760, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
91 2020-10-01 15:24:43 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
92 2020-10-01 15:46:59 -0400 error: dev=0:2048, sector=831587488, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
93 2020-10-01 15:46:59 -0400 error: dev=0:2048, sector=831587512, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
94 2020-10-01 15:46:59 -0400 error: dev=0:2048, sector=789860400, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
95 2020-10-01 15:47:43 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
96 2020-10-01 15:48:03 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
97 2020-10-01 17:46:25 -0400 error: dev=0:2048, sector=781256488, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
98 2020-10-01 17:46:25 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
99 2020-10-01 17:46:25 -0400 error: dev=0:2048, sector=789862208, nr_sector=40, error='unknown block error', rwbs='RA', cmd='', 
100 2020-10-01 17:50:47 -0400 error: dev=0:2048, sector=210829568, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
101 2020-10-01 17:50:47 -0400 error: dev=0:2048, sector=210829576, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
102 2020-10-01 17:50:47 -0400 error: dev=0:2048, sector=199983104, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
103 2020-10-01 17:55:00 -0400 error: dev=0:2048, sector=784367424, nr_sector=176, error='unknown block error', rwbs='RA', cmd='', 
104 2020-10-01 17:55:00 -0400 error: dev=0:2048, sector=789924688, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
105 2020-10-01 17:55:00 -0400 error: dev=0:2048, sector=789860400, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
106 2020-10-01 17:55:00 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
107 2020-10-02 12:58:44 -0400 error: dev=0:2048, sector=789647464, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
108 2020-10-02 12:58:44 -0400 error: dev=0:2048, sector=789647472, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
109 2020-10-02 12:58:44 -0400 error: dev=0:2048, sector=789936432, nr_sector=16, error='unknown block error', rwbs='RA', cmd='', 
110 2020-10-02 12:58:44 -0400 error: dev=0:2048, sector=793774336, nr_sector=264, error='unknown block error', rwbs='RA', cmd='', 
111 2020-10-02 13:55:49 -0400 error: dev=0:2048, sector=784365632, nr_sector=64, error='unknown block error', rwbs='RA', cmd='', 
112 2020-10-02 13:55:49 -0400 error: dev=0:2048, sector=784367424, nr_sector=176, error='unknown block error', rwbs='RA', cmd='', 
113 2020-10-02 13:55:49 -0400 error: dev=0:2048, sector=789924688, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
114 2020-10-02 13:55:49 -0400 error: dev=0:2048, sector=789860400, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
115 2020-10-02 15:44:56 -0400 error: dev=0:2048, sector=783844824, nr_sector=208, error='unknown block error', rwbs='RA', cmd='', 
116 2020-10-02 15:44:56 -0400 error: dev=0:2048, sector=784617408, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
117 2020-10-02 15:44:56 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
118 2020-10-02 15:44:56 -0400 error: dev=0:2048, sector=784621144, nr_sector=136, error='unknown block error', rwbs='RA', cmd='', 
119 2020-10-02 16:51:47 -0400 error: dev=0:2048, sector=789934936, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
120 2020-10-02 16:51:47 -0400 error: dev=0:2048, sector=789994760, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
121 2020-10-02 16:51:47 -0400 error: dev=0:2048, sector=784917304, nr_sector=224, error='unknown block error', rwbs='RA', cmd='', 
122 2020-10-02 16:51:47 -0400 error: dev=0:2048, sector=789844152, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
123 2020-10-02 22:05:58 -0400 error: dev=0:2048, sector=783871880, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
124 2020-10-02 22:05:58 -0400 error: dev=0:2048, sector=784917040, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
125 2020-10-02 22:05:58 -0400 error: dev=0:2048, sector=783871944, nr_sector=24, error='unknown block error', rwbs='RA', cmd='', 
126 2020-10-02 22:05:58 -0400 error: dev=0:2048, sector=783871968, nr_sector=192, error='unknown block error', rwbs='RA', cmd='', 
127 2020-10-02 22:05:58 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
128 2020-10-04 10:42:02 -0400 error: dev=0:2048, sector=781218824, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
129 2020-10-04 10:42:02 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
130 2020-10-04 10:42:02 -0400 error: dev=0:2048, sector=789865624, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
131 2020-10-04 10:42:02 -0400 error: dev=0:2048, sector=789860312, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
132 2020-10-04 11:59:29 -0400 error: dev=0:2048, sector=199983104, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
133 2020-10-04 11:59:29 -0400 error: dev=0:2048, sector=227968536, nr_sector=208, error='unknown block error', rwbs='RA', cmd='', 
134 2020-10-04 11:59:29 -0400 error: dev=0:2048, sector=227968744, nr_sector=48, error='unknown block error', rwbs='RA', cmd='', 
135 2020-10-04 11:59:29 -0400 error: dev=0:2048, sector=210829568, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
136 2020-10-05 08:25:47 -0400 error: dev=0:2048, sector=789933680, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
137 2020-10-05 08:25:47 -0400 error: dev=0:2048, sector=789942112, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
138 2020-10-05 08:25:47 -0400 error: dev=0:2048, sector=789982424, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
139 2020-10-05 08:29:16 -0400 error: dev=0:2048, sector=784341472, nr_sector=48, error='unknown block error', rwbs='RA', cmd='', 
140 2020-10-05 08:29:16 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
141 2020-10-05 08:29:16 -0400 error: dev=0:2048, sector=789865624, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
142 2020-10-05 08:29:16 -0400 error: dev=0:2048, sector=789860312, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
143 2020-10-05 08:29:16 -0400 error: dev=0:2048, sector=781256488, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
144 2020-10-05 13:36:11 -0400 error: dev=0:2048, sector=9705808, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
145 2020-10-05 13:36:11 -0400 error: dev=0:2048, sector=9503424, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
146 2020-10-05 14:07:46 -0400 error: dev=0:2048, sector=783844520, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
147 2020-10-05 14:07:46 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
148 2020-10-06 08:22:52 -0400 error: dev=0:2048, sector=784920592, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
149 2020-10-06 08:22:52 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
150 2020-10-06 08:22:52 -0400 error: dev=0:2048, sector=784919552, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
151 2020-10-06 09:07:22 -0400 error: dev=0:2048, sector=784368712, nr_sector=24, error='unknown block error', rwbs='RA', cmd='', 
152 2020-10-06 09:07:22 -0400 error: dev=0:2048, sector=784917528, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
153 2020-10-06 09:07:22 -0400 error: dev=0:2048, sector=783845032, nr_sector=240, error='unknown block error', rwbs='RA', cmd='', 
154 2020-10-06 09:07:22 -0400 error: dev=0:2048, sector=783844824, nr_sector=208, error='unknown block error', rwbs='RA', cmd='', 
155 2020-10-06 09:29:56 -0400 error: dev=0:2048, sector=784617408, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
156 2020-10-06 09:29:56 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
157 2020-10-06 09:29:56 -0400 error: dev=0:2048, sector=784621144, nr_sector=136, error='unknown block error', rwbs='RA', cmd='', 
158 2020-10-06 10:33:16 -0400 error: dev=0:2048, sector=784704032, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
159 2020-10-06 10:33:16 -0400 error: dev=0:2048, sector=789945464, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
160 2020-10-06 10:37:44 -0400 error: dev=0:2048, sector=781950720, nr_sector=112, error='unknown block error', rwbs='RA', cmd='', 
161 2020-10-06 10:37:44 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
162 2020-10-06 10:37:44 -0400 error: dev=0:2048, sector=782778112, nr_sector=176, error='unknown block error', rwbs='RA', cmd='', 
163 2020-10-06 13:10:24 -0400 error: dev=0:2048, sector=789860344, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
164 2020-10-06 13:10:24 -0400 error: dev=0:2048, sector=784919552, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
165 2020-10-06 13:10:24 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
166 2020-10-06 13:10:24 -0400 error: dev=0:2048, sector=784920928, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
167 2020-10-06 13:30:05 -0400 error: dev=0:2048, sector=784705600, nr_sector=160, error='unknown block error', rwbs='RA', cmd='', 
168 2020-10-06 13:30:05 -0400 error: dev=0:2048, sector=784703968, nr_sector=64, error='unknown block error', rwbs='RA', cmd='', 
169 2020-10-06 13:30:05 -0400 error: dev=0:2048, sector=783871880, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
170 2020-10-06 13:31:02 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
171 2020-10-06 13:31:03 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
172 2020-10-07 08:32:33 -0400 error: dev=0:2048, sector=783584088, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
173 2020-10-07 08:32:33 -0400 error: dev=0:2048, sector=784921848, nr_sector=160, error='unknown block error', rwbs='RA', cmd='', 
174 2020-10-07 08:32:33 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
175 2020-10-07 08:33:42 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
176 2020-10-07 08:33:42 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
177 2020-10-07 13:50:54 -0400 error: dev=0:2048, sector=789984080, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
178 2020-10-07 13:50:54 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
179 2020-10-07 13:51:42 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
180 2020-10-07 13:51:43 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
181 2020-10-07 14:50:00 -0400 error: dev=0:2048, sector=784704032, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
182 2020-10-07 14:50:00 -0400 error: dev=0:2048, sector=789861672, nr_sector=24, error='unknown block error', rwbs='RA', cmd='', 
183 2020-10-07 14:50:00 -0400 error: dev=0:2048, sector=789860344, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
184 2020-10-07 14:50:59 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
185 2020-10-07 14:50:59 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
186 2020-10-07 15:46:24 -0400 error: dev=0:2048, sector=814744576, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
187 2020-10-07 15:46:24 -0400 error: dev=0:2048, sector=789911848, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
188 2020-10-07 15:46:24 -0400 error: dev=0:2048, sector=789941944, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
189 2020-10-08 08:56:25 -0400 error: dev=0:2048, sector=789861672, nr_sector=24, error='unknown block error', rwbs='RA', cmd='', 
190 2020-10-08 08:56:25 -0400 error: dev=0:2048, sector=789860344, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
191 2020-10-08 08:57:30 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
192 2020-10-08 08:57:30 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
193 2020-10-08 14:42:01 -0400 error: dev=0:2048, sector=783871880, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
194 2020-10-08 14:42:58 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
195 2020-10-08 14:42:58 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
196 2020-10-08 16:51:31 -0400 error: dev=0:2048, sector=784916808, nr_sector=64, error='unknown block error', rwbs='RA', cmd='', 
197 2020-10-08 16:51:31 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
198 2020-10-08 16:52:24 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
199 2020-10-08 16:52:24 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
200 2020-10-13 09:45:56 -0400 error: dev=0:2048, sector=789861184, nr_sector=16, error='unknown block error', rwbs='RA', cmd='', 
201 2020-10-13 09:45:56 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
202 2020-10-13 09:45:56 -0400 error: dev=0:2048, sector=793774336, nr_sector=264, error='unknown block error', rwbs='RA', cmd='', 
203 2020-10-13 09:47:00 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
204 2020-10-13 09:47:00 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
205 2020-10-13 10:04:50 -0400 error: dev=0:2048, sector=701565616, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
206 2020-10-13 10:05:45 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
207 2020-10-13 10:05:45 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
208 2020-10-13 10:53:41 -0400 error: dev=0:2048, sector=789943944, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
209 2020-10-13 10:53:41 -0400 error: dev=0:2048, sector=789933680, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
210 2020-10-13 10:53:41 -0400 error: dev=0:2048, sector=789942112, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
211 2020-10-13 10:53:41 -0400 error: dev=0:2048, sector=784917528, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
212 2020-10-13 10:53:41 -0400 error: dev=0:2048, sector=784921184, nr_sector=112, error='unknown block error', rwbs='RA', cmd='', 
213 2020-10-13 10:53:41 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
214 2020-10-13 13:30:20 -0400 error: dev=0:2048, sector=784917040, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
215 2020-10-13 13:30:20 -0400 error: dev=0:2048, sector=789945008, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
216 2020-10-13 13:30:20 -0400 error: dev=0:2048, sector=789978104, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
217 2020-10-13 13:31:20 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
218 2020-10-13 13:31:20 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
219 2020-10-14 08:53:49 -0400 error: dev=0:2048, sector=784677576, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
220 2020-10-14 08:53:49 -0400 error: dev=0:2048, sector=784342328, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
221 2020-10-14 08:53:49 -0400 error: dev=0:2048, sector=784677832, nr_sector=160, error='unknown block error', rwbs='RA', cmd='', 
222 2020-10-14 08:53:49 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
223 2020-10-14 08:54:43 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
224 2020-10-14 08:54:43 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
225 2020-10-14 10:56:37 -0400 error: dev=0:2048, sector=783871880, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
226 2020-10-14 10:57:27 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
227 2020-10-14 10:57:27 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
228 2020-10-14 11:24:54 -0400 error: dev=0:2048, sector=782764280, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
229 2020-10-14 11:24:54 -0400 error: dev=0:2048, sector=789860288, nr_sector=24, error='unknown block error', rwbs='RA', cmd='', 
230 2020-10-14 11:24:54 -0400 error: dev=0:2048, sector=782779248, nr_sector=216, error='unknown block error', rwbs='RA', cmd='', 
231 2020-10-14 11:24:54 -0400 error: dev=0:2048, sector=783919928, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
232 2020-10-14 11:24:54 -0400 error: dev=0:2048, sector=783920184, nr_sector=192, error='unknown block error', rwbs='RA', cmd='', 
233 2020-10-14 11:24:54 -0400 error: dev=0:2048, sector=783920376, nr_sector=64, error='unknown block error', rwbs='RA', cmd='', 
234 2020-10-15 15:22:57 -0400 error: dev=0:2048, sector=789973608, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
235 2020-10-15 15:22:57 -0400 error: dev=0:2048, sector=784676976, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
236 2020-10-15 15:22:57 -0400 error: dev=0:2048, sector=784920848, nr_sector=80, error='unknown block error', rwbs='RA', cmd='', 
237 2020-10-15 15:22:57 -0400 error: dev=0:2048, sector=789887528, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
238 2020-10-15 15:23:56 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
239 2020-10-15 15:23:56 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
240 2020-10-19 08:56:41 -0400 error: dev=0:2048, sector=785454224, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
241 2020-10-19 08:56:41 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
242 2020-10-19 08:57:41 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
243 2020-10-19 08:57:41 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
244 2020-10-19 09:13:12 -0400 error: dev=0:2048, sector=782108704, nr_sector=224, error='unknown block error', rwbs='RA', cmd='', 
245 2020-10-19 09:13:12 -0400 error: dev=0:2048, sector=785465320, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
246 2020-10-19 09:13:12 -0400 error: dev=0:2048, sector=783064384, nr_sector=144, error='unknown block error', rwbs='RA', cmd='', 
247 2020-10-19 09:13:12 -0400 error: dev=0:2048, sector=785664128, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
248 2020-10-19 09:13:12 -0400 error: dev=0:2048, sector=785664160, nr_sector=16, error='unknown block error', rwbs='RA', cmd='', 
249 2020-10-19 09:13:12 -0400 error: dev=0:2048, sector=782108928, nr_sector=120, error='unknown block error', rwbs='RA', cmd='', 
250 2020-10-19 09:14:12 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
251 2020-10-19 09:14:12 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
252 2020-10-19 10:04:00 -0400 error: dev=0:2048, sector=789991368, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
253 2020-10-19 10:04:00 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
254 2020-10-19 10:04:00 -0400 error: dev=0:2048, sector=783919672, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
255 2020-10-19 10:04:00 -0400 error: dev=0:2048, sector=783921368, nr_sector=136, error='unknown block error', rwbs='RA', cmd='', 
256 2020-10-19 10:05:00 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
257 2020-10-19 10:05:00 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
258 2020-10-19 10:55:47 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
259 2020-10-20 09:16:22 -0400 error: dev=0:2048, sector=782243592, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
260 2020-10-20 09:16:22 -0400 error: dev=0:2048, sector=782243624, nr_sector=80, error='unknown block error', rwbs='RA', cmd='', 
261 2020-10-20 09:16:22 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
262 2020-10-20 09:17:27 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
263 2020-10-20 09:17:27 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
264 2020-10-20 10:44:37 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
265 2020-10-20 11:22:43 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
266 2020-10-20 12:04:14 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
267 2020-10-20 12:05:00 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
268 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
269 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
270 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
271 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
272 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
273 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
274 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
275 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
276 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
277 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
278 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
279 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
280 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
281 2020-10-20 12:19:07 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
282 2020-10-20 15:04:30 -0400 error: dev=0:2048, sector=789861184, nr_sector=16, error='unknown block error', rwbs='RA', cmd='', 
283 2020-10-20 15:04:30 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
284 2020-10-20 15:04:30 -0400 error: dev=0:2048, sector=784119080, nr_sector=216, error='unknown block error', rwbs='RA', cmd='', 
285 2020-10-20 15:04:30 -0400 error: dev=0:2048, sector=782777456, nr_sector=136, error='unknown block error', rwbs='RA', cmd='', 
286 2020-10-20 15:08:16 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
287 2020-10-20 15:08:16 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
288 2020-10-20 15:10:32 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
289 2020-10-20 15:17:52 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
290 2020-10-20 15:17:52 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
291 2020-10-20 15:17:52 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
292 2020-10-20 15:17:52 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
293 2020-10-20 15:17:52 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
294 2020-10-20 15:17:52 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
295 2020-10-20 15:17:53 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
296 2020-10-20 15:17:53 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
297 2020-10-20 15:17:53 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
298 2020-10-20 15:17:53 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
299 2020-10-20 15:17:53 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
300 2020-10-20 15:17:53 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
301 2020-10-20 15:17:53 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
302 2020-10-20 15:18:02 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
303 2020-10-21 09:17:33 -0400 error: dev=0:2048, sector=785657632, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
304 2020-10-21 09:17:33 -0400 error: dev=0:2048, sector=789861184, nr_sector=16, error='unknown block error', rwbs='RA', cmd='', 
305 2020-10-21 09:17:33 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
306 2020-10-21 09:18:26 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
307 2020-10-21 09:18:26 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
308 2020-10-21 10:02:29 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
309 2020-10-21 10:57:55 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
310 2020-10-21 14:18:22 -0400 error: dev=0:2048, sector=782243592, nr_sector=32, error='unknown block error', rwbs='RA', cmd='', 
311 2020-10-21 14:18:22 -0400 error: dev=0:2048, sector=782243624, nr_sector=80, error='unknown block error', rwbs='RA', cmd='', 
312 2020-10-21 14:18:22 -0400 error: dev=0:2048, sector=785450976, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
313 2020-10-21 14:18:22 -0400 error: dev=0:2048, sector=785714208, nr_sector=16, error='unknown block error', rwbs='RA', cmd='', 
314 2020-10-21 14:19:29 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
315 2020-10-21 14:19:29 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
316 2020-10-21 14:25:32 -0400 error: dev=0:2048, sector=789861184, nr_sector=16, error='unknown block error', rwbs='RA', cmd='', 
317 2020-10-21 14:25:32 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
318 2020-10-21 14:26:27 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
319 2020-10-21 14:26:27 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
320 2020-10-21 15:36:15 -0400 error: dev=0:2048, sector=785664448, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
321 2020-10-21 15:36:15 -0400 error: dev=0:2048, sector=785468528, nr_sector=8, error='unknown block error', rwbs='RM', cmd='', 
322 2020-10-21 15:36:15 -0400 error: dev=0:2048, sector=784195776, nr_sector=256, error='unknown block error', rwbs='RA', cmd='', 
323 2020-10-21 15:36:15 -0400 error: dev=0:2048, sector=782108704, nr_sector=224, error='unknown block error', rwbs='RA', cmd='', 
324 2020-10-21 15:37:08 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
325 2020-10-21 15:37:08 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
326 2020-10-21 15:39:11 -0400 error: dev=0:2048, sector=782777456, nr_sector=136, error='unknown block error', rwbs='RA', cmd='', 
327 2020-10-21 15:39:11 -0400 error: dev=0:2048, sector=789964984, nr_sector=8, error='unknown block error', rwbs='RA', cmd='', 
328 2020-10-21 15:39:11 -0400 error: dev=0:2048, sector=784119080, nr_sector=216, error='unknown block error', rwbs='RA', cmd='', 
329 2020-10-21 15:40:04 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 
330 2020-10-21 15:40:04 -0400 error: dev=0:0, sector=-1, nr_sector=0, error='I/O error', rwbs='N', cmd='', 

No MCE errors.

Nick · October 21, 2020, 8:21pm

Also, for the dmesg log of the error…I didn’t think dmesg logged kernel panic errors (the panics are hard lock ups in my case). Maybe I can try dmesg -w > yourlogfile & and see if it logs anything when I have another panic? I picked that up on a Stack Exchange forum: (https://unix.stackexchange.com/questions/153635/log-files-for-kernel-panic-on-arch-linux

ricklinux · October 21, 2020, 9:49pm

Strange why you are getting disk errors but could be because of the lockups. I think you might get more useful info from the MCE logs. I’m just finding it a bit strange because you say it happens when streaming and on internet. Is it on ethernet?

ricklinux · October 21, 2020, 10:05pm

Maybe uninstall tlp for a while.

ricklinux · October 21, 2020, 10:08pm

I would do that:

dmesg -w > yourlogfile &

Nick · October 22, 2020, 1:50am

Thanks - I’ll leave tlp uninstalled for a while longer and will set up the dmesg log. I’ll also give mcelog a shot in the meantime. As for connection, I’m primarily using WiFi but have tested this on both wireless and wired connections. Hopefully I’ll have more hard evidence of this to share.

Nick · October 27, 2020, 12:31pm

Update: Over the last few days, I have not experienced a kernel panic! I still have tlp disabled as mentioned above, and I believe that seems to have been the culprit. I also wanted to post a clarification on my error log for ras-mc-ctl --errors. Apparently all those disk errors are meaningless and can be ignored: https://www.reddit.com/r/archlinux/comments/i0zlec/rasdaemon_errors/

With tlp disabled, I have not had panics whether my laptop is running on battery or battery + AC power. I only have one lingering question though…is it truly a good idea to disable this long term? Essentially it’s a power management service, so my worry is that there’s a chance there could be damage done to my hardware if I don’t have something like tlp enabled. My DE is KDE, and I know it ships with its own suite of power management tools (kpowerdevil I belive) that I continue to use right now. Maybe this issue was simply a matter of 2 competing services trying to use the same hardware components and causing a kernel panic? I’m not too saavy with this side of things, so if anyone has input on this I’d appreciate it.

For the time being, I’ll say this is officially “solved” - thanks to everyone for your help!