Another crash, again to do with the GPU;
May 30 15:42:28 domarius-endeavouros kernel: NVRM: GPU at PCI:0000:01:00: GPU-2cb4308a-b22b-7d66-7401-2fea800cec5d
May 30 15:42:28 domarius-endeavouros kernel: NVRM: Xid (PCI:0000:01:00): 62, 00011fab 00012007 00011b38 000159fb 00015e06 00013e17 00000011 00000000
May 30 15:42:34 domarius-endeavouros kernel: NVRM: Xid (PCI:0000:01:00): 119, Timeout after 6s of waiting for RPC response from GPU0 GSP! Expected function 76 (GSP_RM_CONTROL) (0x20800a56 0x5c).
May 30 15:42:34 domarius-endeavouros kernel: NVRM: GPU0 GSP RPC buffer contains function 76 (GSP_RM_CONTROL) and data 0x0000000020800a56 0x000000000000005c.
May 30 15:42:34 domarius-endeavouros kernel: NVRM: GPU0 RPC history (CPU -> GSP):
May 30 15:42:34 domarius-endeavouros kernel: NVRM: entry function data0 data1 ts_start ts_end duration actively_polling
May 30 15:42:34 domarius-endeavouros kernel: NVRM: 0 76 GSP_RM_CONTROL 0x0000000020800a56 0x000000000000005c 0x00063653e133b7ea 0x0000000000000000 y
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -1 76 GSP_RM_CONTROL 0x00000000c3700104 0x0000000000000014 0x00063653e0f6ab5d 0x00063653e0f6ac6f 274us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -2 76 GSP_RM_CONTROL 0x00000000c3700104 0x0000000000000014 0x00063653e0f6a94b 0x00063653e0f6ab50 517us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -3 76 GSP_RM_CONTROL 0x00000000c3700104 0x0000000000000014 0x00063653e0f67b11 0x00063653e0f67c8b 378us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -4 76 GSP_RM_CONTROL 0x00000000c3700104 0x0000000000000014 0x00063653e0f67907 0x00063653e0f67b03 508us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -5 76 GSP_RM_CONTROL 0x00000000c3700104 0x0000000000000014 0x00063653e0f6296d 0x00063653e0f62ad1 356us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -6 76 GSP_RM_CONTROL 0x00000000c3700104 0x0000000000000014 0x00063653e0f6270a 0x00063653e0f62962 600us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -7 76 GSP_RM_CONTROL 0x00000000c3700104 0x0000000000000014 0x00063653e0f62537 0x00063653e0f62646 271us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: GPU0 RPC event history (CPU <- GSP):
May 30 15:42:34 domarius-endeavouros kernel: NVRM: entry function data0 data1 ts_start ts_end duration during_incomplete_rpc
May 30 15:42:34 domarius-endeavouros kernel: NVRM: 0 4130 RECOVERY_ACTION 0x0000000000000000 0x0000000000000000 0x00063653e133b7bf 0x00063653e133b7c1 2us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -1 4102 OS_ERROR_LOG 0x0000000000000000 0x0000000000000000 0x00063653e133b7b4 0x00063653e133b7be 10us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -2 4128 GSP_POST_NOCAT_RECORD 0x0000000000000003 0x0000000000011fab 0x00063653e133b7b2 0x00063653e133b7b3 1us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -3 4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x00000285057f2624 0x00063652f795ae04 0x00063652f795ae04
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -4 4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x00000285057f2624 0x00063652f795ab1b 0x00063652f795ab1b
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -5 4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x00000285057f2624 0x00063652f795a8c5 0x00063652f795a8c7 2us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -6 4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x00000285057f2624 0x00063652bbe8bb80 0x00063652bbe8bb81 1us
May 30 15:42:34 domarius-endeavouros kernel: NVRM: -7 4128 GSP_POST_NOCAT_RECORD 0x0000000000000005 0x00000285057f2624 0x00063652bbe8b898 0x00063652bbe8b899 1us
May 30 15:42:34 domarius-endeavouros kernel: CPU: 5 UID: 0 PID: 440 Comm: nv_queue Tainted: P OE 6.14.6-arch1-1 #1 9658fd36a89bb82f508ea2dcbad8e1444239d436
May 30 15:42:34 domarius-endeavouros kernel: Tainted: [P]=PROPRIETARY_MODULE, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
May 30 15:42:34 domarius-endeavouros kernel: Hardware name: System manufacturer System Product Name/Z170-AR, BIOS 3801 03/14/2018
May 30 15:42:34 domarius-endeavouros kernel: Call Trace:
May 30 15:42:34 domarius-endeavouros kernel: <TASK>
May 30 15:42:34 domarius-endeavouros kernel: dump_stack_lvl+0x5d/0x80
May 30 15:42:34 domarius-endeavouros kernel: _nv013207rm+0x508/0x5b0 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: _nv013118rm+0x74/0x330 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: _nv051942rm+0x49f/0x7f0 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: _nv029397rm+0x106/0x150 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: _nv044125rm+0xa0/0xf0 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: _nv044127rm+0x43/0x50 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: _nv012794rm+0xe8/0x180 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: ? _nv012794rm+0xa7/0x180 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: ? __pfx__main_loop+0x10/0x10 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: rm_execute_work_item+0x13e/0x1f0 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: os_execute_work_item+0x68/0x90 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: _main_loop+0x90/0x150 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: ? __pfx__main_loop+0x10/0x10 [nvidia fefee9cf1f3102d1e82e2e2fe2b949b7e3997694]
May 30 15:42:34 domarius-endeavouros kernel: kthread+0xec/0x230
May 30 15:42:34 domarius-endeavouros kernel: ? __pfx_kthread+0x10/0x10
May 30 15:42:34 domarius-endeavouros kernel: ret_from_fork+0x31/0x50
May 30 15:42:34 domarius-endeavouros kernel: ? __pfx_kthread+0x10/0x10
May 30 15:42:34 domarius-endeavouros kernel: ret_from_fork_asm+0x1a/0x30
May 30 15:42:34 domarius-endeavouros kernel: </TASK>
May 30 15:42:34 domarius-endeavouros kernel: NVRM: Xid (PCI:0000:01:00): 154, GPU recovery action changed from 0x0 (None) to 0x1 (GPU Reset Required)
May 30 15:42:44 domarius-endeavouros kernel: NVRM: Xid (PCI:0000:01:00): 119, pid=1847, name=Renderer, Timeout after 6s of waiting for RPC response from GPU0 GSP! Expected function 76 (GSP_RM_CONTROL) (0x20800a6a 0x0).
May 30 15:42:50 domarius-endeavouros kernel: NVRM: Xid (PCI:0000:01:00): 119, pid=1093, name=QSGRenderThread, Timeout after 6s of waiting for RPC response from GPU0 GSP! Expected function 10 (FREE) (0xbeea0403 0x0).
May 30 15:42:56 domarius-endeavouros kernel: NVRM: Rate limiting GSP RPC error prints for GPU at PCI:0000:01:00 (printing 1 of every 30). The GPU likely needs to be reset.
May 30 15:46:32 domarius-endeavouros kernel: NVRM: Xid (PCI:0000:01:00): 119, Timeout after 6s of waiting for RPC response from GPU0 GSP! Expected function 76 (GSP_RM_CONTROL) (0x20800a6a 0x0).
May 30 15:47:02 domarius-endeavouros systemd-logind[789]: Power key pressed short.
May 30 15:47:02 domarius-endeavouros kernel: NVRM: Xid (PCI:0000:01:00): 16, Head 00000001 Count 000aba20
I’ve just since taken out the video card and given the pins and socket the clean of their life. I have electrical contact cleaner spray which I applied and rubbed the pins with a paper towel, no fibers left behind and they’re all shiny - but they already were, and no black oxide came off onto the paper, that I could see. As for the video card PCI-e socket, I got a tooth brush and sprayed the contact cleaner on, and scrubbed it out fairly thoroughly. Did a visual inspection and then used an air compressor to blow it out and dry it out too.
Typing from the PC since the clean so it’s working for now. Trouble is, the crash is so intermittent, I don’t know if I should blame the hardware, or Linux itself! I’ve never had the crash in Windows yet (I dual boot for games) but I don’t do that often so either the issue doesn’t happen in Windows or I’m just lucky enough that it hasn’t happened yet…