Memory keeps increasing with limited use--diagnosing memory leak issues?

I was able to save ps_mem output as well as free -h output after 23h runtime on a clean guest user (with only Konsole and Kate open). ps_mem still shows basically no memory used, but free -h shows 80 Gib used (htop also shows 80Gib used.)

Output pasted below:

at 23hr runtime:

free -h
               total        used        free      shared  buff/cache   available
Mem:           125Gi        84Gi        34Gi       174Mi       7.7Gi        40Gi
Swap:          8.0Gi          0B       8.0Gi


sudo ps_mem
[sudo] password for guest:
 Private  +   Shared  =  RAM used       Program

148.0 KiB +  24.5 KiB = 172.5 KiB       fusermount3
304.0 KiB +  68.5 KiB = 372.5 KiB       rtkit-daemon
432.0 KiB + 127.5 KiB = 559.5 KiB       xsettingsd
536.0 KiB + 119.5 KiB = 655.5 KiB       dconf-service
556.0 KiB + 146.5 KiB = 702.5 KiB       xdg-permission-store
656.0 KiB + 206.5 KiB = 862.5 KiB       agent
740.0 KiB + 181.5 KiB = 921.5 KiB       at-spi2-registryd
752.0 KiB + 187.5 KiB = 939.5 KiB       at-spi-bus-launcher
532.0 KiB + 548.0 KiB =   1.1 MiB       avahi-daemon (2)
896.0 KiB + 230.5 KiB =   1.1 MiB       systemd-userdbd
456.0 KiB + 765.0 KiB =   1.2 MiB       dnsmasq (2)
  1.1 MiB + 162.5 KiB =   1.3 MiB       xdg-document-portal
  1.1 MiB + 165.5 KiB =   1.3 MiB       obexd
  1.1 MiB + 422.5 KiB =   1.5 MiB       systemd-timesyncd
  1.1 MiB + 374.5 KiB =   1.5 MiB       systemd-machined
  1.4 MiB + 122.5 KiB =   1.5 MiB       bluetoothd
  1.3 MiB + 222.5 KiB =   1.5 MiB       accounts-daemon
  1.9 MiB + 128.5 KiB =   2.0 MiB       (sd-pam)
  1.5 MiB + 491.5 KiB =   2.0 MiB       kwin_wayland_wrapper
  1.7 MiB + 513.5 KiB =   2.2 MiB       systemd-logind
  1.7 MiB + 591.5 KiB =   2.3 MiB       goa-identity-service
  1.6 MiB + 681.5 KiB =   2.3 MiB       dbus-broker-launch (3)
908.0 KiB +   2.0 MiB =   2.9 MiB       sudo (2)
  3.2 MiB + 233.5 KiB =   3.4 MiB       upowerd
  2.7 MiB + 839.5 KiB =   3.5 MiB       systemd-userwork (3)
  2.4 MiB +   1.2 MiB =   3.5 MiB       xembedsniproxy
  2.5 MiB +   1.2 MiB =   3.6 MiB       gmenudbusmenuproxy
  3.6 MiB + 219.5 KiB =   3.8 MiB       htop
  2.3 MiB +   1.8 MiB =   4.0 MiB       virtlogd
  3.0 MiB +   1.2 MiB =   4.2 MiB       sddm
  3.9 MiB + 311.5 KiB =   4.2 MiB       polkitd
  3.8 MiB + 441.5 KiB =   4.3 MiB       systemd-udevd
  3.5 MiB + 968.5 KiB =   4.5 MiB       sddm-helper
  4.1 MiB + 806.5 KiB =   4.9 MiB       xdg-desktop-portal
  4.7 MiB + 448.5 KiB =   5.2 MiB       udisksd
  4.3 MiB + 947.5 KiB =   5.2 MiB       systemd-resolved
  4.3 MiB +   1.5 MiB =   5.8 MiB       bash (2)
  5.7 MiB + 297.5 KiB =   6.0 MiB       dbus-broker (3)
  4.1 MiB +   2.0 MiB =   6.1 MiB       virtnetworkd
  4.8 MiB +   1.4 MiB =   6.3 MiB       startplasma-wayland
  5.9 MiB +   1.4 MiB =   7.3 MiB       goa-daemon
  5.8 MiB +   2.1 MiB =   7.9 MiB       kactivitymanagerd
  6.9 MiB +   1.1 MiB =   7.9 MiB       baloo_file
  7.6 MiB +   1.0 MiB =   8.6 MiB       pipewire
  4.9 MiB +   3.9 MiB =   8.8 MiB       evolution-addressbook-factory
  5.4 MiB +   3.5 MiB =   8.8 MiB       evolution-calendar-factory
  8.4 MiB +   1.1 MiB =   9.5 MiB       NetworkManager
  7.4 MiB +   3.4 MiB =  10.8 MiB       systemd (2)
  8.8 MiB +   2.6 MiB =  11.3 MiB       org_kde_powerdevil
 11.1 MiB + 373.5 KiB =  11.5 MiB       pipewire-pulse
 12.7 MiB +   0.5 KiB =  12.7 MiB       containerd-shim-runc-v2
  9.7 MiB +   3.3 MiB =  13.0 MiB       evolution-source-registry
 14.3 MiB +   6.0 MiB =  20.4 MiB       evolution-alarm-notify
 20.9 MiB +   2.8 MiB =  23.6 MiB       polkit-kde-authentication-agent-1
 21.9 MiB +   2.9 MiB =  24.8 MiB       kwalletd6
 21.5 MiB +   3.9 MiB =  25.3 MiB       blueman-tray
 23.2 MiB +   3.8 MiB =  27.0 MiB       xdg-desktop-portal-kde
 20.8 MiB +   7.2 MiB =  28.0 MiB       kaccess
 21.0 MiB +   7.2 MiB =  28.2 MiB       ksmserver
 26.8 MiB +   2.0 MiB =  28.8 MiB       wireplumber
 25.0 MiB +   4.7 MiB =  29.7 MiB       blueman-applet
 27.1 MiB +   4.1 MiB =  31.2 MiB       xwaylandvideobridge
 26.8 MiB +   4.9 MiB =  31.7 MiB       kdeconnectd
 28.0 MiB +   6.4 MiB =  34.3 MiB       DiscoverNotifier
 33.4 MiB +   2.2 MiB =  35.6 MiB       firewalld
 41.9 MiB +   1.3 MiB =  43.2 MiB       Xwayland
 36.3 MiB +   7.5 MiB =  43.8 MiB       kded6
 53.5 MiB +  20.5 KiB =  53.5 MiB       containerd
 51.5 MiB +   3.8 MiB =  55.4 MiB       firewall-applet
 27.2 MiB +  28.2 MiB =  55.5 MiB       systemd-journald
 36.1 MiB +  20.8 MiB =  56.9 MiB       konsole
 70.6 MiB + 171.5 KiB =  70.8 MiB       dockerd
 20.7 MiB +  51.4 MiB =  72.1 MiB       baloorunner
 65.2 MiB +   7.7 MiB =  72.9 MiB       Xorg
 60.1 MiB +  12.8 MiB =  72.9 MiB       syncthing (2)
 23.0 MiB +  51.5 MiB =  74.5 MiB       kioworker
 35.5 MiB +  63.4 MiB =  98.9 MiB       dolphin
101.0 MiB +  34.3 MiB = 135.3 MiB       kwin_wayland
306.8 MiB +  26.4 MiB = 333.2 MiB       plasmashell
405.3 MiB +   0.5 KiB = 405.3 MiB       mariadbd
---------------------------------
                          2.2 GiB
=================================```

It seems that this particular bug report and patch was all specific to an issue with task manager (reading the post you linked). I’m not using the task manager at all in my instance, so it seems potentially different. I’m unsure if there’s someone here capable/willing to help me interpret a heaptrack result of plasmashell, since I’d probably get a huge file and struggle to interpret myself. Maybe opening a bug report would be best? I’d also be willing to try gnome or something else to see if the issue is KDE related.

The other confusing thing is that my htop MEM% column and my ps_mem show low memory usage of all my processes including plasmashell, despite the 80+GB of used memory overall. How do I know that plasmashell is the top culprit to check with heaptrack?

Do you have a tmpfs drive that could fill up? In this “broken” state, could you post a df -h and a cat /proc/meminfo?

Here is the output! Unsure what to interpret from this:

cat /proc/meminfo
MemTotal:       131341752 kB
MemFree:        26104520 kB
MemAvailable:   32972216 kB
Buffers:         1005392 kB
Cached:          6805900 kB
SwapCached:            0 kB
Active:         10226160 kB
Inactive:        2376364 kB
Active(anon):    5209928 kB
Inactive(anon):        0 kB
Active(file):    5016232 kB
Inactive(file):  2376364 kB
Unevictable:      105020 kB
Mlocked:             136 kB
SwapTotal:       8388604 kB
SwapFree:        8388604 kB
Zswap:                 0 kB
Zswapped:              0 kB
Dirty:             11216 kB
Writeback:             0 kB
AnonPages:       4783432 kB
Mapped:          2191508 kB
Shmem:            418992 kB
KReclaimable:     726932 kB
Slab:           91069020 kB
SReclaimable:     726932 kB
SUnreclaim:     90342088 kB
KernelStack:       25488 kB
PageTables:        62676 kB
SecPageTables:      7612 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    74059480 kB
Committed_AS:   25720452 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      238028 kB
VmallocChunk:          0 kB
Percpu:            29184 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1595392 kB
ShmemHugePages:    32768 kB
ShmemPmdMapped:        0 kB
FileHugePages:    579584 kB
FilePmdMapped:    356352 kB
CmaTotal:              0 kB
CmaFree:               0 kB
Unaccepted:            0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
Hugetlb:               0 kB
DirectMap4k:     5352960 kB
DirectMap2M:    55953408 kB
DirectMap1G:    72351744 kB
df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/nvme0n1p2  3.6T  618G  2.8T  18% /
devtmpfs        4.0M     0  4.0M   0% /dev
tmpfs            63G   67M   63G   1% /dev/shm
efivarfs        256K  140K  112K  56% /sys/firmware/efi/efivars
tmpfs            26G  2.7M   26G   1% /run
tmpfs           1.0M     0  1.0M   0% /run/credentials/systemd-journald.service
tmpfs           1.0M     0  1.0M   0% /run/credentials/systemd-resolved.service
tmpfs            63G   21M   63G   1% /tmp
/dev/nvme0n1p1 1022M  514M  509M  51% /efi
tmpfs            13G  112K   13G   1% /run/user/1001
tmpfs            13G  124K   13G   1% /run/user/1000

There are 80 GB in slab, and most of it unreclaimable. That’s very odd. On a “normal” system you would expect a low GB value and most of it reclaimable.

Can you do a sudo cat /proc/slabinfo

Sure! Here is the output:

This isnt super readable, but the biggest numbers I’m seeing are for acpi_State and then buffer_head. Unsure why this would be/how to fix

# name            <active_objs> <num_objs> <objsize> <objperslab> <pagesperslab> : tunables <limit> <batchcount> <sharedfactor> : slabdata <active_slabs> <num_slabs> <sharedavail>
uvm_gpu_chunk_5       31     31    264   31    2 : tunables    0    0    0 : slabdata      1      1      0
ovl_inode           1845   1845    720   45    8 : tunables    0    0    0 : slabdata     41     41      0
nf_conntrack_expect      0      0    208   39    2 : tunables    0    0    0 : slabdata      0      0      0
nf_conntrack        1056   1056    256   32    2 : tunables    0    0    0 : slabdata     33     33      0
fat_inode_cache      123    123    792   41    8 : tunables    0    0    0 : slabdata      3      3      0
fat_cache              0      0     40  102    1 : tunables    0    0    0 : slabdata      0      0      0
kvm_vcpu               3      3   9024    3    8 : tunables    0    0    0 : slabdata      1      1      0
x86_emulator          12     12   2672   12    8 : tunables    0    0    0 : slabdata      1      1      0
ext4_groupinfo_4k  29832  29832    184   44    2 : tunables    0    0    0 : slabdata    678    678      0
xe_sched_job_parallel      0      0    448   36    4 : tunables    0    0    0 : slabdata      0      0      0
i915_dependency        0      0    128   32    1 : tunables    0    0    0 : slabdata      0      0      0
execute_cb             0      0     64   64    1 : tunables    0    0    0 : slabdata      0      0      0
i915_request         138    138    704   46    8 : tunables    0    0    0 : slabdata      3      3      0
drm_i915_gem_object   1543   1596   1152   28    8 : tunables    0    0    0 : slabdata     57     57      0
intel_context       1050   1050    768   42    8 : tunables    0    0    0 : slabdata     25     25      0
bio-136             3024   3024    192   42    2 : tunables    0    0    0 : slabdata     72     72      0
uvm_tools_block_migration_data_t      0      0    120   34    1 : tunables    0    0    0 : slabdata      0      0      0
uvm_tools_event_tracker_t      0      0   1136   28    8 : tunables    0    0    0 : slabdata      0      0      0
uvm_service_block_context_t      4      4  17832    1    8 : tunables    0    0    0 : slabdata      4      4      0
migrate_vma_state_t      0      0  33320    1   16 : tunables    0    0    0 : slabdata      0      0      0
uvm_va_block_context_t     18     18  10344    3    8 : tunables    0    0    0 : slabdata      6      6      0
uvm_va_block_gpu_state_t      0      0    480   34    4 : tunables    0    0    0 : slabdata      0      0      0
uvm_va_block_t         0      0   2864   11    8 : tunables    0    0    0 : slabdata      0      0      0
uvm_va_range_semaphore_pool_t     70     70   2256   14    8 : tunables    0    0    0 : slabdata      5      5      0
uvm_va_range_external_t    236    236  14512    2    8 : tunables    0    0    0 : slabdata    118    118      0
uvm_va_range_managed_t    185    185    216   37    2 : tunables    0    0    0 : slabdata      5      5      0
nvidia_stack_cache   1770   1770  12288    2    8 : tunables    0    0    0 : slabdata    885    885      0
kcopyd_job             0      0   3240   10    8 : tunables    0    0    0 : slabdata      0      0      0
dm_uevent              0      0   2888   11    8 : tunables    0    0    0 : slabdata      0      0      0
btrfs_delayed_node      0      0    312   26    2 : tunables    0    0    0 : slabdata      0      0      0
btrfs_ordered_extent      0      0    416   39    4 : tunables    0    0    0 : slabdata      0      0      0
bio-320               42     42    384   42    4 : tunables    0    0    0 : slabdata      1      1      0
bio-384               36     36    448   36    4 : tunables    0    0    0 : slabdata      1      1      0
btrfs_extent_buffer    170    170    240   34    2 : tunables    0    0    0 : slabdata      5      5      0
btrfs_path             0      0    112   36    1 : tunables    0    0    0 : slabdata      0      0      0
btrfs_trans_handle      0      0    168   24    1 : tunables    0    0    0 : slabdata      0      0      0
bio-400               36     36    448   36    4 : tunables    0    0    0 : slabdata      1      1      0
btrfs_inode            0      0   1032   31    8 : tunables    0    0    0 : slabdata      0      0      0
bio-456               32     32    512   32    4 : tunables    0    0    0 : slabdata      1      1      0
fsverity_info          0      0    264   31    2 : tunables    0    0    0 : slabdata      0      0      0
fscrypt_inode_info      0      0    128   32    1 : tunables    0    0    0 : slabdata      0      0      0
zs_handle-zswap1       0      0      8  512    1 : tunables    0    0    0 : slabdata      0      0      0
MPTCPv6                0      0   2176   15    8 : tunables    0    0    0 : slabdata      0      0      0
ip6-frags            264    264    184   44    2 : tunables    0    0    0 : slabdata      6      6      0
ip6_dst_cache        840    992    256   32    2 : tunables    0    0    0 : slabdata     31     31      0
PINGv6                 0      0   1216   26    8 : tunables    0    0    0 : slabdata      0      0      0
RAWv6                286    286   1216   26    8 : tunables    0    0    0 : slabdata     11     11      0
UDPv6                576    576   1344   24    8 : tunables    0    0    0 : slabdata     24     24      0
tw_sock_TCPv6        124    124    264   31    2 : tunables    0    0    0 : slabdata      4      4      0
request_sock_TCPv6     78     78    312   26    2 : tunables    0    0    0 : slabdata      3      3      0
TCPv6                276    276   2624   12    8 : tunables    0    0    0 : slabdata     23     23      0
scsi_sense_cache     352    352    128   32    1 : tunables    0    0    0 : slabdata     11     11      0
io_kiocb             704    704    256   32    2 : tunables    0    0    0 : slabdata     22     22      0
bfq_io_cq              0      0   1360   24    8 : tunables    0    0    0 : slabdata      0      0      0
bio-264               50     50    320   25    2 : tunables    0    0    0 : slabdata      2      2      0
mqueue_inode_cache     68     68    960   34    8 : tunables    0    0    0 : slabdata      2      2      0
fuse_request         234    234    152   26    1 : tunables    0    0    0 : slabdata      9      9      0
fuse_inode            72     72    896   36    8 : tunables    0    0    0 : slabdata      2      2      0
jbd2_journal_head   2278   2278    120   34    1 : tunables    0    0    0 : slabdata     67     67      0
jbd2_revoke_table_s    256    256     16  256    1 : tunables    0    0    0 : slabdata      1      1      0
ext4_inode_cache  361455 361476   1176   27    8 : tunables    0    0    0 : slabdata  13388  13388      0
ext4_allocation_context    624    624    152   26    1 : tunables    0    0    0 : slabdata     24     24      0
ext4_prealloc_space    864    864    112   36    1 : tunables    0    0    0 : slabdata     24     24      0
ext4_io_end         1792   1792     64   64    1 : tunables    0    0    0 : slabdata     28     28      0
bio_post_read_ctx    170    170     48   85    1 : tunables    0    0    0 : slabdata      2      2      0
pending_reservation   3072   3072     32  128    1 : tunables    0    0    0 : slabdata     24     24      0
extent_status      53985  54162     40  102    1 : tunables    0    0    0 : slabdata    531    531      0
mb_cache_entry      2190   2190     56   73    1 : tunables    0    0    0 : slabdata     30     30      0
kioctx                28     28    576   28    4 : tunables    0    0    0 : slabdata      1      1      0
userfaultfd_ctx_cache      0      0    192   42    2 : tunables    0    0    0 : slabdata      0      0      0
dnotify_struct         0      0     32  128    1 : tunables    0    0    0 : slabdata      0      0      0
posix_timers_cache    315    315    360   45    4 : tunables    0    0    0 : slabdata      7      7      0
ip4-frags              0      0    200   40    2 : tunables    0    0    0 : slabdata      0      0      0
MPTCP                  0      0   1984   16    8 : tunables    0    0    0 : slabdata      0      0      0
request_sock_subflow_v6      0      0    384   42    4 : tunables    0    0    0 : slabdata      0      0      0
request_sock_subflow_v4      0      0    384   42    4 : tunables    0    0    0 : slabdata      0      0      0
xfrm_dst             700    700    320   25    2 : tunables    0    0    0 : slabdata     28     28      0
xfrm_state             0      0    832   39    8 : tunables    0    0    0 : slabdata      0      0      0
ip_fib_trie          850    850     48   85    1 : tunables    0    0    0 : slabdata     10     10      0
ip_fib_alias         876    876     56   73    1 : tunables    0    0    0 : slabdata     12     12      0
PING                2042   2048   1024   32    8 : tunables    0    0    0 : slabdata     64     64      0
RAW                  224    224   1024   32    8 : tunables    0    0    0 : slabdata      7      7      0
tw_sock_TCP          186    186    264   31    2 : tunables    0    0    0 : slabdata      6      6      0
request_sock_TCP      52     52    312   26    2 : tunables    0    0    0 : slabdata      2      2      0
TCP                  299    299   2432   13    8 : tunables    0    0    0 : slabdata     23     23      0
hugetlbfs_inode_cache     75     75    648   25    4 : tunables    0    0    0 : slabdata      3      3      0
dquot                800    800    256   32    2 : tunables    0    0    0 : slabdata     25     25      0
bio-256               50     50    320   25    2 : tunables    0    0    0 : slabdata      2      2      0
backing_aio          192    192    128   32    1 : tunables    0    0    0 : slabdata      6      6      0
ep_head             6144   6144     16  256    1 : tunables    0    0    0 : slabdata     24     24      0
dax_cache             39     39    832   39    8 : tunables    0    0    0 : slabdata      1      1      0
request_queue         66     66    992   33    8 : tunables    0    0    0 : slabdata      2      2      0
bio-200             2113   2240    256   32    2 : tunables    0    0    0 : slabdata     70     70      0
biovec-max           512    536   4096    8    8 : tunables    0    0    0 : slabdata     67     67      0
biovec-128            16     16   2048   16    8 : tunables    0    0    0 : slabdata      1      1      0
msg_msg-8k             0      0   8192    4    8 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-4k             0      0   4096    8    8 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-2k             0      0   2048   16    8 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-1k             0      0   1024   32    8 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-512            0      0    512   32    4 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-256            0      0    256   32    2 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-128            0      0    128   32    1 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-64             0      0     64   64    1 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-32             0      0     32  128    1 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-16             0      0     16  256    1 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-8              0      0      8  512    1 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-192            0      0    192   42    2 : tunables    0    0    0 : slabdata      0      0      0
msg_msg-96             0      0     96   42    1 : tunables    0    0    0 : slabdata      0      0      0
khugepaged_mm_slot   4386   4386     40  102    1 : tunables    0    0    0 : slabdata     43     43      0
memdup_user-8k         0      0   8192    4    8 : tunables    0    0    0 : slabdata      0      0      0
memdup_user-4k         0      0   4096    8    8 : tunables    0    0    0 : slabdata      0      0      0
memdup_user-2k       368    368   2048   16    8 : tunables    0    0    0 : slabdata     23     23      0
memdup_user-1k       608    608   1024   32    8 : tunables    0    0    0 : slabdata     19     19      0
memdup_user-512        0      0    512   32    4 : tunables    0    0    0 : slabdata      0      0      0
memdup_user-256        0      0    256   32    2 : tunables    0    0    0 : slabdata      0      0      0
memdup_user-128      160    160    128   32    1 : tunables    0    0    0 : slabdata      5      5      0
memdup_user-64      1408   1408     64   64    1 : tunables    0    0    0 : slabdata     22     22      0
memdup_user-32      3072   3072     32  128    1 : tunables    0    0    0 : slabdata     24     24      0
memdup_user-16      5888   5888     16  256    1 : tunables    0    0    0 : slabdata     23     23      0
memdup_user-8      12288  12288      8  512    1 : tunables    0    0    0 : slabdata     24     24      0
memdup_user-192       84     84    192   42    2 : tunables    0    0    0 : slabdata      2      2      0
memdup_user-96       630    630     96   42    1 : tunables    0    0    0 : slabdata     15     15      0
user_namespace       416    416    616   26    4 : tunables    0    0    0 : slabdata     16     16      0
iommu_iova_magazine   8042   8096   1024   32    8 : tunables    0    0    0 : slabdata    253    253      0
dmaengine-unmap-256     15     15   2112   15    8 : tunables    0    0    0 : slabdata      1      1      0
dmaengine-unmap-128     30     30   1088   30    8 : tunables    0    0    0 : slabdata      1      1      0
dmaengine-unmap-2  40000  40000     64   64    1 : tunables    0    0    0 : slabdata    625    625      0
sock_inode_cache    3499   3783    832   39    8 : tunables    0    0    0 : slabdata     97     97      0
skbuff_small_head   1334   1426    704   46    8 : tunables    0    0    0 : slabdata     31     31      0
skbuff_head_cache   2484   2720    256   32    2 : tunables    0    0    0 : slabdata     85     85      0
tracefs_inode_cache    432    432    672   24    4 : tunables    0    0    0 : slabdata     18     18      0
configfs_dir_cache    644    644     88   46    1 : tunables    0    0    0 : slabdata     14     14      0
file_lease_cache       0      0    160   25    1 : tunables    0    0    0 : slabdata      0      0      0
file_lock_cache     1008   1008    192   42    2 : tunables    0    0    0 : slabdata     24     24      0
fsnotify_mark_connector  15640  15640     24  170    1 : tunables    0    0    0 : slabdata     92     92      0
buffer_head       1178119 1183767    104   39    1 : tunables    0    0    0 : slabdata  30353  30353      0
x86_lbr               42     42   1536   21    8 : tunables    0    0    0 : slabdata      2      2      0
task_delay_info      644    644    144   28    1 : tunables    0    0    0 : slabdata     23     23      0
taskstats            888    888    432   37    4 : tunables    0    0    0 : slabdata     24     24      0
proc_dir_entry      2436   2436    192   42    2 : tunables    0    0    0 : slabdata     58     58      0
proc_inode_cache   19384  19872    712   46    8 : tunables    0    0    0 : slabdata    432    432      0
seq_file             816    816    120   34    1 : tunables    0    0    0 : slabdata     24     24      0
sigqueue           12597  12597     80   51    1 : tunables    0    0    0 : slabdata    247    247      0
bdev_cache           100    100   1600   20    8 : tunables    0    0    0 : slabdata      5      5      0
shmem_inode_cache   5289   5330    792   41    8 : tunables    0    0    0 : slabdata    130    130      0
kernfs_node_cache  68797  68880    136   30    1 : tunables    0    0    0 : slabdata   2296   2296      0
mnt_cache           2184   2184    384   42    4 : tunables    0    0    0 : slabdata     52     52      0
bfilp                640    640    256   32    2 : tunables    0    0    0 : slabdata     20     20      0
filp               27292  28392    192   42    2 : tunables    0    0    0 : slabdata    676    676      0
inode_cache        17581  17675    640   25    4 : tunables    0    0    0 : slabdata    707    707      0
dentry            482570 483504    192   42    2 : tunables    0    0    0 : slabdata  11512  11512      0
names_cache          216    216   4096    8    8 : tunables    0    0    0 : slabdata     27     27      0
net_namespace         48     48   4864    6    8 : tunables    0    0    0 : slabdata      8      8      0
lsm_inode_cache   716454 717824     32  128    1 : tunables    0    0    0 : slabdata   5608   5608      0
lsm_file_cache     29976  32000     16  256    1 : tunables    0    0    0 : slabdata    125    125      0
uts_namespace        444    444    432   37    4 : tunables    0    0    0 : slabdata     12     12      0
nsproxy             1344   1344     72   56    1 : tunables    0    0    0 : slabdata     24     24      0
vma_lock          140035 146370     40  102    1 : tunables    0    0    0 : slabdata   1435   1435      0
vm_area_struct    139071 144100    184   44    2 : tunables    0    0    0 : slabdata   3275   3275      0
files_cache         1242   1242    704   46    8 : tunables    0    0    0 : slabdata     27     27      0
signal_cache        1494   1540   1152   28    8 : tunables    0    0    0 : slabdata     55     55      0
sighand_cache       1215   1215   2112   15    8 : tunables    0    0    0 : slabdata     81     81      0
task_struct         1671   1692   6912    4    8 : tunables    0    0    0 : slabdata    423    423      0
cred                2982   2982    192   42    2 : tunables    0    0    0 : slabdata     71     71      0
anon_vma_chain     68555  72192     64   64    1 : tunables    0    0    0 : slabdata   1128   1128      0
anon_vma           44349  47073    104   39    1 : tunables    0    0    0 : slabdata   1207   1207      0
pid                 5105   6272    128   32    1 : tunables    0    0    0 : slabdata    196    196      0
Acpi-ParseExt        936    936    104   39    1 : tunables    0    0    0 : slabdata     24     24      0
Acpi-State        1158460869 1158460869     80   51    1 : tunables    0    0    0 : slabdata 22714919 22714919      0
shared_policy_node  11050  11050     48   85    1 : tunables    0    0    0 : slabdata    130    130      0
numa_policy           30     30    272   30    2 : tunables    0    0    0 : slabdata      1      1      0
perf_event            24     24   1328   24    8 : tunables    0    0    0 : slabdata      1      1      0
trace_event_file    2478   2478     96   42    1 : tunables    0    0    0 : slabdata     59     59      0
ftrace_event_field   7884   7884     56   73    1 : tunables    0    0    0 : slabdata    108    108      0
pool_workqueue      2560   2560    512   32    4 : tunables    0    0    0 : slabdata     80     80      0
maple_node         13367  14496    256   32    2 : tunables    0    0    0 : slabdata    453    453      0
radix_tree_node    51693  52556    584   28    4 : tunables    0    0    0 : slabdata   1877   1877      0
task_group           825    825    640   25    4 : tunables    0    0    0 : slabdata     33     33      0
mm_struct            736    736   1408   23    8 : tunables    0    0    0 : slabdata     32     32      0
vmap_area          31159  32032     72   56    1 : tunables    0    0    0 : slabdata    572    572      0
kmalloc_buckets       36     36    112   36    1 : tunables    0    0    0 : slabdata      1      1      0
kmalloc-cg-8k         32     32   8192    4    8 : tunables    0    0    0 : slabdata      8      8      0
kmalloc-cg-4k        529    536   4096    8    8 : tunables    0    0    0 : slabdata     67     67      0
kmalloc-cg-2k       1536   1536   2048   16    8 : tunables    0    0    0 : slabdata     96     96      0
kmalloc-cg-1k       1597   1696   1024   32    8 : tunables    0    0    0 : slabdata     53     53      0
kmalloc-cg-512      2404   2560    512   32    4 : tunables    0    0    0 : slabdata     80     80      0
kmalloc-cg-256       864    864    256   32    2 : tunables    0    0    0 : slabdata     27     27      0
kmalloc-cg-128      1088   1088    128   32    1 : tunables    0    0    0 : slabdata     34     34      0
kmalloc-cg-64       2880   2880     64   64    1 : tunables    0    0    0 : slabdata     45     45      0
kmalloc-cg-32       3072   3072     32  128    1 : tunables    0    0    0 : slabdata     24     24      0
kmalloc-cg-16       6144   6144     16  256    1 : tunables    0    0    0 : slabdata     24     24      0
kmalloc-cg-8       12288  12288      8  512    1 : tunables    0    0    0 : slabdata     24     24      0
kmalloc-cg-192      1260   1260    192   42    2 : tunables    0    0    0 : slabdata     30     30      0
kmalloc-cg-96       1176   1176     96   42    1 : tunables    0    0    0 : slabdata     28     28      0
dma-kmalloc-8k         0      0   8192    4    8 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-4k         0      0   4096    8    8 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-2k         0      0   2048   16    8 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-1k         0      0   1024   32    8 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-512        0      0    512   32    4 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-256        0      0    256   32    2 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-128        0      0    128   32    1 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-64         0      0     64   64    1 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-32         0      0     32  128    1 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-16         0      0     16  256    1 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-8          0      0      8  512    1 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-192        0      0    192   42    2 : tunables    0    0    0 : slabdata      0      0      0
dma-kmalloc-96         0      0     96   42    1 : tunables    0    0    0 : slabdata      0      0      0
kmalloc-rcl-8k         0      0   8192    4    8 : tunables    0    0    0 : slabdata      0      0      0
kmalloc-rcl-4k         0      0   4096    8    8 : tunables    0    0    0 : slabdata      0      0      0
kmalloc-rcl-2k         0      0   2048   16    8 : tunables    0    0    0 : slabdata      0      0      0
kmalloc-rcl-1k       992   1056   1024   32    8 : tunables    0    0    0 : slabdata     33     33      0
kmalloc-rcl-512       64     64    512   32    4 : tunables    0    0    0 : slabdata      2      2      0
kmalloc-rcl-256       64     64    256   32    2 : tunables    0    0    0 : slabdata      2      2      0
kmalloc-rcl-128     2368   2368    128   32    1 : tunables    0    0    0 : slabdata     74     74      0
kmalloc-rcl-64     47360  47360     64   64    1 : tunables    0    0    0 : slabdata    740    740      0
kmalloc-rcl-32         0      0     32  128    1 : tunables    0    0    0 : slabdata      0      0      0
kmalloc-rcl-16         0      0     16  256    1 : tunables    0    0    0 : slabdata      0      0      0
kmalloc-rcl-8          0      0      8  512    1 : tunables    0    0    0 : slabdata      0      0      0
kmalloc-rcl-192      168    168    192   42    2 : tunables    0    0    0 : slabdata      4      4      0
kmalloc-rcl-96    121548 121548     96   42    1 : tunables    0    0    0 : slabdata   2894   2894      0
kmalloc-8k           788    796   8192    4    8 : tunables    0    0    0 : slabdata    199    199      0
kmalloc-4k          1520   1560   4096    8    8 : tunables    0    0    0 : slabdata    195    195      0
kmalloc-2k          3787   3792   2048   16    8 : tunables    0    0    0 : slabdata    237    237      0
kmalloc-1k         29797  30432   1024   32    8 : tunables    0    0    0 : slabdata    951    951      0
kmalloc-512        78760  79456    512   32    4 : tunables    0    0    0 : slabdata   2483   2483      0
kmalloc-256        21771  21952    256   32    2 : tunables    0    0    0 : slabdata    686    686      0
kmalloc-128        10516  11008    128   32    1 : tunables    0    0    0 : slabdata    344    344      0
kmalloc-64         89433  90304     64   64    1 : tunables    0    0    0 : slabdata   1411   1411      0
kmalloc-32         33154  33920     32  128    1 : tunables    0    0    0 : slabdata    265    265      0
kmalloc-16         29936  30208     16  256    1 : tunables    0    0    0 : slabdata    118    118      0
kmalloc-8          19456  19456      8  512    1 : tunables    0    0    0 : slabdata     38     38      0
kmalloc-192        20701  21000    192   42    2 : tunables    0    0    0 : slabdata    500    500      0
kmalloc-96         15460  16842     96   42    1 : tunables    0    0    0 : slabdata    401    401      0
kmem_cache_node     1024   1024     64   64    1 : tunables    0    0    0 : slabdata     16     16      0
kmem_cache           608    608    256   32    2 : tunables    0    0    0 : slabdata     19     19      0

OMG, yes, that Acpi-State number is gigantic.

No clue, haven’t seen that before, but something is wrong in combination with the kernel working with ACPI. Are there any suspicious message in the journalctl -b regarding acpi?

Apr 08 12:54:32 wes-wks syncthing[1622]: [AF4ZY] INFO: GUI and API listening on [::]:8080

This is the only acpi related thing I see in journalctl -b. I do remember as of a few weeks ago that when I would try to shut the computer down with the power button, I would see a feed of acpi errors in an interface that looked like cli after the regular plasma stuff was killed, on the way to the computer shutting down. After some googling, I recall I added an acpi related argument in my boot options. Here is my current default entry from ‘bootctl list’

 System Token: set
       Exists: no
         type: Boot Loader Specification Type #1 (.conf)
        title: EndeavourOS (6.13.8-arch1-1) (default)
           id: ad4eae18afa9491bbf7ea5600371326b-6.13.8-arch1-1.conf
       source: /efi//loader/entries/ad4eae18afa9491bbf7ea5600371326b-6.13.8-arch1-1.conf (on the EFI System Partition)
     sort-key: endeavouros-6.13.8-arch1-1
      version: 6.13.8-arch1-1
   machine-id: ad4eae18afa9491bbf7ea5600371326b
        linux: /efi//ad4eae18afa9491bbf7ea5600371326b/6.13.8-arch1-1/linux
       initrd: /efi//ad4eae18afa9491bbf7ea5600371326b/6.13.8-arch1-1/initrd
      options: nvme_load=YES nowatchdog rw root=UUID=e8bf1ca3-0696-4125-bad7-3301b375be8e nvidia_drm.modeset=1 rw root=UUID=e8bf1ca3-0696-4125-bad7-3301b375be8e nvidia_drm.modeset=1 quiet splash intel_iommu=on acpi_enforce_resources=lax systemd.machine_id=ad4eae18afa9491bbf7ea5600371326b

I hope that just removing acpi_enforce_resources=lax will fix the issue. I’m going to try doing that, although I’ll have to reboot. (Lmk if you have any other suggestions!)

Give it a try. At least we found the missing memory in the slab section - which is usually not reported by free or the other monitor tools - so you can easily check if it increases now (e.g. cat /proc/meminfo | grep Slab)

But no clue what’s causing it.

Yes, thanks much for the help accounting for the missing memory! I’ll restart and hopefully report back after some runtime. If removing that acpi related boot option does not fix the issue, I wonder if there’s any way to specifically clear whatever is being stored in the slab section (or if this is advisable).

Sounds good.

I’m not an expert, I just discovered slab when I finally spend the time figuring out why my memory calculation was always 1-2 GB short. :wink:

Afaik it’s memory that is allocated dynamically by the kernel and the user has no way to clear it. There are some vm. params that have control over if it works normally, but then this situation is clearly something that should never happen (bug).

Ah that makes sense. Yes, this is clearly a bug! I recall trying to configure VM’s soon after I started using endeavourOS, but I believe I specifically allocated very small amounts of RAM and tried to make sure that nothing would start by default. I abandoned this pretty quickly. Maybe there are some VM related packages I can uninstall (or processes I can kill) that could be related.

Sorry, I should have been more precise: There are a few knobs in the kernel “vm” as in virtual-memory system that can affect slab behavior (being pedantic here on the point that there are ways to influence some behavior). But these are imho unrelated to this issue, this off the charts and something else.

If you worked with virtual-machines in the past that should not have any influence on this issue.

That’s helpful!

Well, I removed the acpi related boot option I had and then rebooted. I checked Slab soon after and then checked it again after about 4hr – here are both results

cat /proc/meminfo | grep Slab
Slab:             739196 kB
cat /proc/meminfo | grep Slab
Slab:           20853936 kB

Seems the issue still persists :confused:

I realized that I should probably figure out how to disable acpi to whatever possible extent, since there is clearly some kind of incompatibility here. I’m going in order and trying the debugging steps here

Steps printed below:

"The steps below are (pretty much) copied from the DebuggingACPI page and are what I suggest you do to try to isolate the problem before filing a bug report. (I believe the procedures for reporting a bug are also on the DebuggingACPI page)


If acpi=off allows the system to boot, try to isolate the ACPI issue with the following boot parameters. Remove acpi=off and boot with only one of the options below.

If you are lucky, you might find a combination of kernel parameters which allows you to boot and use all the cores of your CPU.

Note: If you need an explanation of to how to do a “one time” change of the kernel boot parameters/options, try this answer to the question “How do I add a kernel boot parameter?”.

  • Try booting with acpi=ht
    This disables all of ACPI except just enough to enable Hyper Threading.

If acpi=off works and acpi=ht fails, then the issue is in the ACPI table parsing code itself, or perhaps the SMP code.

  • Try booting with pci=noacpi
    This disables ACPI for IRQ routing and PCI scanning.
  • Try booting with acpi=noirq
    This disables ACPI for IRQ routing.
  • Try booting with pnpacpi=off
    This disables the ACPI component of the Linux Plug and Play code.
  • Try booting with noapic
    Disables the IO-APIC for IRQ routing or PCI scanning.
  • Try booting with nolapic
    Disables the local APIC."

Thus far I’ve tried acpi=off (results in a failure to boot/frozen screen), as well as acpi=ht (allows me to boot, and initial acpi_state cache in Slab is of size 4590, but it still balloons to a huge size afterwards), and pci=noacpi (again boots to a black screen), acpi=noirq (successful boot, but acpi_state still grows exponentially larger with uptime).

Have you tried to update the firmware? Also, check the power management settings in your BIOS.

I updated the BIOS in the middle of diagnosing this (maybe a week ago?). I don’t know much about the power management settings in my mobo–I believe I’ve disabled secure boot and that there may be an additional power management setting I’ve disabled (will take note on next boot)

[Update] – I believe platform power management was disabled in my bios settings. I will try enabling it during my debugging steps to see what difference it makes. As of now, all other debugging steps related to acpi options in my bootloader have been unsuccessful thus far.

Can you post output of,

$cat /proc/interrupts

Thanks for the suggestion! I kind of feel like the computer is screaming at me with this one, lol. The highest entries are:
(9,CPU0) (seems related to acpi and whatever fasteoi is?)
(LOC, : ) (the entire LOC row, corresponding to local timer interrupts)

sudo cat /proc/interrupts
            CPU0       CPU1       CPU2       CPU3       CPU4       CPU5       CPU6       CPU7       CPU8       CPU9       CPU10      CPU11      CPU12      CPU13      CPU14      CPU15      CPU16      CPU17      CPU18      CPU19      CPU20      CPU21      CPU22      CPU23      
   8:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC    8-edge      rtc0
   9:  164617904          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC    9-fasteoi   acpi
  14:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC   14-fasteoi   INTC1084:00, INTC1082:00
  16:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC   16-fasteoi   idma64.6, processor_thermal_device_pci
  17:          0          0          0          0          0          0          0          0          0          0          0       5815          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC   17-fasteoi   snd_hda_intel:card0
  18:          0          0          0          0          0          0          0          0          0          0        156          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC   18-fasteoi   i801_smbus
  28:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC   28-fasteoi   idma64.7, pxa2xx-spi.7
  29:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC   29-fasteoi   i2c_designware.4
  30:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC   30-fasteoi   i2c_designware.5
  32:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC   32-fasteoi   idma64.0, i2c_designware.0
  33:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC   33-fasteoi   idma64.1, i2c_designware.1
  34:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC   34-fasteoi   idma64.2, i2c_designware.2
  35:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-IO-APIC   35-fasteoi   idma64.3, i2c_designware.3
 120:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 DMAR-MSI    0-edge      dmar0
 121:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 DMAR-MSI    1-edge      dmar1
 122:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 DMAR-MSI 2048-edge      dmar0-perf
 123:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 DMAR-MSI 2049-edge      dmar1-perf
 124:          0          0          0          0          0       1096          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSI-0000:00:06.0    0-edge      PCIe PME, aerdrv, PCIe bwctrl
 125:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSI-0000:80:1b.0    0-edge      PCIe PME, aerdrv, PCIe bwctrl
 126:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSI-0000:80:1b.4    0-edge      PCIe PME, aerdrv, PCIe bwctrl
 127:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSI-0000:80:1d.0    0-edge      PCIe PME, aerdrv, PCIe bwctrl
 128:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSI-0000:80:1d.6    0-edge      PCIe PME, aerdrv, PCIe bwctrl
 129:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSI-0000:80:17.0    0-edge      ahci[0000:80:17.0]
 130:          0          0          0          0          0          0          0          0          0          0          0     246886          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSI-0000:80:14.0    0-edge      xhci_hcd
 138:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          1          0          0 IR-PCI-MSI-0000:00:0b.0    0-edge      intel_vpu
 139:          0          0         38          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSI-0000:80:16.0    0-edge      mei_me
 140:          0          0          0          0          0          0          0          0          0        135          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0    0-edge      nvme0q0
 141:          0     134899          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0    1-edge      nvme0q1
 142:          0          0          0     108895          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0    2-edge      nvme0q2
 143:          0          0          0          0          0     112294          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0    3-edge      nvme0q3
 144:          0          0          0          0          0          0          0     123244          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0    4-edge      nvme0q4
 145:          0          0          0          0          0          0          0          0          0      53460          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0    5-edge      nvme0q5
 146:          0          0          0          0          0          0          0          0          0          0          0      44429          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0    6-edge      nvme0q6
 147:          0          0          0          0          0          0          0          0          0          0          0          0          0      21794          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0    7-edge      nvme0q7
 148:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      16673          0          0          0          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0    8-edge      nvme0q8
 149:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      24168          0          0          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0    9-edge      nvme0q9
 150:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0      22505          0          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0   10-edge      nvme0q10
 151:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0       6202          0          0          0          0          0 IR-PCI-MSIX-0000:82:00.0   11-edge      nvme0q11
 152:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0       6780          0          0          0          0 IR-PCI-MSIX-0000:82:00.0   12-edge      nvme0q12
 153:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0       5318          0          0          0 IR-PCI-MSIX-0000:82:00.0   13-edge      nvme0q13
 154:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0       5706          0          0 IR-PCI-MSIX-0000:82:00.0   14-edge      nvme0q14
 155:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0       6530          0 IR-PCI-MSIX-0000:82:00.0   15-edge      nvme0q15
 156:          0          0          0          0          0          0          0          0     407755          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSI-0000:00:02.0    0-edge      i915
 157:          0          0          0          0          0          0          0     458431          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSI-0000:01:00.0    0-edge      nvidia
 158:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0       4477 IR-PCI-MSIX-0000:82:00.0   16-edge      nvme0q16
 159:          0          0          0          0          0          0          0          0          0          0          0          0          0     660904          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSIX-0000:84:00.0    0-edge      enp132s0
 160:          0          0          0          0          0          0          0          0          0          0          0          0       7259          0          0          0          0          0          0          0          0          0          0          0 IR-PCI-MSI-0000:80:1f.3    0-edge      snd_hda_intel:card1
 NMI:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Non-maskable interrupts
 LOC:   28248985   13781655    6654649    6220404    5748397    6284205    5656688    6000101    5564803    6123661    6142424    5639019    6053657    8193792    6268594    5779821    6220357    6323616    6186587    5564009    6068281    6354315    6115042    5574433   Local timer interrupts
 SPU:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Spurious interrupts
 PMI:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Performance monitoring interrupts
 IWI:          3         11          9          5          7          5      26383     124592       3195        248         48         60         11         14          1          1          2          6          0          4          3          3         29          7   IRQ work interrupts
 RTR:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   APIC ICR read retries
 RES:       8599       1931       3240       1661       1479        711      38564      42223      18274      11208      14605      12811      18664      26477      18011      14661      19413      23374      16762      13369      18994      22416      16479      13983   Rescheduling interrupts
 CAL:     152010     610501     546187     572897     449900     578961     408615     487956     808908     876527     695963     579722     579047     631910     585257     419309     672396     681940     651784     509617     646650     777841     662259     580268   Function call interrupts
 TLB:      62369     302557     428310     476001     366989     473023     295760     301601     366040     363529     294708     262285     275928     260461     285562     218129     298144     297659     304712     234712     295346     329998     290167     261214   TLB shootdowns
 TRM:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Thermal event interrupts
 THR:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Threshold APIC interrupts
 DFR:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Deferred Error APIC interrupts
 MCE:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Machine check exceptions
 MCP:         97         98         98         98         98         98         98         98         98         98         98         98         98         98         98         98         98         98         98         98         98         98         98         98   Machine check polls
 ERR:          0
 MIS:          0
 PIN:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Posted-interrupt notification event
 NPI:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Nested posted-interrupt event
 PIW:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Posted-interrupt wakeup event
 PMN:          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0          0   Posted MSI notification event

It seems to me that system acpi states keep changing for some reason. A broken/faulty BIOS firmware could cause this type of problems. But you stated that you have flashed your BIOS.

Let’s see what acpi is doing in the system.


$sudo pacman -S acpid

$sudo systemctl start acpid

$sudo /usr/bin/acpi_listen >> acpi_event.txt

Let it run for a few hours. The acpi_event.txt file should give use some clues.

ok I’ll do this – thanks for all the help!! I see that this last command hangs while it runs–should I just ctrl+c when I’m done with it?