OK, if it started happening after updating to kernel 5.16 then install linux-lts and try that (it’s currently 5.15). If this works correctly then it’s likely a regression that will be fixed over the next few point-releases.
The other potential issue may be with NVIDIA 495xx as it has a known memory leak issue: PSA: bug in Nvidia driver causes dbus spam