I was able to get the 525xx drivers back but only in the 6.1 LTS kernel using:
sudo downgrade nvidia-dkms nvidia-utils lib32-nvidia-utils
However, if I boot into the 6.5 kernel and run the same command, it still only changes it for the 6.1 LTS kernel, not the 6.5.
How can I sudo downgrade to 525 in the 6.5 kernel?