You have to do it…manually. Did the driver include an uninstaller? P.S. This is why you shouldn’t install things manually. Always use pacman.
No, pacman can only remove software it installed.
nvidia-470xx-dkms is the minimum you need. If you need 32-bit support, you can add the lib32 package.