If anyone else ever has this issue, launching Spotify in terminal with --disable-gpu or adding it to the exec line in the .desktop file for Spotify solved my issue! The issue has something to do with hardware acceleration, as disabling it on every app seems to work so far.
However, if you add --disable-gpu to the exec line it does not work when launched from terminal unless you type it there as well, otherwise just use the app launcher 