I’ve seen this with MATE, where the cursor size setting would change at some point (maybe when switching theme?), with different applications looking at different places the setting is stored. The usual fix for me was to reset the cursor size using dconf-editor,
No idea if this is the same for Xfce but it’s probably worth a look.