My Raspberry Pi 4b 4GB with a hardware revision of Rev 1.2 has an annoying audio skip.
@alenbasic 's Raspberry Pi 4b unknown hardware revision does not have the audio skip. Maybe he has hardware Rev 1.1?
For me the solution was to install VLC which I normally use anyway. Then in preferences, then audio tab, change "Output module: to “ALSA audio ouput” then change “Device” to “bcm2835 ALSA, bcm2835 Also Defaut Audio Device”. Save, restart VLC and perfect audio & video. I think this process allows vlc to bypass pulseaudio.