Looks like licence for Sofalizer filter is tricky. The ffmpeg that comes by default does not support it. Neither does jellyfin-ffmpeg6-bin. But the ffmpeg in Debian does support it.
I am guessing there could be a ffmpeg package in AUR that does support Sofalizer filter. So is there one? I would really like to avoid building ffmpeg myself.