Yes I tried different ports (usb 2 and 3). Also the ones on the front, to test if it has something to do with the distance between the adapter and controller.
You are right. When I created the initial post, I used an usb bluetooth adapter.
But since yesterday I have an Intel AX200, connected via PCI-E.
I was really hoping this would also solve this problem. But no, it doesn’t.
At least I know now that this is not a hardware defect of the bluetooth adapter.