That was a good hint. I disabled iommu in the BIOS and this actually prevents the freezes so far. I made two tests so far and will keep testing.
What is the implication of disabling iommu? Is there any negative impact to that? At least my virtualboxes are still running.