Ps5 sound broken?

So the problem is that when I connect headphones to my Ps5 controller (I've tried several headphones, so it's the controller and not the headphones) Does the sound sound extremely broken, bad and weird and all I hear is so quiet, broken sound and it doesn't matter what I do. You can't even understand the voices in games / videos. So you can fix it yourself, and if so, how? Or you can have the controller replaced

Switching to Xbox solves all problems and worries.