Lie of the voices of a PS4 party?

So be the latest every time I join a PS4 party I fly out after a short time or the voices of the other players are at a standstill. However, my teammates hear me well and I have no lags in the game or anywhere else just the voices of the teammates lag

I have that and many others too. I heard that it is due to the server overload, but find it strange that some have it and some do not 🤷♂️