Minscription Villager Jobs?

I've removed all the job blocks nearby but the villager doesn't lose his job why. PLAY ON PS4

If you've traded with them before, they won't lose their jobs either

Either it is like Nikigo already wrote it, you traded with him and because of that he can't lose his job or you just have to wait a bit if you haven't traded with him yet, that can sometimes take a while until a villager loses his job afterwards he no longer has a work block.