I know that you can do this in the Windows settings, but this only applies to the "standard" desktop icons. I want to apply that to shortcuts, for example a nicer Discord / Twitch / Valorant / etc icon on my desktop.
Right click on the shortcut, then select Settings.
Now select the Link tab.
Now you can set a new icon using the "Change symbol" button.