Can I leave the games on and just delete my profile?
No. Games that you have purchased digitally are only saved on your Microsoft account.
4 years ago