Remove XBox one account?

I logged on to my friend's xbox and he logged on to mine. Now I still have his profile here and can access it. I'm afraid he might still be able to access mine. Since I can't go to his xbox and remove myself, I wanted to ask how I can make sure that he can no longer access my account.

Then you would have to delete your account and all of your data on it.