Xbox One Controller doesn't connect

My Xbox connection button is defective and I can't connect my controller! It was normal before Connected everything worked but then I connected my Xbox to my brother and then I couldn't connect to mine! Whenever I switch on my controller it is connected to my brother's console! I tried it with a USB cable but it doesn't work! I can use my keyboard to press everything on the start page, for example settings, YouTube, etc. But I need the controller to play, please help!

First make sure that the controller is fully charged / the batteries are replaced. If the controller is almost empty, it won't connect to another Xbox properly.

Then hold the small button above the power button of your controller and under that of your Xbox for a few seconds (see picture) until both start to flash.

After a few seconds the controller should have connected.

My console's connect button is broken (I don't have Xbox One Slim)