I want to hold the console off but the download is not yet finished. Is that possible to download in silent mode like the ps4?
You can put your console in instant-on mode so that downloads continue in the background while the console is off.
To set that up, do the following:
Press the Xbox button to open the guide.
Select System> Settings> General> Power Mode & Start.
Using the drop-down menu, you can then choose between energy-saving mode and instant-on mode.
The console will then of course still draw power and keep an internet connection, but will do this automatically for you to download updates for the system, as well as for games and general games that are in the download queue.
You can read more about the energy settings on the https://beta.support.xbox.com/help/hardware-network/power/learn-about-power-modes website.