Does a white controller go together with a black setup and a white PC?

I want to buy an Xbox controller for my PC, but I don't know what color it is

You can always mix black and white

But otherwise have no periphery in white

If white controllers are compatible with black hardware, then that should work too.

Joking aside: take what you like or what looks good for you. A contrast can sometimes make sense optically.

I know that I would only have the controller as a contrast and hold my pc, which is why I'm not sure

Then take a white piece of plastic and hold it in your hands like a controller. Then hold it in front of the rest of your hardware and put it next to it and see if you like it or not.