Thanks for writing in!
Custom CSS won’t necessarily slow down the site speed too heavily. It’s your preference where you want to place the CSS. Both Child theme or Global CSS under X/Pro > Theme Options > CSS works absolutely fine.
If you want to optimise page load time, please take a look at our performance optimisation guide.