Relegating the establishment of security controls to a small team of Risk Management experts leads to glaring holes in your Risk Register. Opening up your Risk Register to more perspectives gives you more comprehensive security.
Not everything that is important can be quantified and measured. But not everything can be identified based on the human instinct side either. A balance must be struck for the clearest vision and best guidance.