Disable 'OK Google' recognition without completely disabling Google app

I find the 'OK Google' always-on voice recognition to be creepy and intrusive. At the same time, I find the voice entry for GBoard keyboard to be very useful. If you completely disable the Google app, 'OK Google' recognition is disabled, but so is the voice entry for the GBoard keyboard. Is there a way to prevent Google from always listening, without completely disabling the Google app?