Clearing out most recent emoji / emoticons?

Whenever I use an emoji / emoticon from the Google keyboard on Android, it gets added to the recent / most-used list of emoji. This is generally useful, but there are times when I use an emoji just one time, and I prefer not to have it stored in the "most used" list. Is there any way to remove just one or a few emojis from the most used list? Or even clear out the entire list and start from scratch?