Can I downgrade from SQL Server 2017 CU25 to CU20?

New instance of SQL Server 2017. I chose to install up to CU25 during the initial installation. Been using the database for a few months, but it seems to have a memory leak when using memory-optimized tables which causes it to crash overnight sometimes. I have another instance with the same jobs and hardware on CU20 and it has never had this problem. Leads me to believe this is a CU25 issue. I'd like to downgrade to CU20 to see if this fixes the issue. What is the best way of doing this?