Download Manager causes high CPU usage on Motorola Razr with stock Android 4.0

My Razr (Stock ROM 4.0) is very very hot. After some research I found com.android.providers.downloads is responsible, since it's using about 60% of CPU. I have tried killing it, and it respawns, however what I found to work (for two hours) is clearing the cache and data of the process, and killing it, however something is triggering again. P.S. I'm not downloading anything, and all my apps are updated (so Play Store is not trying to download updates). If I freeze this process, the Gmail app crashes.