How to replace the adopted SD card without reformatting the entire phone?

I currently have a Fairphone 4 and a 1 TB SD card. It was set up as shared internal storage. Over the past few weeks, I've been having random crashes on the phone which I think may be down to the SD card. I've got a replacement SD. However, if I use the new SD card, I cannot access any storage on the phone at all. If I insert the new SD card and format it as internal storage, I can see a total storage of 1.19 TB in the Settings app. However, if I go to the files app, I can't browse any folders. With the FX File Manager, it just says access denied whenever I try to navigate into the /storage folder. I can't install any apps/updates on the phone unless I put the old SD card back in. It does exactly the same thing if I take the SD card out entirely, unable to browse the local folders/update any apps. I'm hoping there's a way to allow access to the new storage area without resetting the entire phone?