iPhone message attachments keep returning even after I delete them

On my iPhone 13, some iMessage conversations have nearly 100 MB of images. For one conversation, I went to "Attachments" and manually deleted every single photo, but then a few days later noticed all the ones I deleted were back, as if I never deleted them. How do I actually delete the attachments permanently? (iPhone 13, iOS 16.6)