Why is my display resolution limited to 800x600 in Debian?

I just installed Debian 11.6 and see that everything looks scaled up a lot. I checked the size of the display and it is 800 x 600 which is quite big having it on my 4k monitor. But me having an NVIDIA RTX 3060 Ti should not trigger this because that is some good hardware. I opened Settings and went to the Display section to change the resolution and I can only see the resolution but not change it. How can I change the resolution of the display?