SystemUIServer (& configd) Freaking Out Since Upgrading to Sequoia

2018 Mac mini previously running Ventura. 32 GB of RAM, 1 TB SSD with plenty of space. Lots of 3rd party apps but not many menubar items or sketchy type software. A pretty clean system. So ever since upgrading to Sequioa, heres what happens: Upon boot, everything is fine for about a day. Then SystemUIServer combined with configd start using 100% of the CPU (out of 600% total). Over the next day or two, it gets worse and worse. You get these little one second beachballs while you're typing. One second goes to two, goes to three. The fan in the mini is spinning annoyingly loudly. After a few days, the system is unusable, so I reboot and everything is fine. For a day. I posted this to the Apple forum but the only suggest was to wipe the system and start over from scratch, which is total nonsense. Things I have tried so far: I've gone through all of my launchd items and deleted all of the ones from old software or from software I don't need. Some had to stay of course, Photoshop won't run without it. I quit the two 3rd party items I had in my menubar. I had a hunch maybe it was a Malwarebytes problem, so I uninstalled it entirely. All this, but no change. The classic next troubleshooting steps to take are to create a new user on this system and see if it happens there, and to install Sequoia on a USB SSD through this machine and see if it happens there. The problem is that 1 day delay before the problem pops up makes it really hard to do that kind of troubleshooting. This isn't (just) a recreational machine, I have work to do. Lots of it. All the time. In the meantime I've just been rebooting every 2 to 3 days and I guess I'm stuck doing that for the foreseeable future. There are two factors that make my setup a little unique. I say a little, because zero 3rd party software is involved, it's all Apple. But this 2018 Mac mini does have 3 monitors installed. And I do have 7 virtual desktop sets setup. So I have 21 total virtual displays with a bunch of windows open on each. But I don't have THAT many windows open on each. I'm not hoarding windows like a Chrome user hoards tabs. I just have areas where I do different kinds of work. Like one for video editing that will have a couple of Finder windows plus iMovie open - but only while I'm working on a video. Another space might have two terminal windows and two browser windows. Nothing dramatic. I tell you this only to suggest that I don't think this problem is related to my "Spaces" or my monitors. Especially since it was like this in Ventura and previous macOS versions for years and while this setup does have some problems, it doesn't have anything quite like this. One more thing: it's not a constant thing once it starts happening, but it happens more and more the longer the Mac runs until it becomes almost constant. BUT I've noticed it tends to be happening a lot when I sit down at my desk and my computer's displays are asleep. I can hear the fan in the mini spinning while it should be idle, so I know the two processes are going nuts. And sure enough, they are. It's as if I have a high CPU screen saver that's also running after the displays go to sleep. But I double checked the screen saver settings and that is not the case. So maybe someone out there has some specific ideas of what might be causing this? Maybe someone knows what would cause configd and SystemIUServer to freak out together in perfect sync? Then pause for a while together, then start up again together?