Delayed focus when switching workspaces (lost keystrokes)

I'm using macOS 13.6 on a 2023 MacBook Pro with an M2 chip. When I switch workspaces (using the Ctrl+← / →), there is a delay of probably several hundred milliseconds (or maybe even a second) before a window on the new workspace acquires focus. For example, let's say I'm switching to a workspace with an open text editor. If I start typing right after hitting Ctrl+← / →, my first keystrokes will not be recognized. This is super annoying, I always have to wait a moment before doing anything when switching to another workspace. This issue is not limited to text editors, it occurs with all keyboard input in every application I'm using. From Ubuntu, I'm used to immediately interacting with a window when switching workspaces. Any idea whether this can be fixed?