Winscp and Putty connection is closed randomly to my Rocky Linux server

When using a VPN to connect to my Rocky Linux 9.3 server running on a virtual machine, my connection is randomly disconnected. After disconnection, I cannot reconnect for about one or two minutes, and the connection is refused. I have tried connecting from different computers on different networks, but the same error occurs. Only connections within the main network work (WinSCP from another Windows server to the Rocky Linux server remains stable). I am using pfSense as a firewall. I have already set the keep-alive connection parameters, but there is nothing suspicious in the server logs. I'm kind of running in the dark here. Some of the logs:

Knocking FTP port.
. 2024-08-21 11:35:02.610 FTP port did not open.
* 2024-08-21 11:35:02.693 (EFatal) Network error: Connection to "192.168.178.205" refused.
. 2024-08-21 11:35:06.189 Looking up host "192.168.178.205" for SSH connection
. 2024-08-21 11:35:06.189 Connecting to 192.168.178.205 port 22
. 2024-08-21 11:35:08.287 Failed to connect to 192.168.178.205: Network error: Connection refused
. 2024-08-21 11:35:08.287 Knocking FTP port.
. 2024-08-21 11:35:10.302 FTP port did not open.
* 2024-08-21 11:35:10.368 (EFatal) Network error: Connection to "192.168.178.205" refused.

/var/log/secure:

Aug 21 14:49:01 localhost sshd: Connection from 172.16.17.4 port 49860 on 192.168.178.205 port 22 rdomain ""
Aug 21 14:49:05 localhost sshd: Accepted password for woshi from 172.16.17.4 port 49860 ssh2
Aug 21 14:49:05 localhost sshd: Starting session: subsystem 'sftp' for woshi from 172.16.17.4 port 49860 id 0
Aug 21 14:49:30 localhost sshd: Connection from 172.16.17.4 port 49945 on 192.168.178.205 port 22 rdomain ""
Aug 21 14:49:58 localhost sshd: Accepted password for woshi from 172.16.17.4 port 49945 ssh2
Aug 21 14:49:58 localhost sshd: Starting session: shell on pts/1 for woshi from 172.16.17.4 port 49945 id 0
Aug 21 14:52:16 localhost sshd: Connection from 172.16.17.4 port 50512 on 192.168.178.205 port 22 rdomain ""
Aug 21 14:52:17 localhost sshd: Accepted password for woshi from 172.16.17.4 port 50512 ssh2
Aug 21 14:52:17 localhost sshd: Starting session: subsystem 'sftp' for woshi from 172.16.17.4 port 50512 id 0
Aug 21 14:53:23 localhost sshd: Connection from 172.16.17.4 port 50739 on 192.168.178.205 port 22 rdomain ""
Aug 21 14:53:23 localhost sshd: Accepted password for woshi from 172.16.17.4 port 50739 ssh2
Aug 21 14:53:24 localhost sshd: Starting session: shell for woshi from 172.16.17.4 port 50739 id 0
Aug 21 14:53:28 localhost sshd: Connection from 172.16.17.4 port 50757 on 192.168.178.205 port 22 rdomain ""
Aug 21 14:53:32 localhost sshd: Failed none for woshi from 172.16.17.4 port 50757 ssh2
Aug 21 14:53:59 localhost sshd: Accepted password for woshi from 172.16.17.4 port 50757 ssh2
Aug 21 14:54:00 localhost sshd: Starting session: shell on pts/0 for woshi from 172.16.17.4 port 50757 id 0
Aug 21 15:09:06 localhost sshd: Timeout, client not responding from user woshi 172.16.17.4 port 49860
Aug 21 15:11:30 localhost sshd: Timeout, client not responding from user woshi 172.16.17.4 port 49945
Aug 21 15:18:25 localhost sshd: Timeout, client not responding from user woshi 172.16.17.4 port 50739
Aug 21 15:21:18 localhost sshd: Timeout, client not responding from user woshi 172.16.17.4 port 50512
Aug 21 15:21:28 localhost sshd: Timeout, client not responding from user woshi 172.16.17.4 port 50757

**UPDATE:** So my network is managed by pfSense. I am connecting to that network over OpenVPN. My Rocky Linux server (target server) is on VmWare virtual machine.