MySQL Group replication failover detection while node is recovering

I'm trying to get a solid MySQL group replication load balancing / failover set-up. Currently I use keepalived to share one private IP to connect to the loadbalanced MySQL GROUP REPLICATION cluster, balanced/failover arranged through haproxy (tcp checks on port 33061) which works great. However, once a node get's in an unreachable state (because of network issues) and eventually goes offline for the cluster we will have to join the node back to the cluster, which is all fine and works. However, during the recovery phase (state RECOVERING), the node is already listening on port 33061, enabling the node for loadbalancing and failover. However, the cluster is not operational yet. Is there any check I can add to prevent the node from being online while the node is still in RECOVERING state, joining the cluster? Usually this process is rather quick, but it also happend a few times that it may take up to 15 minutes, causing database errors during this phase. Many thanks!