Rocky Linux LACP dropping packets, but individual interfaces work fine
0
votes
0
answers
34
views
I have a Rocky Linux setup going to a Dell 5248 running OS10. LAGs switch to switch work just fine. If I do individual interfaces from Rocky up to the switch, I can ping the switch's VLAN interface no problem. However, when I try to set up a LAG I lose more than half my packets. The LAG is up on Linux:
cat /proc/net/bonding/bond0
Ethernet Channel Bonding Driver: v5.14.0-503.40.1.el9_5.x86_64
Bonding Mode: IEEE 802.3ad Dynamic link aggregation
Transmit Hash Policy: layer2 (0)
MII Status: up
MII Polling Interval (ms): 100
Up Delay (ms): 0
Down Delay (ms): 0
Peer Notification Delay (ms): 0
802.3ad info
LACP active: on
LACP rate: slow
Min links: 0
Aggregator selection policy (ad_select): stable
Slave Interface: ens6f0
MII Status: up
Speed: 25000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: b4:83:51:02:7a:30
Slave queue ID: 0
Aggregator ID: 1
Actor Churn State: none
Partner Churn State: churned
Actor Churned Count: 0
Partner Churned Count: 1
Slave Interface: ens6f1
MII Status: up
Speed: 25000 Mbps
Duplex: full
Link Failure Count: 0
Permanent HW addr: b4:83:51:02:7a:31
Slave queue ID: 0
Aggregator ID: 2
Actor Churn State: churned
Partner Churn State: churned
Actor Churned Count: 1
Partner Churned Count: 1
On the switch side it sees it in ARP, the port channel is up, the VLAN is all setup correctly:
RDMATest# show ip arp
Codes: pv - private vlan where the mac is originally learnt
Address Hardware address Interface Egress Interface
------------------------------------------------------------------------------------------
10.99.99.97 e8:eb:d3:44:7a:61 vlan1010 ethernet1/1/21
10.99.99.98 e8:eb:d3:44:89:89 vlan1010 ethernet1/1/23
10.99.99.103 b4:83:51:02:7a:30 vlan1010 port-channel10
192.168.5.244 54:bf:64:f3:12:c3 vlan5 ethernet1/1/48
192.168.5.254 00:01:e8:8b:cd:99 vlan5 ethernet1/1/48
RDMATest#
RDMATest# show vlan 1010
Codes: * - Default VLAN, M - Management VLAN, R - Remote Port Mirroring VLANs,
@ - Attached to Virtual Network, P - Primary, C - Community, I - Isolated,
S - VLAN-Stack VLAN
Q: A - Access (Untagged), T - Tagged
NUM Status Description Q Ports
1010 Active RDMA access VLAN A Eth1/1/21,1/1/23
A Po10
RDMATest# show interface port-channel 10
Port-channel 10 is up, line protocol is up
Address is 1c:72:1d:fa:af:a3, Current address is 1c:72:1d:fa:af:a3
Interface index is 80
Internet address is not set
Mode of IPv4 Address Assignment: not set
Interface IPv6 oper status: Disabled
IP Unreachables status: Disabled
MTU 9216 bytes, IP MTU 9184 bytes
LineSpeed 50G
Minimum number of links to bring Port-channel up is 1
Maximum active members that are allowed in the portchannel is 32
Members in this channel: Eth 1/1/17,1/1/19
ARP type: ARPA, ARP Timeout: 60
Tag Protocol IDentifier (TPID) value: 0x8100
Last clearing of "show interface" counters: 00:54:37
Queuing strategy: fifo
Input statistics:
54670 packets, 7518392 octets
669 64-byte pkts, 15773 over 64-byte pkts, 33523 over 127-byte pkts
4705 over 255-byte pkts, 0 over 511-byte pkts, 0 over 1023-byte pkts
41924 Multicasts, 4929 Broadcasts, 7817 Unicasts
0 runts, 0 giants, 0 throttles
0 CRC, 0 overrun, 0 discarded
0 FEC corrected code words, 0 FEC uncorrected code words
Output statistics:
739017 packets, 60776937 octets
688419 64-byte pkts, 6046 over 64-byte pkts, 40 over 127-byte pkts
44512 over 255-byte pkts, 0 over 511-byte pkts, 0 over 1023-byte pkts
733243 Multicasts, 5084 Broadcasts, 690 Unicasts
0 throttles, 4 discarded, 0 Collisions, wred drops
Rate Info(interval 30 seconds):
Input 0 Mbits/sec, 0 packets/sec, 0% of line rate
Output 0 Mbits/sec, 0 packets/sec, 0% of line rate
Time since last interface status change: 00:54:11
However, this is what I get if I run a ping from Rocky:
[grant@localhost ~]$ !ping
ping 10.99.99.104
PING 10.99.99.104 (10.99.99.104) 56(84) bytes of data.
64 bytes from 10.99.99.104: icmp_seq=2 ttl=64 time=0.239 ms
64 bytes from 10.99.99.104: icmp_seq=3 ttl=64 time=0.223 ms
64 bytes from 10.99.99.104: icmp_seq=7 ttl=64 time=0.260 ms
^C
--- 10.99.99.104 ping statistics ---
11 packets transmitted, 3 received, 72.7273% packet loss, time 10272ms
rtt min/avg/max/mdev = 0.223/0.240/0.260/0.015 ms
Asked by Grant Curell
(769 rep)
Jun 9, 2025, 02:54 PM