DPDK testpmd with E823 link status is down

JackyCT.Chen JackyCT.Chen at advantech.com.tw
Wed Jan 31 11:52:39 CET 2024


Hi Qiming & dpdk dev team:

This is JackyCT.Chen from Advantech, we have a question about E823 DPDK loopback testpmd  ,
Could you please give us some advice?

We bind the E823 and X710 devices with vfio-pci driver and execute the DPDK testpmd . (detail see attached files please)

However,  both E823  "link status : down and link speed : None" , we expected that "link status : up and link speed : 10 Gbps" .
Do you have any suggestions?

Testing procedure & result:
Platform : Moro City Reference Planform ICX-D  ~ CRB

l   On-Board : E823

l   Ext-PCIE CARD : PCIE-2230NP-00A1E ( Intel X710 )
OS/Kernel :  Debian 12  / kernel 6.1.0-16-amd64 x86_64
DPDK : DPDK 24.03.0-rc0 (from trunk build)
NIC_BDF_INFO :
CRB EXT-PCIE CARD : X710
Port : 10G * 4
firmware-version: 7.10 0x80007b33 255.65535.255

CRB On-BOARD : E823
Port Option : 4x10-4x2.5
firmware-version: 3.26 0x8001b733 1.3429.0

BDF = 91:00.0
---
BDF = 89:00.0
BDF = 91:00.1
---
BDF = 89:00.1
Prepare and config :
root at 5-efi:~# modprobe uio
root at 5-efi:~# modprobe vfio-pci
root at 5-efi:~# echo 2048 > /sys/devices/system/node/node0/hugepages/hugepages-2048kB/nr_hugepages
root at 5-efi:~# mkdir -p /mnt/huge
root at 5-efi:~# mount -t hugetlbfs nodev /mnt/huge
root at 5-efi:~# dpdk-devbind.py -b vfio-pci 91:00.0
root at 5-efi:~# dpdk-devbind.py -b vfio-pci 91:00.1
root at 5-efi:~# dpdk-devbind.py -b vfio-pci 89:00.0
root at 5-efi:~# dpdk-devbind.py -b vfio-pci 89:00.1

LOG :
root at 5-efi:~# dpdk-testpmd -c 0xff -n 4 -a 89:00.0 -a 89:00.1 --socket-mem=256 -- -i --mbcache=512 --socket-num=0 --coremask=0xc --nb-cores=2 --rxq=1 --txq=1 --portmask=0xf --rxd=4096 --rxfreet=128 --rxpt=128 --rxht=8 --rxwt=0 --txd=4096 --txfreet=128 --txpt=128 --txht=0 --txwt=0 --burst=64 --txrst=64 --rss-ip -a
EAL: Detected CPU lcores: 24
EAL: Detected NUMA nodes: 1
EAL: Detected static linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: VFIO support initialized
EAL: Using IOMMU type 1 (Type 1)
EAL: Ignore mapping IO port bar(1)
EAL: Ignore mapping IO port bar(4)
EAL: Probe PCI driver: net_ice (8086:188a) device: 0000:89:00.0 (socket 0)
ice_dev_init(): Failed to read device serial number

ice_load_pkg_type(): Active package is: 1.3.35.0, ICE OS Default Package (double VLAN mode)
EAL: Ignore mapping IO port bar(1)
EAL: Ignore mapping IO port bar(4)
EAL: Probe PCI driver: net_ice (8086:188a) device: 0000:89:00.1 (socket 0)
ice_dev_init(): Failed to read device serial number

ice_load_pkg_type(): Active package is: 1.3.35.0, ICE OS Default Package (double VLAN mode)
TMTY: TELEMETRY: No legacy callbacks, legacy socket not created
Interactive-mode selected
previous number of forwarding cores 1 - changed to number of configured cores 2
Auto-start selected
testpmd: create a new mbuf pool <mb_pool_0>: n=262144, size=2176, socket=0
testpmd: preferred mempool ops selected: ring_mp_mc
Configuring Port 0 (socket 0)
ice_set_rx_function(): Using AVX2 Vector Rx (port 0).
Port 0: 00:00:00:00:01:00
Configuring Port 1 (socket 0)
ice_set_rx_function(): Using AVX2 Vector Rx (port 1).
Port 1: 00:00:00:00:01:01
Checking link statuses...
Done
Start automatic packet forwarding
io packet forwarding - ports=2 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 2 (socket 0) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 0) -> TX P=1/Q=0 (socket 0) peer=02:00:00:00:00:01
Logical Core 3 (socket 0) forwards packets on 1 streams:
  RX P=1/Q=0 (socket 0) -> TX P=0/Q=0 (socket 0) peer=02:00:00:00:00:00

  io packet forwarding packets/burst=64
  nb forwarding cores=2 - nb forwarding ports=2
  port 0: RX queue number: 1 Tx queue number: 1
    Rx offloads=0x0 Tx offloads=0x10000
    RX queue: 0
      RX desc=4096 - RX free threshold=128
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x0
    TX queue: 0
      TX desc=4096 - TX free threshold=128
      TX threshold registers: pthresh=128 hthresh=0  wthresh=0
      TX offloads=0x10000 - TX RS bit threshold=64
  port 1: RX queue number: 1 Tx queue number: 1
    Rx offloads=0x0 Tx offloads=0x10000
    RX queue: 0
      RX desc=4096 - RX free threshold=128
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x0
    TX queue: 0
      TX desc=4096 - TX free threshold=128
      TX threshold registers: pthresh=128 hthresh=0  wthresh=0
      TX offloads=0x10000 - TX RS bit threshold=64
testpmd>
testpmd> show port stats all

  ######################## NIC statistics for port 0  ########################
  RX-packets: 442827099  RX-missed: 0          RX-bytes:  26569625172
  RX-errors: 0
  RX-nombuf:  0
  TX-packets: 443292288  TX-errors: 0          TX-bytes:  26597536896

  Throughput (since last show)
  Rx-pps:     14390795          Rx-bps:   6907582048
  Tx-pps:     14405470          Tx-bps:   6914626456
  ############################################################################

  ######################## NIC statistics for port 1  ########################
  RX-packets: 443293641  RX-missed: 0          RX-bytes:  26597617500
  RX-errors: 0
 RX-nombuf:  0
  TX-packets: 442827661  TX-errors: 0          TX-bytes:  26569658892

  Throughput (since last show)
  Rx-pps:     14405477          Rx-bps:   6914629232
  Tx-pps:     14390795          Tx-bps:   6907581696
  ############################################################################
testpmd> show port summary all
Number of available ports: 2
Port MAC Address       Name         Driver         Status   Link
0    00:00:00:00:01:00 89:00.0      net_ice        down     None
1    00:00:00:00:01:01 89:00.1      net_ice        down     None
testpmd> show port stats all

  ######################## NIC statistics for port 0  ########################
  RX-packets: 2267795378 RX-missed: 0          RX-bytes:  136067721784
  RX-errors: 0
  RX-nombuf:  0
  TX-packets: 2270213831 TX-errors: 0          TX-bytes:  136212829092

  Throughput (since last show)
  Rx-pps:     14385293          Rx-bps:   6904940896
  Tx-pps:     14400690          Tx-bps:   6912331240
  ############################################################################

  ######################## NIC statistics for port 1  ########################
  RX-packets: 2270215290 RX-missed: 0          RX-bytes:  136212916568
  RX-errors: 0
  RX-nombuf:  0
  TX-packets: 2267796060 TX-errors: 0          TX-bytes:  136067762768

  Throughput (since last show)
  Rx-pps:     14400690          Rx-bps:   6912331344
  Tx-pps:     14385293          Tx-bps:   6904941024
  ############################################################################



Thanks!


Best Regards,
JackyCT.Chen
x86 Software | Cloud-IoT Group | Advantech Co., Ltd.
02-2792-7818 Ext. 1194

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mails.dpdk.org/archives/dev/attachments/20240131/aaa00c9b/attachment-0001.htm>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: log_202401231_DPDK_CRB_X710_E823_EXP11_INFO_dmesg.txt
URL: <http://mails.dpdk.org/archives/dev/attachments/20240131/aaa00c9b/attachment-0002.txt>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: log_202401231_DPDK_CRB_X710_E823_EXP11_B_E823_TESTPMD_DownDown.txt
URL: <http://mails.dpdk.org/archives/dev/attachments/20240131/aaa00c9b/attachment-0003.txt>


More information about the dev mailing list