[dpdk-dev] testpmd: not seeing any traffic on 1g (pair) or 10g pair

[Zhang, Jerry]

Hi,

Make sure to add iommu=pt inte_iommu=on to kernel parameters if VT-d is enabled. 
Otherwise, the PF may not work well with igb_uio because of DMAR.

Please also refer to the comments in the DPDK getting started guide.

In addition, to run the Intel® DPDK with Intel® VT-d, the iommu=pt kernel parameter 
must be used when using igb_uio driver. This results in pass-through of the DMAR 
(DMA Remapping) lookup in the host. Also, if INTEL_IOMMU_DEFAULT_ON is not set 
in the kernel, the intel_iommu=on kernel parameter must be used too. This ensures 
that the Intel IOMMU is being initialized as expected.

-----Original Message-----
From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of Zhou, Danny
Sent: Tuesday, August 26, 2014 1:58 AM
To: Al Patel; Jayakumar, Muthurajan
Cc: dev at dpdk.org
Subject: Re: [dpdk-dev] testpmd: not seeing any traffic on 1g (pair) or 10g pair

The .log below shows your two 10G ports link are up. 

Which CPU are you using now and how many processor sockets do you have? If you used a platform with two processor sockets, make sure to use correct core mask to specify cores rx/tx packets from 10G NIC connecting to local socket. For you case, make sure 10G NIC with BNF 0e:00.0/0e:00.1 connects to CPU socket No.0(as you used -c 0xF to use core 0 to 3 on socket No.0), otherwise you have to change the core mask in the command line to use logical cores on socket No.1.

> -----Original Message-----
> From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of Al Patel
> Sent: Tuesday, August 26, 2014 12:36 AM
> To: Jayakumar, Muthurajan
> Cc: dev at dpdk.org
> Subject: Re: [dpdk-dev] testpmd: not seeing any traffic on 1g (pair) 
> or 10g pair
> 
> HI Jayakumar,
> 
> I did. I don' that unbind script in my version (I am using 1.6) 
> root at fe-ucs48:~/dpdk-1.6.0r1# ./tools/pci_unbind.py --status
> 
> Network devices using IGB_UIO driver
> ====================================
> 0000:0e:00.0 '82599EB 10-Gigabit SFI/SFP+ Network Connection' 
> drv=igb_uio unused=ixgbe
> 0000:0e:00.1 '82599EB 10-Gigabit SFI/SFP+ Network Connection' 
> drv=igb_uio unused=ixgbe
> 
> Network devices using kernel driver
> ===================================
> 0000:08:00.0 '82576 Gigabit Network Connection' if=eth2 drv=igb 
> unused=igb_uio
> 0000:08:00.1 '82576 Gigabit Network Connection' if=eth3 drv=igb 
> unused=igb_uio
> 0000:14:00.0 '82576 Gigabit Network Connection' if=eth4 drv=igb 
> unused=igb_uio *Active*
> 0000:14:00.1 '82576 Gigabit Network Connection' if=eth6 drv=igb 
> unused=igb_uio
> 
> Other network devices
> =====================
> 0000:05:00.0 '82576 Gigabit Network Connection' unused=igb,igb_uio
> 0000:05:00.1 '82576 Gigabit Network Connection' unused=igb,igb_uio
> 
> 
> ...
> Checking link statuses...
> Port 0 Link Up - speed 10000 Mbps - full-duplex Port 1 Link Up - speed 
> 10000 Mbps - full-duplex Done
> testpmd> show port stats all
> 
>   ######################## NIC statistics for port 0  
> ########################
>   RX-packets: 0          RX-errors: 0         RX-bytes: 0
>   TX-packets: 0          TX-errors: 0         TX-bytes: 0
> 
> ######################################################################
> ######
> 
>   ######################## NIC statistics for port 1  
> ########################
>   RX-packets: 0          RX-errors: 0         RX-bytes: 0
>   TX-packets: 0          TX-errors: 0         TX-bytes: 0
> 
> ######################################################################
> ######
> testpmd>
> 
> 
> testpmd> start tx_first
>   io packet forwarding - CRC stripping disabled - packets/burst=16
>   nb forwarding cores=2 - nb forwarding ports=2
>   RX queues=1 - RX desc=128 - RX free threshold=0
>   RX threshold registers: pthresh=8 hthresh=8 wthresh=4
>   TX queues=1 - TX desc=512 - TX free threshold=0
>   TX threshold registers: pthresh=36 hthresh=0 wthresh=0
>   TX RS bit threshold=0 - TXQ flags=0x0
> testpmd>
> 
> 
> waited for a few seconds ...
> 
> testpmd> stop
> Telling cores to stop...
> Waiting for lcores to finish...
> 
>   ---------------------- Forward statistics for port 0
>  ----------------------
>   RX-packets: 0              RX-dropped: 0             RX-total: 0
>   TX-packets: 0              TX-dropped: 0             TX-total: 0
> 
> ----------------------------------------------------------------------
> ------
> 
>   ---------------------- Forward statistics for port 1
>  ----------------------
>   RX-packets: 0              RX-dropped: 0             RX-total: 0
>   TX-packets: 0              TX-dropped: 0             TX-total: 0
> 
> ----------------------------------------------------------------------
> ------
> 
>   +++++++++++++++ Accumulated forward statistics for all
> ports+++++++++++++++
>   RX-packets: 0              RX-dropped: 0             RX-total: 0
>   TX-packets: 0              TX-dropped: 0             TX-total: 0
> 
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> 
> Done.
> testpmd>
> 
> 
> Looks like nothing is being sent/received.
> 
> Thanks
> -a
> 
> On Mon, Aug 25, 2014 at 12:30 PM, Jayakumar, Muthurajan < 
> muthurajan.jayakumar at intel.com> wrote:
> 
> > Can you please do the following steps as in Quick start guide 
> > http://dpdk.org/doc/quick-start Thanks,
> >
> > Extract sources.
> > tar xf dpdk.tar.gz
> > cd dpdk
> > Build libraries and kernel module (Linux headers are needed).
> > make config T=x86_64-native-linuxapp-gcc make The next steps must be 
> > done as root.
> > Load kernel modules.
> > modprobe uio
> > insmod build/kmod/igb_uio.ko
> > Bind Intel devices to igb_uio.
> > tools/dpdk_nic_bind.py --bind=igb_uio $(tools/dpdk_nic_bind.py 
> > --status | sed -rn 's,.* if=([^ ]*).*igb_uio *$,\1,p') Reserve huge 
> > pages memory.
> > mkdir -p /mnt/huge
> > mount -t hugetlbfs nodev /mnt/huge
> > echo 64 >
> > /sys/devices/system/node/node0/hugepages/hugepages-2048kB/nr_hugepag
> > es
> > Set the highest frequency.
> > for gov in /sys/devices/system/cpu/*/cpufreq/scaling_governor ; do 
> > echo performance >$gov ; done Run poll-mode driver test (with a 
> > cable between ports).
> > build/app/testpmd -c7 -n3 -- -i --nb-cores=2 --nb-ports=2
> >
> > testpmd> show port stats all
> >
> >   ######################## NIC statistics for port 0 
> > ########################
> >   RX-packets: 0          RX-errors: 0         RX-bytes: 0
> >   TX-packets: 0          TX-errors: 0         TX-bytes: 0
> >
> > ####################################################################
> > ########
> >
> >   ######################## NIC statistics for port 1 
> > ########################
> >   RX-packets: 0          RX-errors: 0         RX-bytes: 0
> >   TX-packets: 0          TX-errors: 0         TX-bytes: 0
> >
> > ####################################################################
> > ########
> >
> > testpmd> start tx_first
> >
> > testpmd> stop
> >
> >   ---------------------- Forward statistics for port 0
> > ----------------------
> >   RX-packets: 7139974        RX-dropped: 0             RX-total: 7139974
> >   TX-packets: 6699967        TX-dropped: 0             TX-total: 6699967
> >
> > --------------------------------------------------------------------
> > --------
> >
> >   ---------------------- Forward statistics for port 1
> > ----------------------
> >   RX-packets: 6699967        RX-dropped: 0             RX-total: 6699967
> >   TX-packets: 7139974        TX-dropped: 0             TX-total: 7139974
> >
> > --------------------------------------------------------------------
> > --------
> >
> > -----Original Message-----
> > From: dev [mailto:dev-bounces at dpdk.org] On Behalf Of Al Patel
> > Sent: Monday, August 25, 2014 9:20 AM
> > To: dev at dpdk.org
> > Subject: [dpdk-dev] testpmd: not seeing any traffic on 1g (pair) or 
> > 10g pair
> >
> > Hi,
> >
> > I am doing a basic test with testpmd per the getting started page.
> > I connected two 1g in back to back mode and executed:
> >
> >  sudo ./build/app/testpmd -c 0xF -n 4 -- -i --portmask=0x2 
> > --nb-cores=2
> >
> > start (and start tx_first)
> > stop
> >
> > I see 0 counters for rx/tx.
> >
> > I removed the two 1g from uio driver and added two 10g 82599EB and 
> > reran the test - still 0 traffic.
> >
> > Wondering where to debug.
> > thx
> >