[dts] low pass rate executing dts complete test suite

M R, Chengappa (Network Function Virtualization) cm-r at hpe.com
Fri Jun 1 12:16:17 CEST 2018
Previous message: [dts] [PATCH] tests/unit_tests_dump: fix dump info unmatched
Next message: [dts] low pass rate executing dts complete test suite
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
Dear All,

I am back with some more findings on executing DTS on Intel environment and this time around the pass rate is somewhat around 26.5%

I was able to achieve this pass rate by the recommendations provided by Xu GangX!

However, I am still puzzled as to why I am not having a good pass rate even for Intel NICs

It would be of great help if anyone from the community help me achieve good numbers.

Am sharing the output file (attached to with this mail) for reference.

Also I would be interested to know if anyone has achieved 100% pass rate for DTS on INTEL NIC , if so I would like to have a look at the configuration files used for the same and also would like to know the DTS and DPDK versions and Intel NIC type used to achieve 100% pass rate.

Furthermore, am also sharing the screen shot for of the NIC information configured on TESTER and DUT from the iLO GUI

TESTER
[cid:image006.png at 01D3F9BF.850BF720]




DUT
[cid:image005.png at 01D3F9BF.1C718DB0]


Thanking in advance.
Chengappa

From: Tu, Lijuan [mailto:lijuan.tu at intel.com]
Sent: Tuesday, May 22, 2018 12:27 PM
To: M R, Chengappa (Network Function Virtualization) <cm-r at hpe.com>; Xu, GangX <gangx.xu at intel.com>; dts at dpdk.org
Subject: RE: low pass rate executing dts complete test suite

Hi Chengappa
answers in-line.

From: dts [mailto:dts-bounces at dpdk.org] On Behalf Of M R, Chengappa (Network Function Virtualization)
Sent: Tuesday, May 22, 2018 10:57 AM
To: Xu, GangX <gangx.xu at intel.com<mailto:gangx.xu at intel.com>>; dts at dpdk.org<mailto:dts at dpdk.org>
Subject: Re: [dts] low pass rate executing dts complete test suite

Greetings Xu,

Yes seems like I have had used only one port - let me re-run by making the necessary changes in ports.cfg and get back with the observations.

@ Lijuan Tu,

Please find the answers in-line.

Thanks & Regards,
Chengappa

From: Xu, GangX [mailto:gangx.xu at intel.com]
Sent: Tuesday, May 22, 2018 7:12 AM
To: M R, Chengappa (Network Function Virtualization) <cm-r at hpe.com<mailto:cm-r at hpe.com>>; dts at dpdk.org<mailto:dts at dpdk.org>
Subject: RE: low pass rate executing dts complete test suite

Hi Chengappa:
How many ports do you use?
In the information you provided, I think you used only one port.
Many of the case in dts need two ports or more.
e.g. test suite pmd_bonded need 4 ports, you provide 1, it failed at set_up_all show "blocked set_up_all failed" issue.

Xu gang


From: dts [mailto:dts-bounces at dpdk.org] On Behalf Of Tu, Lijuan
Sent: Monday, May 21, 2018 9:49 PM
To: M R, Chengappa (Network Function Virtualization) <cm-r at hpe.com<mailto:cm-r at hpe.com>>; dts at dpdk.org<mailto:dts at dpdk.org>
Subject: Re: [dts] low pass rate executing dts complete test suite

Hi chengappa,
         Here are my points:
1, the link might have some issues, such as link down
         From the result "receive 0 , expect 64", I think , the link is down
         You can check your link first before running dts.
          [Chengappa] sure, will check on this, thank you for the inputs.

2, DPDK will change during different version , so DTS will change with it.
         Which DPDK and DTS 's version do you use?
         From the failed result "set up failed" and timeout , I think your testpmd started failed.
         Logs in output, you can check them to find the real reason, maybe testpmd's parameters changed.
          [Chengappa]
Am using DPDK 18.02 with DTS 17.08.0, kindly let me know if there are any issues with the combination am using or version mismatch here?
With the log traces I was able to see that the testpmd failed to start - is there anything that I need to tweak to change the testpmd's parameters to be changed?
         [Lijuan]
I think using DTS 18.02 is the best choices , As I know , there are some changes in offloads, vlan filter/strip default value, crc-strip , promise mode etc.
             You can check them form git logs.

From: dts [mailto:dts-bounces at dpdk.org] On Behalf Of M R, Chengappa (Network Function Virtualization)
Sent: Monday, May 21, 2018 7:28 PM
To: dts at dpdk.org<mailto:dts at dpdk.org>
Subject: [dts] low pass rate executing dts complete test suite

Hello DTS community,

As we were investigation on DTS for Niantic (Intel Corporation 82599ES 10-Gigabit) platform and we are seeing very less pass rate.

We were under the assumption if we take care of the initial pre-requisites for TESTER and TARGET DUT as described here - https://dpdk.org/doc/dts/gsg/sys_reqs.html the DTS framework help us achieve a good pass rate.

Could you please help me by letting know if there are any fine tuning for the TARGET DUT so that I can see a better numbers than the current pass rate of 12.4%

[root at tester dts]# cat output/statistics.txt
Passed     = 17
Failed     = 45
Blocked    = 68
Pass rate  = 12.4



Some of the specification on the TARGET DUT and current running configuration are as follows


[root at targetdut ~]# lspci | egrep -i --color 'network|ethernet'
04:00.0 Ethernet controller: Emulex Corporation OneConnect NIC (Skyhawk) (rev 10)
04:00.1 Ethernet controller: Emulex Corporation OneConnect NIC (Skyhawk) (rev 10)
05:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
05:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)




[root at tester dts]# cat conf/ports.cfg
# DUT Port Configuration
# [DUT IP]
# ports=
#     pci=Pci BDF,intf=Kernel interface;
#     pci=Pci BDF,mac=Mac address,peer=Tester Pci BDF,numa=Port Numa
#     pci=Pci BDF,peer=IXIA:card.port
#     pci=Pci BDF,peer=Tester Pci BDF,tp_ip=$(IP),tp_path=$({PERL_PATH);
#     pci=Pci BDF,peer=Tester Pci BDF,sec_port=yes,first_port=Pci BDF;
# [VM NAME] virtual machine name; This section is for virutal scenario
# ports =
#     dev_idx=device index of ports info, peer=Tester Pci BDF
[10.70.2.6]
ports =
    pci=05:00.0,intf=ens2f0;
    pci=05:00.1,intf=ens2f1;



[root at tester dts]# cat executions/execution.cfg
[Execution1]
crbs=10.70.2.6
drivername=igb_uio
test_suites=hello_world
test_suites=
    cmdline,
    hello_world
targets=x86_64-native-linuxapp-gcc
parameters=nic_type=niantic:func=true



[root at tester dts]# cat conf/crbs.cfg
#DUT crbs Configuration
#[DUT IP]
#  dut_ip: DUT ip address
#  dut_user: Login DUT username
#  dut_passwd: Login DUT password
#  os: operation system type linux or freebsd
#  tester_ip: Tester ip address
#  tester_passwd: Tester password
#  ixia_group: IXIA group name
#  channels: Board channel number
#  bypass_core0: Whether by pass core0
[10.70.2.6]
dut_ip=10.70.2.6
dut_user=root
dut_passwd=HP1nvent
os=linux
tester_ip=10.70.2.5
tester_passwd=HP1nvent
channels=4


Snippet of the current results

[cid:image001.png at 01D3F9B9.EF825B40]
[cid:image002.png at 01D3F9B9.EF825B40]
[cid:image003.png at 01D3F9B9.EF825B40]
[cid:image004.png at 01D3F9B9.EF825B40]

Thanking in advance,
Chengappa

If everyone is moving forward together, then success takes care of itself....!!
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://dpdk.org/ml/archives/dts/attachments/20180601/0179c3a2/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 75429 bytes
Desc: image001.png
URL: <http://dpdk.org/ml/archives/dts/attachments/20180601/0179c3a2/attachment-0006.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 90260 bytes
Desc: image002.png
URL: <http://dpdk.org/ml/archives/dts/attachments/20180601/0179c3a2/attachment-0007.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 94096 bytes
Desc: image003.png
URL: <http://dpdk.org/ml/archives/dts/attachments/20180601/0179c3a2/attachment-0008.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image004.png
Type: image/png
Size: 85027 bytes
Desc: image004.png
URL: <http://dpdk.org/ml/archives/dts/attachments/20180601/0179c3a2/attachment-0009.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image005.png
Type: image/png
Size: 75529 bytes
Desc: image005.png
URL: <http://dpdk.org/ml/archives/dts/attachments/20180601/0179c3a2/attachment-0010.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image006.png
Type: image/png
Size: 70397 bytes
Desc: image006.png
URL: <http://dpdk.org/ml/archives/dts/attachments/20180601/0179c3a2/attachment-0011.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: output_31052018.zip
Type: application/x-zip-compressed
Size: 2797640 bytes
Desc: output_31052018.zip
URL: <http://dpdk.org/ml/archives/dts/attachments/20180601/0179c3a2/attachment-0001.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: crbs.cfg
Type: application/octet-stream
Size: 468 bytes
Desc: crbs.cfg
URL: <http://dpdk.org/ml/archives/dts/attachments/20180601/0179c3a2/attachment-0003.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: execution.cfg
Type: application/octet-stream
Size: 479 bytes
Desc: execution.cfg
URL: <http://dpdk.org/ml/archives/dts/attachments/20180601/0179c3a2/attachment-0004.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ports.cfg
Type: application/octet-stream
Size: 652 bytes
Desc: ports.cfg
URL: <http://dpdk.org/ml/archives/dts/attachments/20180601/0179c3a2/attachment-0005.obj>
Previous message: [dts] [PATCH] tests/unit_tests_dump: fix dump info unmatched
Next message: [dts] low pass rate executing dts complete test suite
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ]
More information about the dts mailing list