<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body bgcolor="#FFFFFF">
Hi~<br>
<br>
I have a question about DPDK & QPI performance issue in Romley platform.<br>
Recently, I use DPDK example, l2fwd, to test DPDK's performance in my Romley platform.<br>
When I try to do the test, crossing used CPU, I find the performance dramatically decrease.<br>
Is it true? Or any method can prove the phenomenon?<br>
<br>
In my opinion, there should be no this kind of issue here due to QPI have enough bandwidth to deal the kinds of case.<br>
Thus, I am so amaze in our results and can not explain it.<br>
Could someone can help me to solve this problem.<br>
<br>
Thank a lot!<br>
<br>
<br>
My testing environment describe as below:<br>
<br>
Platform: Romley<br>
CPU: E5-2643 * 2<br>
RAM: Transcend <span lang="EN-US" style="font-size:10.5pt; font-family:SimSun; color:black">
<big>8GB PC3-1600 DDR3 * 8</big><br>
<big>OS: Fedora core 14</big><br>
<big>DPDK: v1.3.1r2, example/l2fwd<br>
Slot setting:<br>
SlotA is controled by CPU1 directly.</big></span><br>
<span lang="EN-US" style="font-size:10.5pt; font-family:SimSun; color:black"><big> SlotB is controled by CPU0 directly.<br>
<big><br>
</big></big></span><big><span lang="EN-US" style="font-size:10.5pt; font-family:SimSun; color:black"><span lang="EN-US" style="color:#009900">DPDK pre-setting:</span><span lang="EN-US"><br>
a. BIOS setting:<br>
HT=disable<br>
b. Kernel paramaters <br>
isolcpus=2,3,6,7<br>
default_hugepagesz=1024M<br>
hugepagesz=1024M<br>
hugepages=16<br>
c. OS setting:<br>
service avahi-daemon stop<br>
service NetworkManager stop<br>
service iptables stop<br>
service acpid stop<br>
selinux disable<br>
<br>
</span></span><br>
<span lang="EN-US" style="font-size:10.5pt; font-family:SimSun; color:black"><span lang="EN-US"><span lang="EN-US"><span style="color:#009900">Example program Command</span>:<br>
a. SlotB(CPU0) -> CPU1<br>
#>./l2fwd -c 0xc -n 4 -- -q 1 -p 0xc<br>
<br>
b. SlotA(CPU1) -> CPU0<br>
#>./l2fwd -c 0xc0 -n 4 -- -q 1 -p 0xc0</span></span> <br>
<br>
</span><span lang="EN-US" style="font-size:10.5pt; font-family:SimSun; color:black"><span lang="EN-US"><span lang="EN-US"><span style="color:#009900">Results</span>:</span></span></span><br>
<small>use frame size 128 bytes</small></big><br>
<table class="MsoNormalTable" border="0" cellpadding="0" cellspacing="0" style="margin-left:20.9pt; border-collapse:collapse">
<tbody>
<tr>
<td valign="top" width="207" style="width:124.0pt; border:solid windowtext
1.0pt; padding:0cm 5.4pt 0cm 5.4pt">
<p class="MsoNormal" style="text-align:justify; text-justify:inter-ideograph"><span style="font-family:"新細明體","serif"">CPU
</span><span lang="EN-US">Affinity</span></p>
</td>
<td valign="top" width="242" style="width:144.95pt; border:solid windowtext
1.0pt; border-left:none; padding:0cm 5.4pt 0cm 5.4pt">
<p class="MsoNormal" style="text-align:justify; text-justify:inter-ideograph"><span lang="EN-US" style="font-size:10.5pt; color:#002060">Slot A (CPU1)</span><span lang="EN-US"></span></p>
</td>
<td valign="top" width="242" style="width:144.95pt; border:solid windowtext
1.0pt; border-left:none; padding:0cm 5.4pt 0cm 5.4pt">
<p class="MsoNormal" style="text-align:justify; text-justify:inter-ideograph"><span lang="EN-US" style="font-size:10.5pt; color:#002060">Slot B (CPU0)</span><span lang="EN-US"></span></p>
</td>
</tr>
<tr>
<td valign="top" width="207" style="width:124.0pt; border:solid windowtext
1.0pt; border-top:none; padding:0cm 5.4pt 0cm 5.4pt">
<p class="MsoNormal" style="text-align:justify; text-justify:inter-ideograph"><span lang="EN-US" style="font-size:10.5pt; color:#002060">CPU0</span><span lang="EN-US"></span></p>
</td>
<td valign="top" width="242" style="width:144.95pt; border-top:none; border-left:none; border-bottom:solid
windowtext 1.0pt; border-right:solid windowtext
1.0pt; padding:0cm 5.4pt 0cm 5.4pt">
<p class="MsoNormal" style="text-align:justify; text-justify:inter-ideograph"><span lang="EN-US" style="font-size:10.5pt; color:#002060">15.9%</span><span lang="EN-US"></span></p>
</td>
<td valign="top" width="242" style="width:144.95pt; border-top:none; border-left:none; border-bottom:solid
windowtext 1.0pt; border-right:solid windowtext
1.0pt; padding:0cm 5.4pt 0cm 5.4pt">
<p class="MsoNormal" style="text-align:justify; text-justify:inter-ideograph"><span lang="EN-US" style="font-size:10.5pt; color:#002060">96.49%</span><span lang="EN-US"></span></p>
</td>
</tr>
<tr>
<td valign="top" width="207" style="width:124.0pt; border:solid windowtext
1.0pt; border-top:none; padding:0cm 5.4pt 0cm 5.4pt">
<p class="MsoNormal" style="text-align:justify; text-justify:inter-ideograph"><span lang="EN-US" style="font-size:10.5pt; color:#002060">CPU1</span><span lang="EN-US"></span></p>
</td>
<td valign="top" width="242" style="width:144.95pt; border-top:none; border-left:none; border-bottom:solid
windowtext 1.0pt; border-right:solid windowtext
1.0pt; padding:0cm 5.4pt 0cm 5.4pt">
<p class="MsoNormal" style="text-align:justify; text-justify:inter-ideograph"><span lang="EN-US" style="font-size:10.5pt; color:#002060">90.88%</span><span lang="EN-US"></span></p>
</td>
<td valign="top" width="242" style="width:144.95pt; border-top:none; border-left:none; border-bottom:solid
windowtext 1.0pt; border-right:solid windowtext
1.0pt; padding:0cm 5.4pt 0cm 5.4pt">
<p class="MsoNormal" style="text-align:justify; text-justify:inter-ideograph"><span lang="EN-US" style="font-size:10.5pt; color:#002060">24.78%</span><span lang="EN-US"></span></p>
</td>
</tr>
</tbody>
</table>
<br>
<br>
本信件可能包含瑞祺電通機密資訊，非指定之收件者，請勿使用或揭露本信件內容，並請銷毀此信件。 This email may contain confidential information. Please do not use or disclose it in any way and delete it if you are not the intended recipient.
</body>
</html>