[dts] [PATCH v1] test_plans: add virtio pvp test for performance track

[Tu, Lijuan]

applied

> -----Original Message-----
> From: dts [mailto:dts-bounces at dpdk.org] On Behalf Of Yinan
> Sent: Monday, January 13, 2020 3:03 AM
> To: dts at dpdk.org
> Cc: Wang, Yinan <yinan.wang at intel.com>
> Subject: [dts] [PATCH v1] test_plans: add virtio pvp test for performance
> track
> 
> From: Wang Yinan <yinan.wang at intel.com>
> 
> add vhost/virtio pvp packed ring inorder path test for performance track
> 
> Signed-off-by: Wang Yinan <yinan.wang at intel.com>
> ---
>  .../pvp_multi_paths_performance_test_plan.rst | 69 ++++++++++++++++---
>   ...host_single_core_performance_test_plan.rst | 68 ++++++++++++++----
>   ...rtio_single_core_performance_test_plan.rst | 68 +++++++++++++++---
>  3 files changed, 173 insertions(+), 32 deletions(-)
> 
> diff --git a/test_plans/pvp_multi_paths_performance_test_plan.rst
> b/test_plans/pvp_multi_paths_performance_test_plan.rst
> index 477c68d..9da51ba 100644
> --- a/test_plans/pvp_multi_paths_performance_test_plan.rst
> +++ b/test_plans/pvp_multi_paths_performance_test_plan.rst
> @@ -34,9 +34,10 @@
>  vhost/virtio pvp multi-paths performance test plan
> ==================================================
> 
> -Benchmark pvp multi-paths performance with 7 tx/rx paths.
> -Includes mergeable, normal, vector_rx, inorder mergeable, -inorder no-
> mergeable, virtio 1.1 mergeable, virtio 1.1 normal path.
> +Benchmark PVP multi-paths performance with 9 tx/rx paths.
> +Includes mergeable, non-mergeable, vector_rx, inorder mergeable,
> +inorder non-mergeable, virtio 1.1 mergeable, virtio 1.1 non-mergeable，
> +virtio 1.1 inorder mergeable, virtio 1.1 inorder non-mergeable path.
>  Give 1 core for vhost and virtio respectively.
> 
>  Test flow
> @@ -69,8 +70,8 @@ Test Case 1: pvp test with virtio 1.1 mergeable path
> 
>      testpmd>show port stats all
> 
> -Test Case 2: pvp test with virtio 1.1 normal path -
> =================================================
> +Test Case 2: pvp test with virtio 1.1 non-mergeable path
> +========================================================
> 
>  1. Bind one port to igb_uio, then launch vhost by below command::
> 
> @@ -119,8 +120,8 @@ Test Case 3: pvp test with inorder mergeable path
> 
>      testpmd>show port stats all
> 
> -Test Case 4: pvp test with inorder no-mergeable path -
> ====================================================
> +Test Case 4: pvp test with inorder non-mergeable path
> +=====================================================
> 
>  1. Bind one port to igb_uio, then launch vhost by below command::
> 
> @@ -169,8 +170,8 @@ Test Case 5: pvp test with mergeable path
> 
>      testpmd>show port stats all
> 
> -Test Case 6: pvp test with normal path
> -======================================
> +Test Case 6: pvp test with non-mergeable path
> +=============================================
> 
>  1. Bind one port to igb_uio, then launch vhost by below command::
> 
> @@ -215,6 +216,56 @@ Test Case 7: pvp test with vector_rx path
>      >set fwd mac
>      >start
> 
> +3. Send packet with packet generator with different packet size,includes [64,
> 128, 256, 512, 1024, 1518], check the throughput with below command::
> +
> +    testpmd>show port stats all
> +
> +Test Case 8: pvp test with virtio 1.1 inorder mergeable path
> +============================================================
> +
> +1. Bind one port to igb_uio, then launch vhost by below command::
> +
> +    rm -rf vhost-net*
> +    ./testpmd -n 4 -l 2-3  --socket-mem 1024,1024 --legacy-mem \
> +    --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0'
> \
> +    -- -i --nb-cores=1 --txd=1024 --rxd=1024
> +    testpmd>set fwd mac
> +    testpmd>start
> +
> +2. Launch virtio-user by below command::
> +
> +    ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \
> +    --legacy-mem --no-pci --file-prefix=virtio \
> +    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,packed_vq=1,mrg_rxbuf=1,in_order=1 \
> +    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --nb-cores=1 --txd=1024 --
> rxd=1024
> +    >set fwd mac
> +    >start
> +
> +3. Send packet with packet generator with different packet size,includes [64,
> 128, 256, 512, 1024, 1518], check the throughput with below command::
> +
> +    testpmd>show port stats all
> +
> +Test Case 9: pvp test with virtio 1.1 inorder non-mergeable path
> +===============================================================
> =
> +
> +1. Bind one port to igb_uio, then launch vhost by below command::
> +
> +    rm -rf vhost-net*
> +    ./testpmd -n 4 -l 2-3  --socket-mem 1024,1024 --legacy-mem \
> +    --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0'
> \
> +    -- -i --nb-cores=1 --txd=1024 --rxd=1024
> +    testpmd>set fwd mac
> +    testpmd>start
> +
> +2. Launch virtio-user by below command::
> +
> +    ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \
> +    --legacy-mem --no-pci --file-prefix=virtio \
> +    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,packed_vq=1,mrg_rxbuf=0,in_order=1 \
> +    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --nb-cores=1 --txd=1024 --
> rxd=1024
> +    >set fwd mac
> +    >start
> +
>  3. Send packet with packet generator with different packet size,includes [64,
> 128, 256, 512, 1024, 1518], check the throughput with below command::
> 
>      testpmd>show port stats all
> \ No newline at end of file
> diff --git
> a/test_plans/pvp_multi_paths_vhost_single_core_performance_test_plan.rs
> t
> b/test_plans/pvp_multi_paths_vhost_single_core_performance_test_plan.rs
> t
> index e4d369f..92c0d60 100644
> ---
> a/test_plans/pvp_multi_paths_vhost_single_core_performance_test_plan.rs
> t
> +++
> b/test_plans/pvp_multi_paths_vhost_single_core_performance_test_plan
> +++ .rst
> @@ -34,10 +34,12 @@
>  vhost/virtio pvp multi-paths vhost single core test plan
> ========================================================
> 
> -Benchmark PVP vhost single core performance with 7 tx/rx paths.
> -Includes mergeable, normal, vector_rx, inorder mergeable, -inorder no-
> mergeable, virtio 1.1 mergeable, virtio 1.1 normal path.
> -Give 2 cores for virtio and 1 core for vhost, set io fwd at virtio side to lower
> the virtio workload.
> +Benchmark PVP vhost single core performance with 9 tx/rx paths.
> +Includes mergeable, non-mergeable, vector_rx, inorder mergeable,
> +inorder non-mergeable, virtio 1.1 mergeable, virtio 1.1 non-mergeable，
> +virtio 1.1 inorder mergeable, virtio 1.1 inorder non-mergeable path.
> +Give 2 cores for virtio and 1 core for vhost, set io fwd at virtio side
> +to lower the virtio workload.
> 
>  Test flow
>  =========
> @@ -58,15 +60,15 @@ Test Case 1: vhost single core performance test with
> virtio 1.1 mergeable path  2. Launch virtio-user by below command::
> 
>      ./testpmd -l 7-9 -n 4  --socket-mem 1024,1024 --legacy-mem --file-
> prefix=virtio \
> -    --vdev=virtio_user0,mac=00:11:22:33:44:10,path=./vhost-
> net,queues=1,packed_vq=1,mrg_rxbuf=1 \
> +
> + --vdev=virtio_user0,mac=00:11:22:33:44:10,path=./vhost-net,queues=1,pa
> + cked_vq=1,mrg_rxbuf=1,in_order=0 \
>      -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --
> txd=1024 --rxd=1024
>      >set fwd io
>      >start
> 
>  3. Send packet with packet generator with different packet size, check the
> throughput.
> 
> -Test Case 2: vhost single core performance test with virtio 1.1 normal path -
> ================================================================
> ===========
> +Test Case 2: vhost single core performance test with virtio 1.1
> +non-mergeable path
> +===============================================================
> ========
> +===========
> 
>  1. Bind one port to igb_uio, then launch vhost by below command::
> 
> @@ -79,7 +81,7 @@ Test Case 2: vhost single core performance test with
> virtio 1.1 normal path  2. Launch virtio-user by below command::
> 
>      ./testpmd -l 7-9 -n 4  --socket-mem 1024,1024 --legacy-mem --file-
> prefix=virtio \
> -    --vdev=virtio_user0,mac=00:11:22:33:44:10,path=./vhost-
> net,queues=1,packed_vq=1,mrg_rxbuf=0 \
> +
> + --vdev=virtio_user0,mac=00:11:22:33:44:10,path=./vhost-net,queues=1,pa
> + cked_vq=1,mrg_rxbuf=0,in_order=0 \
>      -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --
> txd=1024 --rxd=1024
>      >set fwd io
>      >start
> @@ -107,8 +109,8 @@ Test Case 3: vhost single core performance test with
> inorder mergeable path
> 
>  3. Send packet with packet generator with different packet size, check the
> throughput.
> 
> -Test Case 4: vhost single core performance test with inorder no-mergeable
> path -
> ================================================================
> ==============
> +Test Case 4: vhost single core performance test with inorder
> +non-mergeable path
> +===============================================================
> ========
> +========
> 
>  1. Bind one port to igb_uio, then launch vhost by below command::
> 
> @@ -149,8 +151,8 @@ Test Case 5: vhost single core performance test with
> mergeable path
> 
>  3. Send packet with packet generator with different packet size, check the
> throughput.
> 
> -Test Case 6: vhost single core performance test with normal path -
> ================================================================
> +Test Case 6: vhost single core performance test with non-mergeable path
> +===============================================================
> ========
> 
>  1. Bind one port to igb_uio, then launch vhost by below command::
> 
> @@ -189,4 +191,46 @@ Test Case 7: vhost single core performance test with
> vector_rx path
>      >set fwd io
>      >start
> 
> +3. Send packet with packet generator with different packet size, check the
> throughput.
> +
> +Test Case 8: vhost single core performance test with virtio 1.1 inorder
> +mergeable path
> +===============================================================
> ========
> +===============
> +
> +1. Bind one port to igb_uio, then launch vhost by below command::
> +
> +    rm -rf vhost-net*
> +    ./testpmd -l 3-4 -n 4 --socket-mem 1024,1024 --legacy-mem --no-pci --file-
> prefix=vhost \
> +    --vdev 'net_vhost0,iface=vhost-net,queues=1' -- -i --nb-cores=1 --
> txd=1024 --rxd=1024
> +    testpmd>set fwd mac
> +    testpmd>start
> +
> +2. Launch virtio-user by below command::
> +
> +    ./testpmd -l 7-9 -n 4  --socket-mem 1024,1024 --legacy-mem --file-
> prefix=virtio \
> +    --vdev=virtio_user0,mac=00:11:22:33:44:10,path=./vhost-
> net,queues=1,packed_vq=1,mrg_rxbuf=1,in_order=1 \
> +    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --
> txd=1024 --rxd=1024
> +    >set fwd io
> +    >start
> +
> +3. Send packet with packet generator with different packet size, check the
> throughput.
> +
> +Test Case 9: vhost single core performance test with virtio 1.1 inorder
> +non-mergeable path
> +===============================================================
> ========
> +===================
> +
> +1. Bind one port to igb_uio, then launch vhost by below command::
> +
> +    rm -rf vhost-net*
> +    ./testpmd -l 3-4 -n 4 --socket-mem 1024,1024 --legacy-mem --no-pci --file-
> prefix=vhost \
> +    --vdev 'net_vhost0,iface=vhost-net,queues=1' -- -i --nb-cores=1 --
> txd=1024 --rxd=1024
> +    testpmd>set fwd mac
> +    testpmd>start
> +
> +2. Launch virtio-user by below command::
> +
> +    ./testpmd -l 7-9 -n 4  --socket-mem 1024,1024 --legacy-mem --file-
> prefix=virtio \
> +    --vdev=virtio_user0,mac=00:11:22:33:44:10,path=./vhost-
> net,queues=1,packed_vq=1,mrg_rxbuf=0,in_order=1 \
> +    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --
> txd=1024 --rxd=1024
> +    >set fwd io
> +    >start
> +
>  3. Send packet with packet generator with different packet size, check the
> throughput.
> \ No newline at end of file
> diff --git
> a/test_plans/pvp_multi_paths_virtio_single_core_performance_test_plan.rst
> b/test_plans/pvp_multi_paths_virtio_single_core_performance_test_plan.rs
> t
> index e4394b6..990c18a 100644
> ---
> a/test_plans/pvp_multi_paths_virtio_single_core_performance_test_plan.rst
> +++ b/test_plans/pvp_multi_paths_virtio_single_core_performance_test_pla
> +++ n.rst
> @@ -34,10 +34,12 @@
>  vhost/virtio pvp multi-paths virtio single core test plan
> =========================================================
> 
> -Benchmark pvp virtio single core performance with 7 tx/rx paths.
> -Includes mergeable, normal, vector_rx, inorder mergeable, -inorder no-
> mergeable, virtio 1.1 mergeable, virtio 1.1 normal path.
> -Give 2 cores for vhost and 1 core for virtio, set io fwd at vhost side to lower
> the vhost workload.
> +Benchmark pvp virtio single core performance with 9 tx/rx paths.
> +Includes mergeable, non-mergeable, vector_rx, inorder mergeable,
> +inorder non-mergeable, virtio 1.1 mergeable, virtio 1.1 non-mergeable，
> +virtio 1.1 inorder mergeable, virtio 1.1 inorder non-mergeable path.
> +Give 2 cores for vhost and 1 core for virtio, set io fwd at vhost side
> +to lower the vhost workload.
> 
>  Test flow
>  =========
> @@ -66,8 +68,8 @@ Test Case 1: virtio single core performance test with
> virtio 1.1 mergeable path
> 
>  3. Send packet with packet generator with different packet size, check the
> throughput.
> 
> -Test Case 2: virtio single core performance test with virtio 1.1 normal path -
> ================================================================
> ============
> +Test Case 2: virtio single core performance test with virtio 1.1
> +non-mergeable path
> +===============================================================
> ========
> +============
> 
>  1. Bind one port to igb_uio, then launch vhost by below command::
> 
> @@ -103,15 +105,15 @@ Test Case 3: virtio single core performance test
> with inorder mergeable path
> 
>      ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \
>      --legacy-mem --no-pci --file-prefix=virtio \
> -    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,in_order=1 \
> +
> + --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,in_orde
> + r=1,mrg_rxbuf=1 \
>      -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=1 --
> txd=1024 --rxd=1024
>      >set fwd mac
>      >start
> 
>  3. Send packet with packet generator with different packet size, check the
> throughput.
> 
> -Test Case 4: virtio single core performance test with inorder no-mergeable
> path -
> ================================================================
> ===============
> +Test Case 4: virtio single core performance test with inorder
> +non-mergeable path
> +===============================================================
> ========
> +=========
> 
>  1. Bind one port to igb_uio, then launch vhost by below command::
> 
> @@ -154,8 +156,8 @@ Test Case 5: virtio single core performance test with
> mergeable path
> 
>  3. Send packet with packet generator with different packet size, check the
> throughput.
> 
> -Test Case 6: virtio single core performance test with normal path -
> ================================================================
> =
> +Test Case 6: virtio single core performance test with non-mergeable
> +path
> +===============================================================
> ========
> +=
> 
>  1. Bind one port to igb_uio, then launch vhost by below command::
> 
> @@ -196,4 +198,48 @@ Test Case 7: virtio single core performance test with
> vector_rx path
>      >set fwd mac
>      >start
> 
> +3. Send packet with packet generator with different packet size, check the
> throughput.
> +
> +Test Case 8: virtio single core performance test with virtio 1.1
> +inorder mergeable path
> +===============================================================
> ========
> +================
> +
> +1. Bind one port to igb_uio, then launch vhost by below command::
> +
> +    rm -rf vhost-net*
> +    ./testpmd -n 4 -l 2-4  --socket-mem 1024,1024 --legacy-mem \
> +    --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' -
> - -i --nb-cores=2 --txd=1024 --rxd=1024
> +    testpmd>set fwd io
> +    testpmd>start
> +
> +2. Launch virtio-user by below command::
> +
> +    ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \
> +    --legacy-mem --no-pci --file-prefix=virtio \
> +    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,packed_vq=1,mrg_rxbuf=1,in_order=1 \
> +    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=1 --
> txd=1024 --rxd=1024
> +    >set fwd mac
> +    >start
> +
> +3. Send packet with packet generator with different packet size, check the
> throughput.
> +
> +Test Case 9: virtio single core performance test with virtio 1.1
> +inorder non-mergeable path
> +===============================================================
> ========
> +====================
> +
> +1. Bind one port to igb_uio, then launch vhost by below command::
> +
> +    rm -rf vhost-net*
> +    ./testpmd -n 4 -l 2-4  --socket-mem 1024,1024 --legacy-mem \
> +    --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' -
> - -i --nb-cores=2 --txd=1024 --rxd=1024
> +    testpmd>set fwd io
> +    testpmd>start
> +
> +2. Launch virtio-user by below command::
> +
> +    ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \
> +    --legacy-mem --no-pci --file-prefix=virtio \
> +    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,packed_vq=1,mrg_rxbuf=0,in_order=1 \
> +    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=1 --
> txd=1024 --rxd=1024
> +    >set fwd mac
> +    >start
> +
>  3. Send packet with packet generator with different packet size, check the
> throughput.
> \ No newline at end of file
> --
> 2.17.1