[dpdk-dev] Running DPDK application with non-previlege mode

[Kamaraj P]

Hi Thomas/Antoly,

We have tried with the below capability to start a DPDK application as a
container.
--cap-add=NET_ADMIN --cap-add=SYS_RESOURCE  --cap-add=SYS_NICE

Still We could see the failures when rte_eali_init() ..

09-06-2021  10:48:37.423583 EAL: NUMA is not supported.
*09-06-2021  10:48:37.423895 EAL: alloc_seg(): get_mempolicy: Function not
implemented  ==> Does this sound like virtual memory is not enough in the
running system (because of NUMA not supported )?*
09-06-2021  10:48:37.423910 EAL: Ask a virtual area of 0x200000 bytes
09-06-2021  10:48:37.423919 EAL: Virtual area found at 0x2200200000 (size =
0x200000)
09-06-2021  10:48:37.423933 EAL: attempted to allocate 1 segments, but only
0 were allocated
09-06-2021  10:48:37.423945 EAL: NUMA is not supported.
*09-06-2021  10:48:37.427811 EAL: alloc_seg(): mmap() failed: Cannot
allocate memory ==>  SYS_RESOURCE would suffice here ?*
09-06-2021  10:48:37.427821 EAL: Ask a virtual area of 0x40000000 bytes
09-06-2021  10:48:37.427829 EAL: Virtual area found at 0x140000000 (size =
0x40000000)
09-06-2021  10:48:37.427839 EAL: attempted to allocate 1 segments, but only
0 were allocated
09-06-2021  10:48:37.427847 EAL: error allocating rte services array
09-06-2021  10:48:37.427869 EAL: rte_service_init() failed


As for the dpdk options when bringing up our application,
--log-level=*:8
--lcores=(0-1)@0
--in-memory
-d/usr/lib64/dpdk-19/librte_pmd_ixgbe.so.20.0
-d/usr/lib64/dpdk-19/librte_pmd_e1000.so.20.0
-d/usr/lib64/dpdk-19/librte_pmd_bnxt.so.20.0
--vdev=net_af_packet0,iface=dpbr_100
--vdev=net_af_packet1,iface=asac-in
--vdev=net_af_packet2,iface=asac-out
*--iova-mode=va  ==> will valid here ?*

Would assume some of the flags were not enough to run DPDK on top of our
environment ? Any memory configuration which needs to be checked for the
underlying system ?
Please share your thoughts.

Thanks,
Kamaraj

On Sun, Sep 5, 2021 at 10:24 PM Kamaraj P <pkamaraj at gmail.com> wrote:

> Hello Thomas,
> THanks for the suggestion.
> Yes. Our DPDK application already has an in-memory option.
> BTW we are not using a multi-process environment for our DPDK application.
>
> Thanks,
> Kamaraj
>
>
> On Wed, Sep 1, 2021 at 11:23 PM Thomas Monjalon <thomas at monjalon.net>
> wrote:
>
>> 01/09/2021 18:09, Kamaraj P:
>> > Thanks Bruce.
>> >
>> > BTW we are trying to run our application as docker container.
>> > We may need to pass the parameters(system capability) along with docker
>> > command line to mount the hugepages ?
>> > Like this :
>> https://github.com/usnistgov/ndn-dpdk/blob/main/docs/Docker.md
>> >
>> > Please share your thoughts.
>>
>> The easiest is to run with --in-memory option.
>>
>> If you really want the hugetlb files (for multi-process),
>> use such docker option:
>> --mount type=bind,src=/dev/hugepages,dst=/dev/hugepages
>>
>>
>>
>>