Bug 473 - variance in test case fail for static and shared build binaries
Summary: variance in test case fail for static and shared build binaries
Status: UNCONFIRMED
Alias: None
Product: DPDK
Classification: Unclassified
Component: other (show other bugs)
Version: 20.05
Hardware: x86 Linux
: Normal major
Target Milestone: 20.05
Assignee: Thomas Monjalon
URL:
Depends on:
Blocks:
 
Reported: 2020-05-14 04:00 CEST by Vipin Varghese
Modified: 2020-05-19 13:32 CEST (History)
2 users (show)



Attachments

Description Vipin Varghese 2020-05-14 04:00:51 CEST
DPDK:20.05-rc2
Linux:4.15.0-99-generic 
GCC: Ubuntu 7.5.0-3ubuntu1~18.04
Distribution: Ubuntu 18.04.4 LTS

Steps for static:
1. fetch from git the right version of DPDK.
2. default build for `x86_64-native-linuxapp-gcc`
3. move to the parent folder `dpdk`
4. execute `make test O=x86_64-native-linuxapp-gcc`

Failed test cases in STATIC
```
Cycles autotest:              Fail                         [00m 01s][00m 02s]
EAL flags autotest:           Fail                         [00m 02s][00m 05s]
Read/write lock autotest:     Fail [Timeout]               [00m 10s][00m 13s]
Alarm autotest:               Fail                         [00m 00s][00m 38s]
PMD ring autotest:            Fail                         [00m 00s][00m 57s]
Link bonding autotest:        Fail                         [00m 00s][01m 14s]
Link bonding mode4 autotest:  Fail                         [00m 00s][01m 14s]
Link bonding rssconf autotest:Fail                         [00m 00s][01m 14s]
```

Steps for shared:
1. fetch from git the right version of DPDK.
2. edit .config for SHARED for `x86_64-native-linuxapp-gcc`
3. move to the parent folder `dpdk`
4. export LD_LIBRARY_PATH=$RTE_SDK/$RTE_TARGETlib/
5. execute `make test O=x86_64-native-linuxapp-gcc`

Failed test cases in SHARED
```
EAL flags autotest:           Fail                         [00m 02s][00m 05s]
RIB autotest:                 Fail                         [00m 00s][00m 05s]
RIB slow autotest:            Fail                         [00m 00s][00m 06s]
RIB6 autotest:                Fail                         [00m 00s][00m 06s]
RIB6 slow autotest:           Fail                         [00m 00s][00m 06s]
FIB autotest:                 Fail                         [00m 00s][00m 06s]
FIB slow autotest:            Fail                         [00m 00s][00m 06s]
FIB6 autotest:                Fail                         [00m 00s][00m 06s]
FIB6 slow autotest:           Fail                         [00m 00s][00m 06s]
Read/write lock autotest:     Fail [Timeout]               [00m 10s][00m 12s]
Alarm autotest:               Fail                         [00m 00s][00m 13s]
Multi-process autotest:       Fail                         [00m 01s][00m 14s]
Mbuf autotest:                Fail                         [00m 00s][00m 14s]
Mempool autotest:             Fail                         [00m 00s][00m 19s]
Prefetch autotest:            Fail                         [00m 00s][00m 19s]
Sched autotest:               Fail                         [00m 00s][00m 21s]
Eventdev selftest octeontx:   Fail                         [00m 00s][00m 21s]
Table autotest:               Fail [Crash]                 [00m 00s][00m 21s]
Flow classify autotest:       Fail [Crash]                 [00m 00s][00m 21s]
Event eth rx adapter autotest:Fail [Crash]                 [00m 00s][00m 21s]
User delay:                   Fail [Crash]                 [00m 00s][00m 21s]
Atomics autotest:             Success                      [00m 02s][00m 21s]
Sleep delay:                  Fail [Crash]                 [00m 00s][00m 21s]
Rawdev autotest:              Fail                         [00m 00s][00m 21s]
Kvargs autotest:              Fail [Crash]                 [00m 00s][00m 21s]
Link bonding autotest:        Fail                         [00m 00s][00m 21s]
Link bonding mode4 autotest:  Fail [Crash]                 [00m 00s][00m 21s]
Link bonding rssconf autotest:Fail                         [00m 00s][00m 21s]
Crc autotest:                 Fail [Crash]                 [00m 00s][00m 21s]
Distributor autotest:         Fail                         [00m 00s][00m 21s]
Reorder autotest:             Fail [Crash]                 [00m 00s][00m 21s]
Bitmap test:                  Fail [Crash]                 [00m 00s][00m 21s]
Hash multiwriter autotest:    Fail [Crash]                 [00m 00s][00m 22s]
Service autotest:             Fail [Crash]                 [00m 00s][00m 22s]
Timer racecond autotest:      Fail [Crash]                 [00m 00s][00m 22s]
Member autotest:              Fail [Crash]                 [00m 00s][00m 22s]
Efd_autotest:                 Fail [Crash]                 [00m 00s][00m 22s]
Thash autotest:               Fail [Crash]                 [00m 00s][00m 22s]
Hash function autotest:       Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev sw mvsam autotest:  Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev dpaa2 sec autotest: Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev dpaa sec autotest:  Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev qat autotest:       Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev aesni mb autotest:  Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev openssl autotest:   Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev scheduler autotest: Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev aesni gcm autotest: Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev null autotest:      Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev sw snow3g autotest: Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev sw kasumi autotest: Fail [Crash]                 [00m 00s][00m 22s]
Cryptodev_sw_zuc_autotest:    Fail [Crash]                 [00m 00s][00m 22s]
Reciprocal division:          Fail [Crash]                 [00m 00s][00m 22s]
Red all:                      Fail [Crash]                 [00m 00s][00m 23s]
Fbarray autotest:             Fail [Crash]                 [00m 00s][00m 23s]
External memory autotest:     Fail [Crash]                 [00m 00s][00m 23s]
Metrics autotest:             Fail [Crash]                 [00m 00s][00m 23s]
Bitratestats autotest:        Fail [Crash]                 [00m 00s][00m 23s]
Latencystats autotest:        Fail [Crash]                 [00m 00s][00m 23s]
Pdump autotest:               Fail [Crash]                 [00m 00s][00m 23s]
IPsec_SAD:                    Fail [Crash]                 [00m 00s][00m 23s]
Non-parallel autotests:
Eventdev common autotest:     Fail                         [00m 00s][00m 40s]

```
Comment 1 Ajit Khaparde 2020-05-18 17:20:08 CEST
Thomas, Bruce, I haven't checked all my mails yet, but will this one block 20.05?
Comment 2 Thomas Monjalon 2020-05-19 08:38:51 CEST
This result is very suspicious.

1/ Static test should not fail at all.

2/ Shared test should load libraries from CONFIG_RTE_EAL_PMD_PATH

3/ We should focus on meson now
Comment 3 Vipin Varghese 2020-05-19 13:32:26 CEST
Hi Ajith,

based on update from David in ticket `https://bugs.dpdk.org/show_bug.cgi?id=471` I am using `make test`

Following is the link I followed for build for DPDK, Application and test folder. 

1. `http://doc.dpdk.org/guides/linux_gsg/build_dpdk.html#compiling-and-installing-dpdk-system-wide`.

2. `http://doc.dpdk.org/guides/linux_gsg/build_sample_apps.html`

3. `http://doc.dpdk.org/guides/sample_app_ug/compiling.html` 

I did not find any mention of

1. how to build `app/test` with either meson or make.

2. only mention to CONFIG_RTE_EAL_PMD_PATH is in `http://doc.dpdk.org/guides/nics/mlx4.html?highlight=config_rte_eal_pmd_path`, `http://doc.dpdk.org/guides/nics/mlx5.html?highlight=config_rte_eal_pmd_path`, and `http://doc.dpdk.org/guides/vdpadevs/mlx5.html?highlight=config_rte_eal_pmd_path`


Questions: 

1. What is the recommendation from DPDK? if Make is depreciated there is no updates in `http://doc.dpdk.org/guides/rel_notes/release_20_05.html` or `http://doc.dpdk.org/guides/rel_notes/known_issues.html`

2. if auto-test with make is broken, can you help me find the same in documentation?

3. Is make for auto-test broken in 19.11.2 LTS?

Note You need to log in before you can comment on or make changes to this bug.