[dts] DTS Enhancement Plan

[Chen, Zhaoyan]

Hi, DTS developers/users,

With DPDK development rapidly, more and more test suites were developed in DTS. (150+ test suites and 3k+ test cases in DTS). Meanwhile, paralleling execution tests for NICs/crypto/other device on same DUT become important for reducing execution time for covering all test cases. So we plan to enhance the DTS, for

*        Improve test suite quality

*        Unified test capability/function into framework

*        Paralleling execution

So we draft a DTS development plan, and share with you.

Looking forward to hear your thoughts, ideas and suggestions.

/Zhaoyan

DTS framework enhancement
=========================

Unified packet sending for functionality test
              * Implement all packet sending features in Packet Class
              * Remove others sending functions in DTS framework
              * Sending packet from Tester only

Generic EAL options generator for DPDK based application
              * Generate EAL options for DPDK app, and consider the assigned hardware resource for test, instead of whole DUT
              * Test suite can overwrite the options, in restricted range
              * Define hardware resource in crb.cfg, port.cfg and pktgen.cfg

Global resource management
              * Global driver load or unload, vfio-pci, igb_uio, uio_pci_generic
              * Define a parameter to decside if insmod/rmmod, if the module updated. otherwise, keep this module on host.
              * External_memory setup
              * Define DUT's cores mask in crb configuration
              * Define DUT's ports mask
              * Define physical ports in crb config

Clean up unused APIs, unused imported libraries, and unused APIs
              * plotting.py, plotgraph.py, numpy, matplotlib
              * e.g. self.tester.run_rfc2544, has been replaced by pktgen class
              * Replace private texttable.py with public version

All-in-one configuration file
              * Support configure all information in one configuration file for easy using
              * yaml file is better

Prepare to move to Python 3, make code be compatible with py2 and py3

Generate auto-script for all DTS dependencies
              * Update requirements.txt
              * Generate script for binary dependencies for compilation python packages

Release DTS container version


Test Suites cleanness
=================

Move to new packet sending API
              * Update all tests, which generate packets and send packets

Move to generic EAL generator API
              * Update all tests which use DPDK based application with new EAL string

Clean up "sleep"
              * Replace "sleep" with a stable checking mechanism

Replace "pktgen app" with "testpmd app" for testing
              * pktgen app needs be built for special DPDK version and too heavy for a simple function test, replace it in test case with testpmd app
Clean up absolute path
              * Replace "/tmp" with "/tmp/<dts_pid_random>/", or relative path "tmp".
              * Replace specific OS path in test case

Clean up test case dependencies, (files, libraries or tools)
              * Check all test suites, and add dependencies into auto-script or requirements.txt

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mails.dpdk.org/archives/dts/attachments/20190724/f9bea12d/attachment.html>