[PATCH v9 00/34] Implementation of revised ml/cnxk driver

Jerin Jacob jerinjacobk at gmail.com
Sun Oct 29 13:53:55 CET 2023


On Fri, Oct 27, 2023 at 12:12 AM Srikanth Yalavarthi
<syalavarthi at marvell.com> wrote:
>
> This patch series is an implementation of revised ml/cnxk driver
> to support models compiled with TVM compiler framework. TVM models
> use a hybrid mode for execution, with regions of the model executing
> on the ML accelerator and the rest executing on CPU cores.
>
> This series of commits reorganizes the ml/cnxk driver and adds support
> to execute multiple regions with-in a TVM model.
>
> v9:
>   - Fixed incorrect IO layout for TVM Marvell models
>   - Set byte offset to zero for I/O tensors
>   - Updated max layers macro definition. Set to TVMDP max layers.
>   - Fixed TVM model IO type to RTE IO type map

Series applied to dpdk-next-net-mrvl/for-next-net with following chages. Thanks.

1) cnxl ml driver update in doc/guides/rel_notes/release_23_11.rst
moved to close to mldev subsystem changes
2)
[for-next-net]dell[dpdk-next-net-mrvl] $ git diff
diff --git a/doc/guides/mldevs/cnxk.rst b/doc/guides/mldevs/cnxk.rst
index 28e5b5b87f..25e8ff783a 100644
--- a/doc/guides/mldevs/cnxk.rst
+++ b/doc/guides/mldevs/cnxk.rst
@@ -212,9 +212,9 @@ not part of DPDK and must be installed separately:
 .. note::

     In order for meson to find the dependencies during the configure stage,
-    it is required to add the cmake paths <install_prefix>/lib/cmake/dlpack,
-    <install_prefix>/lib/cmake/dmlc and <install_prefix>/lib/cmake/tvm to
-    CMAKE_PREFIX_PATH and <install_prefix>/lib/pkgconfig to PKG_CONFIG_PATH.
+    it is required to update CMAKE_PREFIX_PATH and PKG_CONFIG_PATH as below.
+    CMAKE_PREFIX_PATH='<install_prefix>/lib/cmake/tvm:<install_prefix>/lib/cmake/dlpack:<install_prefix>/lib/cmake/dmlc'
+    PKG_CONFIG_PATH='<install_prefix>/lib/pkgconfig'


For the record, I have used following build command to test code with
external build dep.

Assumung all depended libraries installed at /export/cross_ml/install/

CMAKE_PREFIX_PATH='/export/cross_ml/install/lib/cmake/tvm:/export/cross_ml/install/lib/cmake/dlpack:/export/cross_ml/install/lib/cmake/dmlc'
PKG_CONFIG_PATH='/export/cross_ml/install/lib/pkgconfig/' meson setup
 --cross config/arm/arm64_cn10k_linux_gcc  -Denable_docs=true
-Dexamples=all -Dc_args='-I/export/cross_ml/install/include'
-Dc_link_args='-L/export/cross_ml/install/lib' build

Also, -Dc_args='-I/export/cross_ml/install/include'
-Dc_link_args='-L/export/cross_ml/install/lib' could be removed when
following patch merged through main tree.
https://patches.dpdk.org/project/dpdk/patch/20231029082004.5576-1-syalavarthi@marvell.com/


More information about the dev mailing list