[PATCH v2 0/3] Spec changes to support multi I/O models
Srikanth Yalavarthi
syalavarthi at marvell.com
Wed Sep 20 09:19:07 CEST 2023
This series implements changes to mldev spec to extend support
for ML models with multiple inputs and outputs. Changes include
introduction of I/O layout to support packed and split buffers
for model input and output. Extended the rte_ml_model_info
structure to support multiple inputs and outputs.
Updated rte_ml_op and quantize / dequantize APIs to support an
array of input and output ML buffer segments.
Support for batches option is dropped from test application.
v2:
- Minor fixes
- Cleanup of application help
v1:
- Initial changes
Srikanth Yalavarthi (3):
mldev: add support for arbitrary shape dimensions
mldev: introduce support for IO layout
mldev: drop input and output size get APIs
app/test-mldev/ml_options.c | 16 -
app/test-mldev/ml_options.h | 2 -
app/test-mldev/test_inference_common.c | 420 +++++++++++++++++--------
app/test-mldev/test_inference_common.h | 6 +
app/test-mldev/test_model_common.c | 6 -
app/test-mldev/test_model_common.h | 1 -
doc/guides/tools/testmldev.rst | 6 -
drivers/ml/cnxk/cn10k_ml_dev.h | 3 +
drivers/ml/cnxk/cn10k_ml_model.c | 84 +++--
drivers/ml/cnxk/cn10k_ml_model.h | 12 +
drivers/ml/cnxk/cn10k_ml_ops.c | 135 +++-----
lib/mldev/meson.build | 2 +-
lib/mldev/mldev_utils.c | 30 --
lib/mldev/mldev_utils.h | 16 -
lib/mldev/rte_mldev.c | 50 +--
lib/mldev/rte_mldev.h | 201 +++++-------
lib/mldev/rte_mldev_core.h | 68 +---
lib/mldev/version.map | 3 -
18 files changed, 506 insertions(+), 555 deletions(-)
--
2.41.0
More information about the dev
mailing list