Skip to content

Onnxruntime Utils for IOBinding and optional CUDA backend

Xiangyang Ju requested to merge xju/athena:upstream_onnx_pr into main

Add IOBinding for Onnxruntime and optionally offload the execution to CUDA GPUs.

It requires the onnxruntime compiled with the CUDA backend support.

Edited by Xiangyang Ju

Merge request reports

Loading