Onnxruntime Utils for IOBinding and optional CUDA backend

Xiangyang Jurequested to merge
xju/athena:upstream_onnx_pr into main

Add IOBinding for Onnxruntime and optionally offload the execution to CUDA GPUs.

It requires the onnxruntime compiled with the CUDA backend support.

Edited by Xiangyang Ju

Merge request reports