Design

onnx-light-cpu is an extension of onnx-light: it installs fast CPU kernels into onnx-light’s shared C++ dispatch table. It accelerates standard ONNX operators in the ai.onnx domain and operators in the com.microsoft domain. The pages below explain registration, runtime parallel execution, implementation selection, benchmarks, and the main kernel families.

• Registering kernels
• Parallel kernel execution
• Kernel and implementation selection
• Benchmark Methodology
• Kernels