Introduction to onnxruntime

This tutorial introduces onnxruntime, a runtime for ONNX available on many platforms and languages. This documentation is mostly about python but onnxruntime is available on many other platforms. onnxruntime executes an ONNX graph.

• OrtValue
  • Device
  • Memory Allocator
  • OrtValue
  • DLPack
  • Sparse Tensors
• Inference with onnxruntime in Python
  • Simple case
  • Session Options
  • Providers
  • Inference on a device different from CPU
  • Profiling
  • Graph Optimisations
• Extensions
  • C API
  • Other languages
  • Custom runtime
  • Tools

previous

ONNX operators and function

next

OrtValue