:orphan:

Backend Test and Kernels Examples
=================================

Examples showing how to retrieve, inspect or run ONNX backend test cases
exposed by :mod:`onnx_light.onnx.backend`.


.. raw:: html

  <div id='sg-tag-list' class='sphx-glr-tag-list'></div>


.. raw:: html

    <div class="sphx-glr-thumbnails">

.. thumbnail-parent-div-open

.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="ReferenceEvaluator dispatches every NodeProto against the static C++ KernelDispatchTable. Any operator that is not built in — typically an operator from a user-defined domain, or a temporary stand-in for an op that is not yet implemented — would otherwise fail with unsupported op_type.">

.. only:: html

  .. image:: /auto_examples_backend/images/thumb/sphx_glr_plot_custom_kernel_thumb.png
    :alt:

  :doc:`/auto_examples_backend/plot_custom_kernel`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Extend ReferenceEvaluator with a custom kernel</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="The ONNX backend test suite shipped with onnx-light is exposed as a small C++ data model bound to Python under onnx_light.onnx.backend. Each entry is a TestCase made of a ModelProto plus one or more DataSet (lists of reference input / output Tensor instances).">

.. only:: html

  .. image:: /auto_examples_backend/images/thumb/sphx_glr_plot_backend_test_case_thumb.png
    :alt:

  :doc:`/auto_examples_backend/plot_backend_test_case`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Retrieve a backend test case and display its model and data</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="onnx_light ships a C++ kernel dispatcher exposed in Python through ReferenceEvaluator. After each run call the evaluator retains the RuntimeContext used internally; calling events returns an append-only log of every tensor map mutation: graph initializers seeded on entry, inputs injected by the caller, intermediate values produced by each node kernel and outputs propagated back to the caller.">

.. only:: html

  .. image:: /auto_examples_backend/images/thumb/sphx_glr_plot_runtime_events_thumb.png
    :alt:

  :doc:`/auto_examples_backend/plot_runtime_events`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Run a model with the runtime and inspect intermediate results</div>
    </div>


.. raw:: html

    <div class="sphx-glr-thumbcontainer" tooltip="This example shows how to take one backend test case from the suite shipped with onnx-light (onnx_light.onnx.backend), run its ONNX model with the reference runtime, and then re-run the same case as a backend test.">

.. only:: html

  .. image:: /auto_examples_backend/images/thumb/sphx_glr_plot_run_cast_to_int2_thumb.png
    :alt:

  :doc:`/auto_examples_backend/plot_run_cast_to_int2`

.. raw:: html

      <div class="sphx-glr-thumbnail-title">Run an ONNX model casting a float tensor into an int2 tensor</div>
    </div>


.. thumbnail-parent-div-close

.. raw:: html

    </div>


.. toctree::
   :hidden:

   /auto_examples_backend/plot_custom_kernel
   /auto_examples_backend/plot_backend_test_case
   /auto_examples_backend/plot_runtime_events
   /auto_examples_backend/plot_run_cast_to_int2


.. only:: html

  .. container:: sphx-glr-footer sphx-glr-footer-gallery

    .. container:: sphx-glr-download sphx-glr-download-python

      :download:`Download all examples in Python source code: auto_examples_backend_python.zip </auto_examples_backend/auto_examples_backend_python.zip>`

    .. container:: sphx-glr-download sphx-glr-download-jupyter

      :download:`Download all examples in Jupyter notebooks: auto_examples_backend_jupyter.zip </auto_examples_backend/auto_examples_backend_jupyter.zip>`


.. only:: html

 .. rst-class:: sphx-glr-signature

    `Gallery generated by Sphinx-Gallery <https://sphinx-gallery.github.io>`_