Completed Plans — 2026

Completed performance roadmaps from 2026. Unfinished work remains on the next-steps page.

Completed

Plan	Contribution
Exp and Log parity	Brings the transcendental kernels to their published ONNX Runtime parity and numerical gates.
Gemm and MatMul	Delivers the shared matrix engine, typed and compact paths, scheduling, packing, AVX-512 tuning, and the corrective work through #605 and #608.
Attention	Delivers materialized and bounded-memory streaming Attention, including the AVX-512 optimization pass and the AVX2 decode and scheduling foundations through #599, #605, and #608.
Binary elementwise performance	Delivers prepared traversal, typed bulk execution, AVX-512 arithmetic, low-precision comparison, integer validation, and dispatch optimizations through #599.
Binary elementwise	Supplies the shared prepared broadcast engine, generated correctness corpus, and parity gate for all 19 registered binary operators.
TreeEnsemble	Provides the typed in-place v5 engine, compact prepared storage, and final correctness, parity, and memory gates, with the large-batch row-parallel follow-up tracked in #580.
Runtime execution controls	Supplies the typed session policy and shared executor used by every registered kernel.
Processor performance profile	Measures cache and RAM bandwidth and latency plus sustained arithmetic throughput through one explicit Python API.
Registered kernel documentation	Derives the Python inventory and generated reference directly from the actual C++ registrations.
Recent kernel performance improvements	Consolidates the August sprint and the August 30–September 2 follow-up across unary, binary, matrix, Attention, normalization, com.microsoft, and TreeEnsemble kernels.
com.microsoft domain support	Introduces CDist and BiasGelu end to end, including schemas, runtime kernels, gradients, fusion patterns, tests, documentation, and the latency follow-ups in #562 and #564.