com.microsoft - SkipLayerNormalization#

SkipLayerNormalization - 1#

Version

This version of the operator has been available since version 1 of domain com.microsoft.

Summary

Attributes

  • epsilon - FLOAT : The epsilon value to use to avoid division by zero.

Inputs

Between 3 and 5 inputs.

  • input (heterogeneous) - T:

  • skip (heterogeneous) - T:

  • gamma (heterogeneous) - T:

  • beta (optional, heterogeneous) - T:

  • bias (optional, heterogeneous) - T:

Outputs

Between 1 and 4 outputs.

  • output (heterogeneous) - T:

  • mean (optional, heterogeneous) - U:

  • inv_std_var (optional, heterogeneous) - U:

  • input_skip_bias_sum (optional, heterogeneous) - T:

Type Constraints

  • T in ( tensor(float), tensor(float16) ): Constrain input and output types to float or half tensors.

  • U in ( tensor(float) ): Constrain mean and inv_std_var to float tensors.

Examples