GroupNormalization - version 18#

This page documents version 18 of operator GroupNormalization. See GroupNormalization for the latest version (since version 21).

Warning

This operator is deprecated.

  • Domain: ai.onnx

  • Since version: 18

A GroupNormalization function. Carries out group normalization as described in the paper https://arxiv.org/abs/1803.08494

This operator transforms input according to

y = scale * (x - mean) / sqrt(variance + epsilon) + bias,

where the mean and variance are computed per instance per group of channels, and scale and bias should be specified for each group of channels. The number of groups num_groups should be divisible by the number of channels so that there are an equal number of channels per group.

When the number of groups is the same as the number of channels, this operator is equivalent to InstanceNormalization. When there is only one group, this operator is equivalent to LayerNormalization.

Inputs

  • X (T): Input data tensor. Dimensions for image cases are (N x C x H x W), where N is the batch size, C is the number of channels, and H and W are the height and width of the data. Statistics are computed for every group of channels over C, H, and W. For non-image cases, the dimensions are in the form of (N x C x D1 x D2 ... Dn).

  • scale (T): Scale tensor of shape (num_groups).

  • bias (T): Bias tensor of shape (num_groups).

Outputs

  • Y (T): The output tensor of the same shape as X.

Attributes

  • epsilon (float): The epsilon value to use to avoid division by zero.

  • num_groups (int): The number of groups of channels. It should be a divisor of the number of channels C.

Type Constraints

  • T: Constrain input and output types to float tensors. Allowed types: tensor(bfloat16), tensor(double), tensor(float), tensor(float16).