com.microsoft - GatedRelativePositionBias#
GatedRelativePositionBias - 1#
Version
domain: com.microsoft
since_version: 1
function:
support_level: SupportType.COMMON
shape inference: True
This version of the operator has been available since version 1 of domain com.microsoft.
Summary
Attributes
num_heads - INT (required) : Number of attention heads
Inputs
query_layer (heterogeneous) - T:
query_bias (heterogeneous) - T:
rel_pos (heterogeneous) - T:
weight (heterogeneous) - T:
bias (heterogeneous) - T:
eco_a (heterogeneous) - T:
Outputs
output (heterogeneous) - T:
Type Constraints
T in ( tensor(float), tensor(float16) ): Constrain input and output types to float tensors.
Examples