com.microsoft - AttnLSTM#
AttnLSTM - 1#
Version
name: AttnLSTM (GitHub)
domain: com.microsoft
since_version: 1
function:
support_level: SupportType.COMMON
shape inference: False
This version of the operator has been available since version 1 of domain com.microsoft.
Summary
Attributes
activation_alpha - FLOATS : Optional scaling values used by some activation functions. The values are consumed in the order of activation functions, for example (f, g, h) in LSTM. Default values are the same as of corresponding ONNX operators.For example with LeakyRelu, the default alpha is 0.01.
activation_beta - FLOATS : Optional scaling values used by some activation functions. The values are consumed in the order of activation functions, for example (f, g, h) in LSTM. Default values are the same as of corresponding ONNX operators.
activations - STRINGS : A list of 3 (or 6 if bidirectional) activation functions for input, output, forget, cell, and hidden. The activation functions must be one of the activation functions specified above. Optional: See the equations for default if not specified.
clip - FLOAT : Cell clip threshold. Clipping bounds the elements of a tensor in the range of [-threshold, +threshold] and is applied to the input of activations. No clip if not specified.
direction - STRING : Specify if the RNN is forward, reverse, or bidirectional. Must be one of forward (default), reverse, or bidirectional.
hidden_size - INT : Number of neurons in the hidden layer.
input_forget - INT : Couple the input and forget gates if 1, default 0.
Inputs
Between 3 and 14 inputs.
X (heterogeneous) - T:
W (heterogeneous) - T:
R (heterogeneous) - T:
B (optional, heterogeneous) - T:
sequence_lens (optional, heterogeneous) - T1:
initial_h (optional, heterogeneous) - T:
initial_c (optional, heterogeneous) - T:
P (optional, heterogeneous) - T:
QW (optional, heterogeneous) - T:
MW (optional, heterogeneous) - T:
V (optional, heterogeneous) - T:
M (optional, heterogeneous) - T:
memory_seq_lens (optional, heterogeneous) - T1:
AW (optional, heterogeneous) - T:
Outputs
Between 0 and 3 outputs.
Y (optional, heterogeneous) - T:
Y_h (optional, heterogeneous) - T:
Y_c (optional, heterogeneous) - T:
Type Constraints
T in ( tensor(double), tensor(float) ): Constrain input and output types to float tensors.
T1 in ( tensor(int32) ): Constrain seq_lens to integral tensors.
Examples