TransformerBlock constructor

TransformerBlock(
  1. int embedSize,
  2. int numHeads, {
  3. bool masked = false,
})

Implementation

TransformerBlock(this.embedSize, int numHeads, {bool masked = false})
    : attention = MultiHeadAttention(numHeads, embedSize, masked: masked),
      ffn = FeedForward(embedSize),
      ln1 = LayerNorm(embedSize),
      ln2 = LayerNorm(embedSize);