FeedForward constructor

FeedForward(
  1. int dim
)

Implementation

FeedForward(int dim)
  : w1 = Layer(dim, dim * 4, useGelu: true),
    w2 = Layer(dim * 4, dim, useGelu: false);