softplus function

Tensor<Vector> softplus(
  1. Tensor<Vector> v
)

Differentiable approximation of the Relu function.

Implementation

Tensor<Vector> softplus(Tensor<Vector> v) {
  return vectorLog(addScalar(vectorExp(v), 1.0));
}