SiLU (a.k.a. swish) activation function.
Computes the element-wise function:
\[\mathrm{silu}(x) = x \cdot \mathrm{sigmoid}(x) = \frac{x}{1 + e^{-x}}\]
swish()
and silu()
are both aliases for the same function.
- Parameters
x – input array
- Returns
An array.