flax.linen.activation.silu#
- flax.linen.activation.silu(x)[source]#
SiLU (a.k.a. swish) activation function.
Computes the element-wise function:
\[\mathrm{silu}(x) = x \cdot \mathrm{sigmoid}(x) = \frac{x}{1 + e^{-x}}\]swish()
andsilu()
are both aliases for the same function.- Parameters
x – input array
- Returns
An array.
See also