flax.linen.activation.hard_swish#
- flax.linen.activation.hard_swish(x)#
Hard SiLU (swish) activation function
Computes the element-wise function
\[\mathrm{hard\_silu}(x) = x \cdot \mathrm{hard\_sigmoid}(x)\]Both
hard_silu()
andhard_swish()
are aliases for the same function.- Parameters
x – input array
- Returns
An array.
See also