jax.nn.hard_swish

Contents

jax.nn.hard_swish#

jax.nn.hard_swish(x)[source]#

Hard SiLU (swish) activation function

Computes the element-wise function

\[\mathrm{hard\_silu}(x) = x \cdot \mathrm{hard\_sigmoid}(x)\]

Both hard_silu() and hard_swish() are aliases for the same function.

Parameters:

x (jax.typing.ArrayLike) – input array

Returns:

An array.

Return type:

Array

See also

hard_sigmoid()