jax.nn.squareplus

jax.nn.squareplus(x, b=4)

Squareplus activation function.

Computes the element-wise function

\[\mathrm{squareplus}(x) = \frac{x + \sqrt{x^2 + b}}{2}\]

as described in https://arxiv.org/abs/2112.11687.

Parameters:

• x (Union[Array, ndarray, bool_, number, bool, int, float, complex]) – input array

• b (Union[Array, ndarray, bool_, number, bool, int, float, complex]) – smoothness parameter

Return type:

Array