jax.nn.celu

jax.nn.celu(x, alpha=1.0)

Continuously-differentiable exponential linear unit activation.

Computes the element-wise function:

\[\begin{split}\mathrm{celu}(x) = \begin{cases} x, & x > 0\\ \alpha \left(\exp(\frac{x}{\alpha}) - 1\right), & x \le 0 \end{cases}\end{split}\]

For more information, see Continuously Differentiable Exponential Linear Units.

Parameters:

• x (Union[Array, ndarray, bool_, number, bool, int, float, complex]) – input array

• alpha (Union[Array, ndarray, bool_, number, bool, int, float, complex]) – array or scalar (default: 1.0)

Return type:

Array

Returns:

An array.