r"""A Glorot normal initializer. This initializer samples from a normal distribution with a standard deviation computed from the number of in

r"""A Glorot uniform initializer. This initializer samples from a uniform distribution with a range computed from the number of input (``fan_

returns the smallest composite of 2, 3, 5, 7 and 11 which is >= n */

returns the smallest composite of 2, 3, 5 which is >= n */

Grows the backing store by a factor of two, and at least to {min_capacity}. TODO: Move to private after removing external code using this method.

r"""Applies the HardShrink activation function. .. math:: \text{hardshrink}(x) = \begin{cases} x & \text{if } x > \lambda \\

r"""Applies the HardTanh function. Applies :math:`\max(\min(x, \mathrm{max\_val}), \mathrm{min\_val})` element-wise.

r"""Applies the hardswish function, element-wise. .. math:: \text{Hardswish}(x) = x * \min(\max(x + 3, 0), 6) / 6

r"""Build a He normal initializer. This initializer samples from a normal distribution with a standard deviation computed from the number of

r"""A He uniform (Kaiming uniform) initializer. This initializer samples from a uniform distribution with a range computed from the number of

r""" Computes the hinge loss between inputs and targets. .. math:: \text{hinge}(y, y_{\text{pred}}) = \max(0, 1 - y \cdot y_{\text{pr

r""" Computes the Huber loss between inputs and targets. .. math:: l_{\delta}(a) = \left\{ \begin{array}{ll} \fr

Initialize optimizer state

Initialize optimizer state

Initialize optimizer state

Initialize optimizer state

Initialize optimizer state

Initialize optimizer state

Initialize optimizer state

Initialize optimizer state

Initialize optimizer state