To be extended by derived classes to implement the optimizer's update. Args: gradient (mx.array): The ``parameter`` gradient.

Performs the RMSprop parameter update and stores :math:`v` in the optimizer state.

Performs the Adagrad parameter update and stores :math:`v` in the optimizer state.

Performs the AdaDelta parameter update and stores :math:`v` and :math:`u` in the optimizer state.

Performs the Adam parameter update and stores :math:`v` and :math:`m` in the optimizer state.

Performs the AdamW parameter update by modifying the parameters passed into Adam.

Performs the Adamax parameter update and stores :math:`v` and :math:`m` in the optimizer state.

Performs the Lion parameter update and stores :math:`m` in the optimizer state.

Performs the Adafactor parameter and state update.

Performs the Muon parameter update

Call the quantized embedding layer as a quantized linear layer. Use this for example when input embedding and output projection

Attach an event to a not yet evaluated array

Computes the binary cross entropy loss. By default, this function takes the pre-sigmoid logits, which results in a faster and more preci

All compilable

Binary into binary

Binary into unary into un-compilable