↓ 2 callersFunctionnaive_mesa_net_exact(q, k, v, g, lamb, beta, h_kk_init=None, h_kv_init=None)
fla/ops/mesa_net/naive.py:44
↓ 2 callersFunctionnaive_path_attn Reference PyTorch implementation of path attention. Args: q: [B, T, HQ, D] k: [B, T, H, D] v: [B, T, H, D] w
fla/ops/path_attn/naive.py:13
↓ 2 callersFunctionnaive_recurrent_gated_delta_product(q, k, v, g, beta, scale, cu_seqlens,
initial_state=None, output_final
fla/ops/gated_delta_product/naive.py:11
↓ 2 callersFunctionparallel_deltaformer_chunk_fwd(
q: torch.Tensor,
k: torch.Tensor,
v: torch.Tensor,
u: torch.Tensor,
qk_scale: float,
fla/ops/deltaformer/parallel.py:31
↓ 2 callersFunctionparallel_path_attnr""" Args: q (torch.Tensor): queries of shape `[B, T, HQ, K]` k (torch.Tensor): keys of shape `[B, T, H, K
fla/ops/path_attn/parallel.py:225
↓ 2 callersFunctionparallel_retentionr""" Args: q (torch.Tensor): queries of shape `[B, T, H, K]`. k (torch.Tensor): keys of shape `[B, T, H, K
fla/ops/retention/parallel.py:13
↓ 2 callersFunctionprepare_wy_repr_bwd(
k: torch.Tensor,
v: torch.Tensor,
beta: torch.Tensor,
gk: torch.Tensor,
A: torch.Tensor,
fla/ops/kda/wy_fast.py:297
↓ 2 callersFunctionrecurrence_iplr_delta_rule_ref(
q,
k,
v,
a,
b,
initial_state: torch.Tensor | None = None,
output_final_state: bo
tests/ops/test_iplr_delta.py:86
↓ 2 callersFunctionrecurrent_dplr_delta_rule_ref(
q: torch.Tensor,
k: torch.Tensor,
v: torch.Tensor,
a: torch.Tensor,
b: torch.Tensor,
tests/ops/test_dplr_delta.py:19
↓ 2 callersFunctionrmsnorm_fn(x, weight, bias, z=None, eps=1e-6, group_size=None, norm_before_gate=True)
fla/modules/layernorm_gated.py:466
↓ 2 callersFunctionrotary_embedding_fwdbwd Args: x: [B, T, H, D]. cos: [TR, R / 2] sin: [TR, R / 2] seqlen_offsets: integer or integer tensor of size [N]
fla/modules/rotary.py:142
↓ 2 callersFunctiontorch_addcmul_rwkv7(hidden_states, delta, xr, xw, xk, xv, xa, xg=None)
fla/ops/rwkv7/fused_addcmul.py:290
↓ 1 callersFunction_build_kda_bwd_kernel(
B, H, K, V, BT, BK, BV,
hD1, hD2,
dtype_str,
STATE_V_FIRST, IS_VARLEN=False,
num_warps=4
fla/ops/kda/backends/tilelang/chunk_bwd_dqkg.py:35
↓ 1 callersFunction_build_kernel(
B,
H,
K,
V,
BT,
BK,
BV,
NK,
hD1,
hD2,
dtype_str,
USE_G,
fla/ops/common/backends/tilelang/chunk_bwd.py:21
↓ 1 callersFunction_check_passing_vs_whole(
B: int,
T: int,
H: int,
cu_seqlens: list[int] | None,
dtype: torch.dtype,
split_at:
tests/modules/test_token_shift.py:80
↓ 1 callersFunction_create_yoco_config(
L: int,
H: int,
D: int,
use_l2warp: bool = False,
vocab_size: int = 1000,
self_decod
tests/models/test_modeling_yoco.py:56
↓ 1 callersMethod_decode_incrementalr"""Non-windowed decode against a *pre-rescaled* KV cache. The cache holds ``(k_tilde, v, P[, gs_cumsum])`` rather than raw ``(k, v, g)``.
fla/layers/wall_attn.py:220