↓ 2 callersFunctionlayernorm_fn(x, weight, bias, z=None, eps=1e-6, group_size=None, norm_before_gate=True, is_rms_norm=False)
mamba_ssm/ops/triton/layernorm_gated.py:380
↓ 2 callersFunctionmamba_inner_fn(
xz, conv1d_weight, conv1d_bias, x_proj_weight, delta_proj_weight,
out_proj_weight, out_proj_bias,
mamba_ssm/ops/selective_scan_interface.py:373
↓ 2 callersFunctionmamba_mimo_bwd_combined(
dout,
q,
k,
v,
q_bias,
k_bias,
mimo_v,
m
mamba_ssm/ops/tilelang/mamba3/mamba3_mimo_bwd.py:1158
↓ 2 callersFunctionrms_norm_ref(x, weight, bias, z=None, eps=1e-6, group_size=None, norm_before_gate=True, upcast=True)
mamba_ssm/ops/triton/layernorm_gated.py:18
↓ 2 callersFunctionrmsnorm_fn(x, weight, bias, z=None, eps=1e-6, group_size=None, norm_before_gate=True)
mamba_ssm/ops/triton/layernorm_gated.py:384
↓ 2 callersFunctionselective_state_update_fused_ref_v2 Reference to match the new fused kernel API. Shapes: state: (B, N, H, S) A: (B, N) B: (B, R, N, S)
mamba_ssm/ops/cute/mamba3/mamba3_step_fn.py:741
↓ 2 callersFunctionssd_selective_scan Argument: x: (batch, seqlen, nheads, headdim) dt: (batch, seqlen, nheads) or (batch, seqlen, nheads, headdim) A: (nheads)
mamba_ssm/ops/triton/ssd_combined.py:723
↓ 1 callersMethod_apply_rotary_update_kvcache_attention Fast path that combine 3 steps: apply rotary to Q and K, update kv cache, and apply attention. q: (batch_size, seqlen_q, nheads, head
mamba_ssm/modules/mha.py:129
↓ 1 callersFunction_make_inputs(
*,
seed: int,
headdim: int,
dstate: int,
chunk_size: int = 256,
ngroups: int = 1,
tests/test_determinism.py:24
↓ 1 callersMethod_preprocess(self, A_proj, dd_dt, B, C, x, z, trap_proj, angle_proj)
mamba_ssm/modules/mamba3.py:253
↓ 1 callersFunction_update_kv_cachekv: (batch_size, seqlen, 2, nheads, head_dim) or (batch_size, 1, 2, nheads, head_dim)
mamba_ssm/modules/mha.py:26
↓ 1 callersMethod_update_kv_cachekv: (batch_size, seqlen, 2, nheads, head_dim) or (batch_size, 1, 2, nheads, head_dim)
mamba_ssm/modules/mha.py:124
↓ 1 callersFunctionapply_angle_dt_reference(
angle: Tensor, # (batch, seqlen, nheads, dim)
dt: Tensor, # (batch, seqlen, nheads)
)
tests/ops/tilelang/test_mamba3_mimo.py:454
↓ 1 callersFunctioncapture_graph(
model, inference_params, batch_size, max_seqlen, decoding_seqlen=1, mempool=None, n_warmups=2
)
mamba_ssm/utils/generation.py:342
↓ 1 callersFunctionchunk_scan_ref Argument: B: (batch, seqlen, ngroups, dstate) C: (batch, seqlen, ngroups, dstate) x: (batch, seqlen, nheads, headdim)
mamba_ssm/ops/triton/ssd_chunk_scan.py:1846
↓ 1 callersFunctionchunk_state_ref Argument: B: (batch, seqlen, ngroups, dstate) x: (batch, seqlen, nheads, headdim) dt: (batch, nheads, nchunks, chunk_size
mamba_ssm/ops/triton/ssd_chunk_state.py:1094
↓ 1 callersFunctioncompute_dqkv Compute gradients dQ_mid, dK_mid, dV, dADT, dQK_dot, dD, d_issm_state for Mamba-3 backward pass. This kernel operates on the rotated/sca
mamba_ssm/ops/triton/mamba3/mamba3_siso_bwd.py:616
↓ 1 callersFunctioncreate_block(
d_model,
d_intermediate,
ssm_cfg=None,
attn_layer_idx=None,
attn_cfg=None,
norm_epsi
mamba_ssm/models/mixer_seq_simple.py:29
↓ 1 callersMethodkernel(
self,
mState: cute.Tensor, # (B, H, D, N)
mBstate: cute.Tensor, # (B, R, H, N)
mamba_ssm/ops/cute/mamba3/mamba3_step_fn.py:227
↓ 1 callersFunctionmake_smoke_inputs(
*,
batch: int = 1,
seqlen: int = 64,
mimo_rank: int = 4,
nheads_qk: int = 1,
nheads:
tests/ops/tilelang/test_mamba3_mimo.py:190
↓ 1 callersFunctionmake_tensors(*, batch: int, seqlen: int, nheads: int, headdim: int, dstate: int, ngroups: int, chunk_size: int,
tests/benchmark_determinism_kernels.py:35
↓ 1 callersFunctionmamba_inner_ref(
xz, conv1d_weight, conv1d_bias, x_proj_weight, delta_proj_weight,
out_proj_weight, out_proj_bias,
mamba_ssm/ops/selective_scan_interface.py:384
↓ 1 callersFunctionmamba_mimo_bwd_bwd(
B,
S,
H,
G,
N,
P,
R,
hasZ,
hasD,
reduceO,
chunk_size: int = 16,
mamba_ssm/ops/tilelang/mamba3/mamba3_mimo_bwd.py:505
↓ 1 callersFunctionmamba_mimo_bwd_fwd(
B,
S,
H,
G,
N,
P,
R,
hasZ,
hasD,
reduceO,
chunk_size: int = 16,
mamba_ssm/ops/tilelang/mamba3/mamba3_mimo_bwd.py:42
↓ 1 callersFunctionmamba_mimo_forward(q, k, v,
q_bias, k_bias,
mimo_v, mimo_o,
mamba_ssm/ops/tilelang/mamba3/mamba3_mimo_fwd.py:417
↓ 1 callersFunctionmamba_mimo_fwd(
B,
S,
H,
G,
N,
P,
R,
hasZ,
hasD,
reduceO,
return_final_state=Fal
mamba_ssm/ops/tilelang/mamba3/mamba3_mimo_fwd.py:38