MCPcopy Create free account
hub / github.com/NVIDIA/TensorRT-LLM / decode

Method decode

tensorrt_llm/models/gemma/utils/modules.py:58–59  ·  view source on GitHub ↗
(self, x: jax.Array)

Source from the content-addressed store, hash-verified

56 return x
57
58 def decode(self, x: jax.Array) -> jax.Array:
59 return jnp.dot(x, self.input_embedding_table.T)
60
61
62class Attention(nn.Module):

Callers 15

deserialize_managed_weightsFunction · 0.45
generate_asyncMethod · 0.45
_truncate_promptMethod · 0.45
_decode_tokensFunction · 0.45
add_events_from_respMethod · 0.45
getMethod · 0.45
get_prefixMethod · 0.45
keysMethod · 0.45
getMethod · 0.45
_safe_decode_utf8Method · 0.45
encode_opaque_stateFunction · 0.45
create_logprobsFunction · 0.45

Calls

no outgoing calls

Tested by

no test coverage detected