MCPcopy Create free account
hub / github.com/NVIDIA/TensorRT-LLM / __init__

Method __init__

tensorrt_llm/models/bloom/model.py:109–118  ·  view source on GitHub ↗
(self, config: PretrainedConfig)

Source from the content-addressed store, hash-verified

107class BloomModel(Module):
108
109 def __init__(self, config: PretrainedConfig):
110 super().__init__()
111 self.vocab_embedding = Embedding(config.vocab_size,
112 config.hidden_size,
113 dtype=config.dtype)
114 self.ln_embed = LayerNorm(normalized_shape=config.hidden_size,
115 dtype=config.dtype)
116 self.layers = DecoderLayerList(BloomDecoderLayer, config)
117 self.ln_f = LayerNorm(normalized_shape=config.hidden_size,
118 dtype=config.dtype)
119
120 def forward(self,
121 input_ids: Tensor,

Callers 2

__init__Method · 0.45
__init__Method · 0.45

Calls 3

DecoderLayerListClass · 0.85
EmbeddingClass · 0.50
LayerNormClass · 0.50

Tested by

no test coverage detected