MCPcopy Create free account
hub / github.com/NVIDIA/TensorRT-LLM / __init__

Method __init__

tensorrt_llm/models/opt/model.py:111–126  ·  view source on GitHub ↗
(self, config: PretrainedConfig)

Source from the content-addressed store, hash-verified

109class OPTModel(Module):
110
111 def __init__(self, config: PretrainedConfig):
112 super().__init__()
113 self.do_layer_norm_before = config.do_layer_norm_before
114
115 self.vocab_embedding = Embedding(config.vocab_size,
116 config.hidden_size,
117 dtype=config.dtype)
118 self.position_embedding = Embedding(config.max_position_embeddings,
119 config.hidden_size,
120 dtype=config.dtype)
121
122 self.layers = DecoderLayerList(OPTDecoderLayer, config)
123
124 if self.do_layer_norm_before:
125 self.ln_f = LayerNorm(normalized_shape=config.hidden_size,
126 dtype=config.dtype)
127
128 def forward(self,
129 input_ids: Tensor,

Callers 2

__init__Method · 0.45
__init__Method · 0.45

Calls 3

DecoderLayerListClass · 0.85
EmbeddingClass · 0.50
LayerNormClass · 0.50

Tested by

no test coverage detected