MCPcopy Create free account
hub / github.com/NVIDIA/TensorRT-LLM / is_int8_weight_only

Method is_int8_weight_only

tensorrt_llm/quantization/mode.py:121–122  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

119 return (self & bits) != 0
120
121 def is_int8_weight_only(self):
122 return self._all(self.INT8_WEIGHTS, self.WEIGHTS_AND_ACTIVATIONS)
123
124 def is_int4_weight_only(self):
125 return self._all(self.INT4_WEIGHTS, self.WEIGHTS_AND_ACTIVATIONS)

Callers 15

is_weight_onlyMethod · 0.95
to_dictMethod · 0.95
create_trt_sessionMethod · 0.80
test_weights_onlyMethod · 0.80
test_int8_kv_cacheMethod · 0.80
add_tllm_weightFunction · 0.80
buildFunction · 0.80
get_weight_dtype_and_idFunction · 0.80
create_weightsMethod · 0.80

Calls 1

_allMethod · 0.95

Tested by 3

create_trt_sessionMethod · 0.64
test_weights_onlyMethod · 0.64
test_int8_kv_cacheMethod · 0.64