MCPcopy Create free account
hub / github.com/NVIDIA/TensorRT-LLM / _Profiler

Class _Profiler

tensorrt_llm/runtime/generation.py:183–190  ·  view source on GitHub ↗

Source from the content-addressed store, hash-verified

181
182
183class _Profiler(trt.IProfiler):
184
185 def __init__(self):
186 super().__init__()
187 self.results = []
188
189 def report_layer_time(self, layer_name, ms):
190 self.results.append((layer_name, ms))
191
192
193def _contiguous_tile_beam_width(tensor: torch.Tensor, size: int,

Callers 1

_set_profilerMethod · 0.85

Calls

no outgoing calls

Tested by

no test coverage detected