MCPcopy Create free account
hub / github.com/NVIDIA/TensorRT-LLM / submit

Method submit

tensorrt_llm/executor/executor.py:107–108  ·  view source on GitHub ↗
(self, request: GenerationRequest)

Source from the content-addressed store, hash-verified

105
106 @abstractmethod
107 def submit(self, request: GenerationRequest) -> GenerationResult:
108 pass
109
110 @abstractmethod
111 def abort_request(self, request_id: int) -> None:

Callers 1

generate_asyncMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected