MCPcopy Create free account
hub / github.com/NVIDIA/TensorRT-LLM / submit

Method submit

tests/unittest/llmapi/test_llm.py:2014–2020  ·  view source on GitHub ↗
(self, request: GenerationRequest)

Source from the content-addressed store, hash-verified

2012 should_raise_error = True
2013
2014 def submit(self, request: GenerationRequest) -> GenerationResult:
2015 # Making the first response failed, and the subsequent responses successful
2016 if DummyExecutorWorker4.should_raise_error:
2017 DummyExecutorWorker4.should_raise_error = False
2018 raise RequestError("Test error")
2019
2020 return super().submit(request)
2021
2022
2023DummyExecutor4 = DummyExecutorMeta("DummyExecutor4", (), {},

Calls 1

RequestErrorClass · 0.90

Tested by

no test coverage detected