MCPcopy Create free account
hub / github.com/NVIDIA/TensorRT-LLM / put

Method put

tensorrt_llm/executor/ipc.py:158–168  ·  view source on GitHub ↗
(self, obj: Any, routing_id: Optional[bytes] = None)

Source from the content-addressed store, hash-verified

156 return False
157
158 def put(self, obj: Any, routing_id: Optional[bytes] = None):
159 self.setup_lazily()
160 self._check_thread_safety()
161 with nvtx_range_debug("send", color="blue", category="IPC"):
162 if self.use_hmac_encryption or self.socket_type == zmq.ROUTER:
163 # Need manual serialization for encryption or ROUTER multipart
164 data = self._prepare_data(obj)
165 self._send_data(data, routing_id=routing_id)
166 else:
167 # Standard socket without encryption - use pyobj directly
168 self.socket.send_pyobj(obj)
169
170 def put_noblock(self,
171 obj: Any,

Calls 5

setup_lazilyMethod · 0.95
_check_thread_safetyMethod · 0.95
_prepare_dataMethod · 0.95
_send_dataMethod · 0.95
nvtx_range_debugFunction · 0.85