MCPcopy Create free account
hub / github.com/NVIDIA/TensorRT-LLM / init_workers_sync

Method init_workers_sync

tensorrt_llm/executor/ray_executor.py:151–163  ·  view source on GitHub ↗
(self)

Source from the content-addressed store, hash-verified

149 self.workers.append(worker)
150
151 def init_workers_sync(self):
152 self.create_workers(RayGPUWorker, self.worker_kwargs)
153 try:
154 ray.get(self._get_worker_ready_futures())
155 except ray.exceptions.ActorDiedError as e:
156 raise RuntimeError("RayGPUWorker died during initialization") from e
157 port = self.call_all_ray_workers("setup_tcp_store",
158 leader_only=True,
159 async_call=False)[0]
160 self.call_all_ray_workers("setup_distributed_env_and_worker",
161 leader_only=False,
162 async_call=False,
163 port=port)
164
165 async def init_workers_async(self):
166 self.create_workers(RayGPUWorker, self.worker_kwargs)

Callers 1

__init__Method · 0.95

Calls 4

create_workersMethod · 0.95
call_all_ray_workersMethod · 0.95
getMethod · 0.45

Tested by

no test coverage detected