MCPcopy Create free account
hub / github.com/PaddlePaddle/FastDeploy / exist_prefill

Method exist_prefill

fastdeploy/worker/xpu_model_runner.py:287–294  ·  view source on GitHub ↗

check whether prefill stage exist

(self)

Source from the content-addressed store, hash-verified

285 return prompt_logprobs_list
286
287 def exist_prefill(self):
288 """
289 check whether prefill stage exist
290 """
291 if int(paddle.max(self.share_inputs["seq_lens_encoder"])) != 0:
292 return 1
293 else:
294 return 0
295
296 def only_prefill(self):
297 """

Callers 1

only_decodeMethod · 0.95

Calls

no outgoing calls

Tested by

no test coverage detected