MCPcopy Create free account
hub / github.com/modelscope/modelscope / _batch

Method _batch

modelscope/pipelines/base.py:292–302  ·  view source on GitHub ↗
(self, data_list)

Source from the content-addressed store, hash-verified

290 return out
291
292 def _batch(self, data_list):
293 batch_data = {}
294 for sample_preprocessed in data_list:
295 for k, v in sample_preprocessed.items():
296 value_list = batch_data.get(k, [])
297 value_list.append(v)
298 batch_data[k] = value_list
299 for k in batch_data.keys():
300 if isinstance(batch_data[k][0], torch.Tensor):
301 batch_data[k] = torch.cat(batch_data[k])
302 return batch_data
303
304 def _process_batch(self, input: List[Input], batch_size,
305 **kwargs) -> Dict[str, Any]:

Callers 2

_process_batchMethod · 0.95
_stream_batchMethod · 0.45

Calls 5

itemsMethod · 0.45
getMethod · 0.45
appendMethod · 0.45
keysMethod · 0.45
catMethod · 0.45

Tested by

no test coverage detected