MCPcopy Create free account
hub / github.com/feast-dev/feast / _write_batch

Function _write_batch

sdk/python/feast/infra/compute_engines/ray/utils.py:148–160  ·  view source on GitHub ↗

Write a single Arrow batch to the online store and pass it through.

(batch: pa.Table)

Source from the content-addressed store, hash-verified

146 batch_size = repo_config.materialization_config.online_write_batch_size
147
148 def _write_batch(batch: pa.Table) -> pa.Table:
149 """Write a single Arrow batch to the online store and pass it through."""
150 rows_to_write = _convert_arrow_to_proto(
151 batch, feature_view, join_key_to_value_type
152 )
153 if rows_to_write:
154 online_store.online_write_batch(
155 config=repo_config,
156 table=feature_view,
157 data=rows_to_write,
158 progress=lambda x: None,
159 )
160 return batch
161
162 # Ray's map_batches requires a positive integer or "default" for batch_size;
163 # None is not accepted. When no explicit batch size is configured, omit the

Callers

nothing calls this directly

Calls 2

_convert_arrow_to_protoFunction · 0.90
online_write_batchMethod · 0.45

Tested by

no test coverage detected