MCPcopy
hub / github.com/huggingface/datasets / write

Function write

benchmarks/benchmark_array_xd.py:25–30  ·  view source on GitHub ↗
(my_features, dummy_data, tmp_dir)

Source from the content-addressed store, hash-verified

23
24@get_duration
25def write(my_features, dummy_data, tmp_dir):
26 with ArrowWriter(features=my_features, path=os.path.join(tmp_dir, "beta.arrow")) as writer:
27 for key, record in dummy_data:
28 example = my_features.encode_example(record)
29 writer.write(example)
30 num_examples, num_bytes = writer.finalize()
31
32
33@get_duration

Callers 1

benchmark_array_xdFunction · 0.70

Calls 4

ArrowWriterClass · 0.90
finalizeMethod · 0.80
encode_exampleMethod · 0.45
writeMethod · 0.45

Tested by

no test coverage detected