MCPcopy Create free account
hub / github.com/apache/arrow / test_construct_from_single_directory

Function test_construct_from_single_directory

python/pyarrow/tests/test_dataset.py:2517–2533  ·  view source on GitHub ↗
(tempdir, dataset_reader, pickle_module)

Source from the content-addressed store, hash-verified

2515
2516@pytest.mark.parquet
2517def test_construct_from_single_directory(tempdir, dataset_reader, pickle_module):
2518 directory = tempdir / 'single-directory'
2519 directory.mkdir()
2520 tables, paths = _create_directory_of_files(directory)
2521
2522 d1 = ds.dataset(directory)
2523 d2 = ds.dataset(directory, filesystem=fs.LocalFileSystem())
2524 d3 = ds.dataset(directory.name, filesystem=_filesystem_uri(tempdir))
2525 t1 = dataset_reader.to_table(d1)
2526 t2 = dataset_reader.to_table(d2)
2527 t3 = dataset_reader.to_table(d3)
2528 assert t1 == t2 == t3
2529
2530 # test pickle roundtrip
2531 for d in [d1, d2, d3]:
2532 restored = pickle_module.loads(pickle_module.dumps(d))
2533 assert dataset_reader.to_table(restored) == t1
2534
2535
2536@pytest.mark.parquet

Callers

nothing calls this directly

Calls 6

_filesystem_uriFunction · 0.90
LocalFileSystemMethod · 0.80
loadsMethod · 0.80
dumpsMethod · 0.80
to_tableMethod · 0.45

Tested by

no test coverage detected