MCPcopy Create free account
hub / github.com/apache/arrow / test_write_dataset

Function test_write_dataset

python/pyarrow/tests/test_dataset.py:4218–4250  ·  view source on GitHub ↗
(tempdir)

Source from the content-addressed store, hash-verified

4216
4217@pytest.mark.parquet
4218def test_write_dataset(tempdir):
4219 # manually create a written dataset and read as dataset object
4220 directory = tempdir / 'single-file'
4221 directory.mkdir()
4222 _ = _create_single_file(directory)
4223 dataset = ds.dataset(directory)
4224
4225 # full string path
4226 target = tempdir / 'single-file-target'
4227 expected_files = [target / "part-0.arrow"]
4228 _check_dataset_roundtrip(dataset, str(target), expected_files, 'a', target)
4229
4230 # pathlib path object
4231 target = tempdir / 'single-file-target2'
4232 expected_files = [target / "part-0.arrow"]
4233 _check_dataset_roundtrip(dataset, target, expected_files, 'a', target)
4234
4235 # relative path
4236 target = tempdir / 'single-file-target3'
4237 expected_files = [target / "part-0.arrow"]
4238 with change_cwd(tempdir):
4239 _check_dataset_roundtrip(
4240 dataset, './single-file-target3', expected_files, 'a', target)
4241
4242 # Directory of files
4243 directory = tempdir / 'single-directory'
4244 directory.mkdir()
4245 _ = _create_directory_of_files(directory)
4246 dataset = ds.dataset(directory)
4247
4248 target = tempdir / 'single-directory-target'
4249 expected_files = [target / "part-0.arrow"]
4250 _check_dataset_roundtrip(dataset, str(target), expected_files, 'a', target)
4251
4252
4253@pytest.mark.parquet

Callers

nothing calls this directly

Calls 4

change_cwdFunction · 0.90
_create_single_fileFunction · 0.85
_check_dataset_roundtripFunction · 0.85

Tested by

no test coverage detected