Add list_file() functional API to FSSpecFileLister and IoPathFileLister#463

Closed

bushshrub wants to merge 22 commits intopytorch:mainfrom bushshrub:387-filelister-listfile

+36

Commits on Jun 2, 2022

feat: naive impl of list_file for fsspec

bushshrub
authored and
ejguan
committed
test: test for list_file() for FSSpecFileLister

bushshrub
authored and
ejguan
committed
test: consistency with test_fsspec_file_lister_iterdatapipe_with_list

bushshrub
authored and
ejguan
committed
test: ensure protocol is present

bushshrub
authored and
ejguan
committed
feat: naive impl of list_file for iopath

bushshrub
authored and
ejguan
committed
test: test for list_file() of iopath

bushshrub
authored and
ejguan
committed
test: consistency for iopath

bushshrub
authored and
ejguan
committed
feat: functional_datapipe list_file_by

bushshrub
authored and
ejguan
committed
test: update tests for fsspec and iopath for functional api

bushshrub
authored and
ejguan
committed
test: merge functional API tests with regular tests

bushshrub
authored and
ejguan
committed
test: delete unnecessary test

bushshrub
authored and
ejguan
committed
style: change variable names for functional lister tests

bushshrub
authored and
ejguan
committed
chore: directly iterate over datapipe

bushshrub
authored and
ejguan
committed
refactor: fix grammar

authored and
ejguan
committed
refactor: fix grammar

authored and
ejguan
committed
test: update tests with new functional API

bushshrub
authored and
ejguan
committed
Update test/test_fsspec.py

bushshrub
and
ejguan
committed
test: fix failing tests due to missing file:// prefix

bushshrub
authored and
ejguan
committed
test: fix breaking test due to unsortable datapipe

bushshrub
authored and
ejguan
committed
test: fix failing test_fsspec_file_lister_iterdp_with_lsit

bushshrub
authored and
ejguan
committed
test: fix failing tests due to .sort() being in-place

bushshrub
authored and
ejguan
committed
test: fix failing tests due to missing file:// prefix again

bushshrub
authored and
ejguan
committed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add list_file() functional API to FSSpecFileLister and IoPathFileLister#463

Commits on Jun 2, 2022

feat: naive impl of list_file for fsspec

test: test for list_file() for FSSpecFileLister

test: consistency with test_fsspec_file_lister_iterdatapipe_with_list

test: ensure protocol is present

feat: naive impl of list_file for iopath

test: test for list_file() of iopath

test: consistency for iopath

feat: functional_datapipe list_file_by

test: update tests for fsspec and iopath for functional api

test: merge functional API tests with regular tests

test: delete unnecessary test

style: change variable names for functional lister tests

chore: directly iterate over datapipe

refactor: fix grammar

refactor: fix grammar

test: update tests with new functional API

Update test/test_fsspec.py

test: fix failing tests due to missing file:// prefix

test: fix breaking test due to unsortable datapipe

test: fix failing test_fsspec_file_lister_iterdp_with_lsit

test: fix failing tests due to .sort() being in-place

test: fix failing tests due to missing file:// prefix again