Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Globus transfer and monitoring #55

Merged
merged 6 commits into from
May 16, 2019

Conversation

Cadair
Copy link
Member

@Cadair Cadair commented May 13, 2019

An example of usiing this is:

from dkist.utils.globus.endpoints import get_directory_listing, get_transfer_client
from dkist.utils.globus.transfer import start_transfer_from_file_list, watch_transfer_progress

file_list = get_directory_listing("/fraser/", "dkist GCSv4")[:100]

tc = get_transfer_client()

task_id = start_transfer_from_file_list("dkist GCSv4", "dest_endpoint",
                                        "/endpoint/transfer_test",
                                        file_list, src_base_path=None)

watch_transfer_progress(task_id, tc, verbose=True)

@codecov
Copy link

codecov bot commented May 13, 2019

Codecov Report

Merging #55 into master will increase coverage by 0.11%.
The diff coverage is 100%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master      #55      +/-   ##
==========================================
+ Coverage   97.31%   97.42%   +0.11%     
==========================================
  Files          20       21       +1     
  Lines        1005     1050      +45     
==========================================
+ Hits          978     1023      +45     
  Misses         27       27
Impacted Files Coverage Δ
dkist/utils/globus/transfer.py 100% <100%> (ø)
dkist/utils/globus/__init__.py 100% <100%> (ø) ⬆️
dkist/utils/globus/endpoints.py 100% <100%> (ø) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 2d0a60d...a75b8a6. Read the comment docs.

@Cadair Cadair added this to the 16 milestone May 14, 2019
@Cadair Cadair merged commit 2a176de into DKISTDC:master May 16, 2019
@Cadair Cadair deleted the globus_transfer branch May 16, 2019 11:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant