Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: implement recursive download for dfget #613

Merged
merged 1 commit into from
Jul 19, 2024

Conversation

Lzzzzzt
Copy link
Contributor

@Lzzzzzt Lzzzzzt commented Jul 18, 2024

implement recursive download for dfget

Description

This PR completes with the following tasks:

  • add new function called download_tasks to download the directory
  • add new function called download_task to download single file

Other details will be shown in the code.

Related Issue

#496

Motivation and Context

Dragonfly rust client does not support back-to-source downloading of different object storage protocols. Priority is given to supporting OSS protocol back-to-source downloads. Need to support OSS protocol in dragonfly-client-backend crate, implemented based on trait Backend and it needs to support directory recursive downloading.

Screenshots

image

@Lzzzzzt Lzzzzzt requested a review from a team as a code owner July 18, 2024 11:09
Copy link

codecov bot commented Jul 18, 2024

Codecov Report

Attention: Patch coverage is 0% with 146 lines in your changes missing coverage. Please review.

Project coverage is 12.32%. Comparing base (c202b14) to head (494389d).

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##             main     #613      +/-   ##
==========================================
- Coverage   12.47%   12.32%   -0.16%     
==========================================
  Files          55       55              
  Lines        9952    10077     +125     
==========================================
  Hits         1242     1242              
- Misses       8710     8835     +125     
Files Coverage Δ
dragonfly-client-core/src/error/mod.rs 68.00% <ø> (ø)
dragonfly-client/src/bin/dfget/main.rs 0.00% <0.00%> (ø)

@Lzzzzzt Lzzzzzt force-pushed the recusive-download branch 3 times, most recently from 3733d46 to 9ade0cb Compare July 18, 2024 11:29
dragonfly-client/src/bin/dfget/main.rs Show resolved Hide resolved
dragonfly-client/src/bin/dfget/main.rs Show resolved Hide resolved
dragonfly-client/src/bin/dfget/main.rs Show resolved Hide resolved
dragonfly-client/src/bin/dfget/main.rs Outdated Show resolved Hide resolved
dragonfly-client/src/bin/dfget/main.rs Outdated Show resolved Hide resolved
dragonfly-client/src/bin/dfget/main.rs Outdated Show resolved Hide resolved
@BruceAko
Copy link
Contributor

Redundant signature information.
image

@Lzzzzzt Lzzzzzt force-pushed the recusive-download branch from 9ade0cb to c58a83f Compare July 18, 2024 12:32
Signed-off-by: lzzzt <[email protected]>

feat: implement recursive download for dfget

Signed-off-by: lzzzt <[email protected]>
@Lzzzzzt Lzzzzzt force-pushed the recusive-download branch from c58a83f to 494389d Compare July 18, 2024 12:39
Copy link
Member

@gaius-qi gaius-qi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@gaius-qi gaius-qi merged commit 2247e0f into dragonflyoss:main Jul 19, 2024
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants