-
Notifications
You must be signed in to change notification settings - Fork 335
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: upgrade opendal #1245
feat: upgrade opendal #1245
Conversation
f2fa12c
to
34324e1
Compare
Codecov Report
@@ Coverage Diff @@
## develop #1245 +/- ##
===========================================
- Coverage 85.60% 85.32% -0.28%
===========================================
Files 495 495
Lines 73397 73378 -19
===========================================
- Hits 62828 62612 -216
- Misses 10569 10766 +197 |
34324e1
to
a25c923
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
let file_full_path = format!("{}{}", self.path, filename); | ||
let _ = self.object_store.stat(&file_full_path).await.context( | ||
error::ListObjectsSnafu { | ||
path: &file_full_path, | ||
}, | ||
)?; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is it possible that a file doesn't exist while listing the data source?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is it possible that a file doesn't exist while listing the data source?
OpenDAL always raises an error if target file path does not exist.
* chore: upgrade opendal * chore: finish upgrading opendal * fix: clippy complaints * fix some tests * fix: all unit tests * chore: rebase develop * fix: sqlness tests * optimize imports * chore: rebase develop * doc: add todo
I hereby agree to the terms of the GreptimeDB CLA
What's changed and what's your intention?
Upgrades opendal from 0.27 to 0.30. This is the prerequisite of #1248 .
The major changes are:
ObjectStore
now takes aBuilder
instead of anAccessor
.Object
is completely removed from opendal in #1477. Thus lots of file read/write stuff needs rewrite.list/scan
now returns a stream ofEntry
instead ofObject
.Checklist
Refer to a related PR or issue link (optional)