-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
perf: use lpop with count and don't fetch upload in Upload task #707
Conversation
we don't need to fetch the report upload because all we're doing is setting the upload_pk to upload_id in the normalized args dict we also can batch our redis lpops into groups of 50 so we don't have to make as many calls to redis
🔍 Existing Issues For ReviewYour pull request is modifying functions with the following pre-existing issues: 📄 File: tasks/upload.py
Did you find this useful? React with a 👍 or 👎 |
Codecov ReportAttention: Patch coverage is ✅ All tests successful. No failed tests found.
@@ Coverage Diff @@
## main #707 +/- ##
==========================================
- Coverage 98.09% 98.08% -0.02%
==========================================
Files 434 434
Lines 36607 36616 +9
==========================================
+ Hits 35911 35916 +5
- Misses 696 700 +4
Flags with carried forward coverage won't be shown. Click here to find out more.
|
Codecov ReportAttention: Patch coverage is
✅ All tests successful. No failed tests found.
@@ Coverage Diff @@
## main #707 +/- ##
==========================================
- Coverage 98.09% 98.08% -0.02%
==========================================
Files 434 434
Lines 36607 36616 +9
==========================================
+ Hits 35911 35916 +5
- Misses 696 700 +4
Flags with carried forward coverage won't be shown. Click here to find out more.
|
Codecov ReportAttention: Patch coverage is
✅ All tests successful. No failed tests found. @@ Coverage Diff @@
## main #707 +/- ##
==========================================
- Coverage 98.09% 98.08% -0.02%
==========================================
Files 434 434
Lines 36607 36616 +9
==========================================
+ Hits 35911 35916 +5
- Misses 696 700 +4
Flags with carried forward coverage won't be shown. Click here to find out more.
|
Codecov ReportAttention: Patch coverage is
Changes have been made to critical files, which contain lines commonly executed in production. Learn more ✅ All tests successful. No failed tests found.
Additional details and impacted files@@ Coverage Diff @@
## main #707 +/- ##
==========================================
- Coverage 98.14% 98.13% -0.01%
==========================================
Files 475 475
Lines 37962 37971 +9
==========================================
+ Hits 37257 37263 +6
- Misses 705 708 +3
Flags with carried forward coverage won't be shown. Click here to find out more.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
looks great!
codecov/worker#707 uses an lpop argument that requires Redis 6.2
we don't need to fetch the report upload because all we're doing is setting the upload_pk to upload_id in the normalized args dict
we also can batch our redis lpops into groups of 50 so we don't have to make as many calls to redis