Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BQ to VCF] Deleting the shards is slow #388

Open
allieychen opened this issue Oct 18, 2018 · 0 comments
Open

[BQ to VCF] Deleting the shards is slow #388

allieychen opened this issue Oct 18, 2018 · 0 comments

Comments

@allieychen
Copy link
Contributor

In BQ to VCF, the deletion of the temp shards take a long time (roughly 10 mins for about 3000 shards). Current solution (PR 387) is leaving the garbage collection to the user rather than auto deletion. Should revisit this issue and find a faster way to clean up the temp files.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant