Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable file trash storage in JupyterLab #220

Closed
bsatoriu opened this issue Dec 1, 2020 · 3 comments
Closed

Disable file trash storage in JupyterLab #220

bsatoriu opened this issue Dec 1, 2020 · 3 comments
Assignees
Labels
ADE Algorithm Development Environment Subsystem Enhancement New feature or request JPL JPL related issues

Comments

@bsatoriu
Copy link
Collaborator

bsatoriu commented Dec 1, 2020

The Ops ADE reached maximum storage capacity recently when a user generated 1TB worth of h5 files in a local workspace. Even after deleting these files, the storage usage remain unchanged after Jupyter moved the deleted files into the system's trash folder. See this PR for info on this behavior: jupyter/notebook#1968 (comment)

To prevent unintended caching of deleted files, we can set the delete_to_trash config setting in send2trash library to false. This will prevent users from being able to recover files that may get deleted accidentally. However, the convention in MAAP is to store critical data inside of a S3-backed user folder, which mitigates this potential risk.

@bsatoriu bsatoriu added ADE Algorithm Development Environment Subsystem JPL JPL related issues labels Dec 1, 2020
@bsatoriu bsatoriu self-assigned this Dec 1, 2020
@gchang
Copy link
Collaborator

gchang commented Jan 27, 2021

This is still valid and open.

@gchang gchang added the Enhancement New feature or request label Feb 16, 2021
@gchang
Copy link
Collaborator

gchang commented Mar 24, 2021

Or... we could move/link the trash folder to a S3-backed folders.

@gchang
Copy link
Collaborator

gchang commented Jul 8, 2021

In GCC, the project file system is now on EFS so there's no limit to storage so the system trash is no longer an issue that will prevent users from using more storage. However, we need to still monitor disk usage and let users know when they're using a lot of resources. Captured in #374.

@gchang gchang closed this as completed Jul 8, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ADE Algorithm Development Environment Subsystem Enhancement New feature or request JPL JPL related issues
Projects
None yet
Development

No branches or pull requests

3 participants