Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Record step performance #924

Open
donkirkby opened this issue May 20, 2020 · 0 comments
Open

Record step performance #924

donkirkby opened this issue May 20, 2020 · 0 comments

Comments

@donkirkby
Copy link
Member

donkirkby commented May 20, 2020

It's often helpful to know which part of a container's workflow is consuming resources, such as processing time or memory.

Proposal: after #511 provides named arguments and #920 starts recording performance, add an option for containers to configure a named argument for a current_step.csv file. Once a minute, the runcontainer command can read the last line of the file to see what the current step is, and record the time spent on each step, as well as which step triggered the peak memory usage. It might also be possible to check the memory usage of each step, but we'll have to dig into the cgroups features.

@donkirkby donkirkby added this to the Near future milestone May 20, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant