Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Assign a load stage to steps of a pipeline manually #813

Closed
gabrielmbmb opened this issue Jul 23, 2024 · 0 comments
Closed

[FEATURE] Assign a load stage to steps of a pipeline manually #813

gabrielmbmb opened this issue Jul 23, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@gabrielmbmb
Copy link
Member

Is your feature request related to a problem? Please describe.
In #760 the logic to load the steps in stages was added. Currently, load stages are defined by the position of the GlobalSteps in the pipeline.

Describe the solution you'd like
I would like to be able to specify in which stage a step should be loaded. This could be helpful to allow executing bigger pipelines on machines with lower resources at the cost of a lower parallelisation. For example, a pipeline that uses several LLMs could be executed in a machine with 1 GPU if there is only one LLM being executed at a time i.e. there is only 1 step using a GPU per stage.

@gabrielmbmb gabrielmbmb added the enhancement New feature or request label Jul 23, 2024
@gabrielmbmb gabrielmbmb added this to the 1.4.0 milestone Jul 23, 2024
@gabrielmbmb gabrielmbmb self-assigned this Jul 23, 2024
@gabrielmbmb gabrielmbmb modified the milestones: 1.4.0, 1.5.0 Aug 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Done
Development

No branches or pull requests

1 participant