You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
In #760 the logic to load the steps in stages was added. Currently, load stages are defined by the position of the GlobalSteps in the pipeline.
Describe the solution you'd like
I would like to be able to specify in which stage a step should be loaded. This could be helpful to allow executing bigger pipelines on machines with lower resources at the cost of a lower parallelisation. For example, a pipeline that uses several LLMs could be executed in a machine with 1 GPU if there is only one LLM being executed at a time i.e. there is only 1 step using a GPU per stage.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
In #760 the logic to load the steps in stages was added. Currently, load stages are defined by the position of the
GlobalStep
s in the pipeline.Describe the solution you'd like
I would like to be able to specify in which stage a step should be loaded. This could be helpful to allow executing bigger pipelines on machines with lower resources at the cost of a lower parallelisation. For example, a pipeline that uses several LLMs could be executed in a machine with 1 GPU if there is only one LLM being executed at a time i.e. there is only 1 step using a GPU per stage.
The text was updated successfully, but these errors were encountered: