Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce memory efficient topological sort #20258

Merged
merged 11 commits into from
Apr 23, 2024
Merged

Conversation

pengwa
Copy link
Contributor

@pengwa pengwa commented Apr 10, 2024

Introduce memory efficient topo sort (for training)

and laze initialize Priority-Based and Memory-Efficient topo sort. Because in most cases, they are not needed, so we free the overheads of GraphViewer construction for most use cases.

Motivation and Context

@pengwa pengwa added the training issues related to ONNX Runtime training; typically submitted using template label Apr 10, 2024
@pengwa pengwa requested review from wschin and zhijxu-MS April 10, 2024 08:52
@pengwa pengwa marked this pull request as ready for review April 10, 2024 08:53
@pengwa pengwa requested a review from guyang3532 April 10, 2024 09:47
@pengwa pengwa changed the title Introduce memory efficient topo sort Introduce memory efficient topological sort Apr 10, 2024
wschin
wschin previously approved these changes Apr 19, 2024
Copy link
Contributor

@wschin wschin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a lot.

@pengwa pengwa merged commit a7787a0 into main Apr 23, 2024
94 checks passed
@pengwa pengwa deleted the pengwa/mem_efficient_order branch April 23, 2024 00:00
TedThemistokleous pushed a commit to TedThemistokleous/onnxruntime that referenced this pull request May 7, 2024
### Introduce memory efficient topo sort (for training)

~~and laze initialize Priority-Based and Memory-Efficient topo sort.
Because in most cases, they are not needed, so we free the overheads of
GraphViewer construction for most use cases.~~

### Motivation and Context
<!-- - Why is this change required? What problem does it solve?
- If it fixes an open issue, please link to the issue here. -->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
training issues related to ONNX Runtime training; typically submitted using template
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants