Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

io: write out lp file with sliced variables and constraints #365

Merged
merged 1 commit into from
Oct 21, 2024

Conversation

FabianHofmann
Copy link
Collaborator

When writing out an LP file, large variables and constraints are now chunked to avoid memory issues. This is especially useful for large models with constraints with many terms. The chunk size can be set with the slice_size argument in the solve function.

@koen-vg I think we are merging this quite soon, could you have a try with your large pypsa-eur myopic network? I hope this will finally fix the issues.

@FabianHofmann FabianHofmann force-pushed the slice_generator branch 4 times, most recently from a01892a to 4b3f65a Compare October 20, 2024 10:02
@FabianHofmann FabianHofmann requested a review from lkstrp October 20, 2024 10:04
@FabianHofmann FabianHofmann force-pushed the slice_generator branch 2 times, most recently from 85147f8 to c1f1944 Compare October 20, 2024 10:10
@koen-vg
Copy link

koen-vg commented Oct 20, 2024

I would love to try this out, at a conference now so I can't promise to be very quick about it, but I'll report back as soon as I've tested this.

@FabianHofmann
Copy link
Collaborator Author

@koen-vg thanks, sure, take your time. @lkstrp merging this as non-intrusive and well tested

@FabianHofmann FabianHofmann merged commit 40a27f9 into master Oct 21, 2024
19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants