Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix optimizer regressions #3694

Closed
wants to merge 7 commits into from

Conversation

andygrove
Copy link
Member

@andygrove andygrove commented Oct 3, 2022

Which issue does this PR close?

Closes #3690

Rationale for this change

PR #3662 introduced regressions that were not detected due to a lack of test cases and also due to the fact that we default to skip_failing_rules = true.

What changes are included in this PR?

Are there any user-facing changes?

No

@github-actions github-actions bot added core Core DataFusion crate optimizer Optimizer rules labels Oct 3, 2022
@andygrove andygrove requested review from liukun4515 and alamb October 3, 2022 16:48
@andygrove andygrove marked this pull request as ready for review October 3, 2022 23:30
@andygrove
Copy link
Member Author

@alamb @liukun4515 This PR is one solution for fixing the recent regressions introduced into the optimizer - by reverting the PR that introduced them - but maybe @liukun4515 can fix these issues in a separate PR, then we won't need to merge this one.

@liukun4515
Copy link
Contributor

@alamb @liukun4515 This PR is one solution for fixing the recent regressions introduced into the optimizer - by reverting the PR that introduced them - but maybe @liukun4515 can fix these issues in a separate PR, then we won't need to merge this one.

I have done the enhancement to fix the bug in #3699

@alamb
Copy link
Contributor

alamb commented Oct 4, 2022

@andygrove can you verify your dask tests work now?

The two tests described above are included now in the optimizer integration test by @liukun4515 : https://github.com/apache/arrow-datafusion/blob/57312284c082c914dd5e1edaa5c1fe3dbe4f222d/datafusion/optimizer/tests/integration-test.rs#L33-L57

@andygrove
Copy link
Member Author

Closed in favor of #3699

#3699 fixes some of the regressions 👍 but there are are more. I will file a new issue shortly once I have a good repro case.

@andygrove andygrove closed this Oct 4, 2022
@andygrove andygrove deleted the fix-optimizer-regressions branch January 27, 2023 18:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Core DataFusion crate optimizer Optimizer rules
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Optimizer regressions in unwrap_cast_in_comparison
3 participants