-
Notifications
You must be signed in to change notification settings - Fork 5.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Update correlation in Apply node #5687
Conversation
kokosing
commented
Jul 18, 2016
•
edited
Loading
edited
0e099ff
to
1747df3
Compare
|
||
checkState(resolvedField.isPresent() && resolvedField.get().isLocal(), "Unable to get symbol for field in outer scope: '%s'", expression); | ||
if (resolvedField.isPresent() && resolvedField.get().isLocal()) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
return resolvedField.filter(ResolvedField::isLocal).map(field -> outputSymbols.get(field.getFieldIndex()))
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
I did not read this pull request. But I would like to add a comment because of a production issue we've seen before. When Teradata brought non-equi conjunct support to outer join in Presto (thank you again), we removed the sanity check that fails any query that contains such conjuncts (and its tests) before the feature were linked together to execute such query correctly. As a result, for more than a month, the Presto release version produces incorrect result for such queries. Please make sure any query with correlated subqueries continues to fail loudly until such query produces correct result. |
@haozhun That is a general true. None of the features should be enabled until it works correctly. I am trying to test it as mush as I can, nevertheless the bugs may still exists. That is why code review is so much important, that I could benefit from your experience and possibly broaden the test coverage to avoid that situation you (FB) experienced before. |
@haozhun Maybe we could display a notice to the user about possible instability of new features, that given feature was recently added and may still have bugs or instabilities. Such notice could be displayed through couple of Presto releases. What do you think about such approach, would it help if you had something like that for non-equi conjunct support to outer join back then? |
1747df3
to
e0a34b7
Compare
@@ -70,6 +70,11 @@ | |||
|
|||
public class LogicalPlanner | |||
{ | |||
public enum Stage | |||
{ | |||
CREATED, OPTIMIZED, OPTIMIZED_AND_VALIDATED |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This should probably in a separate commit.
Also, can you remind me of the rationale for this? I remember discussing about this, but I can't find the original comments.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Fixed. I added a commit message which explains the motivation.