Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DO NOT REVIEW][SPARK-22042] [SQL] Insert shuffle nodes in entire tree before applying ReorderJoinPredicates #19725

Closed

Conversation

tejasapatil
Copy link
Contributor

trying out suggestion in #19257 (comment)

@SparkQA
Copy link

SparkQA commented Nov 12, 2017

Test build #83734 has finished for PR 19725 at commit e333c51.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
  • case class InjectPlaceholderExchange(conf: SQLConf) extends Rule[SparkPlan]

def apply(plan: SparkPlan): SparkPlan = plan.transformUp {
case operator @ ShuffleExchangeExec(partitioning, child, _) =>
child.children match {
case ShuffleExchangeExec(childPartitioning, baseChild, _)::Nil =>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No white spaces around :: intended?

@tejasapatil tejasapatil deleted the SPARK-22042_dummy_shuffle branch December 20, 2017 18:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants