Skip to content

Commit

Permalink
[SPARK-2283][SQL] Reset test environment before running PruningSuite
Browse files Browse the repository at this point in the history
JIRA issue: [SPARK-2283](https://issues.apache.org/jira/browse/SPARK-2283)

If `PruningSuite` is run right after `HiveCompatibilitySuite`, the first test case fails because `srcpart` table is cached in-memory by `HiveCompatibilitySuite`, but column pruning is not implemented for `InMemoryColumnarTableScan` operator yet.

Author: Cheng Lian <[email protected]>

Closes #1221 from liancheng/spark-2283 and squashes the following commits:

dc0b663 [Cheng Lian] SPARK-2283: reset test environment before running PruningSuite

(cherry picked from commit 7f196b0)
Signed-off-by: Michael Armbrust <[email protected]>
  • Loading branch information
liancheng authored and marmbrus committed Jun 26, 2014
1 parent abb62f0 commit 5869f8b
Showing 1 changed file with 5 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,11 @@ import scala.collection.JavaConversions._
* A set of test cases that validate partition and column pruning.
*/
class PruningSuite extends HiveComparisonTest {
// Column/partition pruning is not implemented for `InMemoryColumnarTableScan` yet, need to reset
// the environment to ensure all referenced tables in this suites are not cached in-memory.
// Refer to https://issues.apache.org/jira/browse/SPARK-2283 for details.
TestHive.reset()

// Column pruning tests

createPruningTest("Column pruning - with partitioned table",
Expand Down

0 comments on commit 5869f8b

Please sign in to comment.