[SPARK-31891][SQL] Support `MSCK REPAIR TABLE .. [{ADD|DROP|SYNC} PARTITIONS]` #31499

MaxGekk · 2021-02-06T20:34:52Z

What changes were proposed in this pull request?

In the PR, I propose to extend the MSCK REPAIR TABLE command, and support new options {ADD|DROP|SYNC} PARTITIONS. In particular:

Extend the logical node RepairTable, and add two new flags enableAddPartitions and enableDropPartitions.
Add similar flags to the v1 execution node AlterTableRecoverPartitionsCommand
Add new method dropPartitions() to AlterTableRecoverPartitionsCommand which drops partitions from the catalog if their locations in the file system don't exist.
Updated public docs about the MSCK REPAIR TABLE command:

Closes #31097

Why are the changes needed?

The changes allow to recover tables with removed partitions. The example below portraits the problem:

spark-sql> create table tbl2 (col int, part int) partitioned by (part);
spark-sql> insert into tbl2 partition (part=1) select 1;
spark-sql> insert into tbl2 partition (part=0) select 0;
spark-sql> show table extended like 'tbl2' partition (part = 0);
default	tbl2	false	Partition Values: [part=0]
Location: file:/Users/maximgekk/proj/apache-spark/spark-warehouse/tbl2/part=0
...

Remove the partition (part = 0) from the filesystem:

$ rm -rf /Users/maximgekk/proj/apache-spark/spark-warehouse/tbl2/part=0

Even after recovering, we cannot query the table:

spark-sql> msck repair table tbl2;
spark-sql> select * from tbl2;
21/01/08 22:49:13 ERROR SparkSQLDriver: Failed in [select * from tbl2]
org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: file:/Users/maximgekk/proj/apache-spark/spark-warehouse/tbl2/part=0

To have feature parity with Hive: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-RecoverPartitions(MSCKREPAIRTABLE)

Does this PR introduce any user-facing change?

Yes. After the changes, we can query recovered table:

spark-sql> msck repair table tbl2 sync partitions;
spark-sql> select * from tbl2;
1	1
spark-sql> show partitions tbl2;
part=1

How was this patch tested?

By running the modified test suite:

$ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *MsckRepairTableParserSuite"
$ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *PlanResolutionSuite"
$ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *AlterTableRecoverPartitionsSuite"
$ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *AlterTableRecoverPartitionsParallelSuite"

Added unified v1 and v2 tests for MSCK REPAIR TABLE:

$ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *MsckRepairTableSuite"

SparkQA · 2021-02-06T21:55:50Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39544/

SparkQA · 2021-02-06T22:23:40Z

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39544/

SparkQA · 2021-02-07T00:49:05Z

Test build #134961 has finished for PR 31499 at commit c313bdb.

This patch fails Spark unit tests.
This patch merges cleanly.
This patch adds the following public classes (experimental):
case class RepairTable(

SparkQA · 2021-02-07T08:05:35Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39564/

SparkQA · 2021-02-07T08:40:50Z

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39564/

SparkQA · 2021-02-07T11:54:22Z

Test build #134981 has finished for PR 31499 at commit 1168390.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

MaxGekk · 2021-02-07T16:54:37Z

@cloud-fan @dongjoon-hyun @viirya @HyukjinKwon May I ask you to review this PR.

SparkQA · 2021-02-07T18:12:58Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39574/

SparkQA · 2021-02-07T19:44:51Z

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39574/

SparkQA · 2021-02-07T22:03:21Z

Test build #134991 has finished for PR 31499 at commit 79ec7a1.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

MaxGekk · 2021-02-10T05:45:16Z

@cloud-fan @HyukjinKwon Any objections to the changes?

MaxGekk · 2021-02-10T06:16:28Z

@dongjoon-hyun @viirya Are you ok with the changes?

dongjoon-hyun · 2021-02-13T00:18:36Z

Sorry for being late, @MaxGekk . I'll take a look at this during weekend.

dongjoon-hyun · 2021-02-13T00:20:24Z

~~I added me as a reviewer in order not to forget this.~~ It doesn't work as expected. I assigned it to myself.

dongjoon-hyun · 2021-02-15T16:05:47Z

docs/sql-ref-syntax-ddl-repair-table.md

@@ -37,6 +37,13 @@ MSCK REPAIR TABLE table_identifier

    **Syntax:** `[ database_name. ] table_name`

+* **`[[ADD|DROP|SYNC] PARTITIONS]`**


Is the syntax and function aiming to be identical with HIVE-17824?

the syntax is from to the SQL standard but functionality is from Hive.

dongjoon-hyun · 2021-02-15T16:12:39Z

docs/sql-ref-syntax-ddl-repair-table.md

@@ -37,6 +37,13 @@ MSCK REPAIR TABLE table_identifier

    **Syntax:** `[ database_name. ] table_name`

+* **`[[ADD|DROP|SYNC] PARTITIONS]`**
+
+    * If the option is not specified, `MSCK REPAIR TABLE` adds partitions to the Hive external catalog only.


the option sounds a little mismatched because this is a SQL syntax. Are you mentioned the optional syntaxes like this in our SQL docs?

I will remove the option, I found it in another command: http://spark.apache.org/docs/latest/sql-ref-syntax-aux-analyze-table.html

If no analyze option is specified, ANALYZE TABLE collects ...

but docs for other commands say If specified, ...

dongjoon-hyun · 2021-02-15T16:14:03Z

docs/sql-ref-syntax-ddl-repair-table.md

+* **`[[ADD|DROP|SYNC] PARTITIONS]`**
+
+    * If the option is not specified, `MSCK REPAIR TABLE` adds partitions to the Hive external catalog only.
+    * **ADD**, the command adds new partitions in the catalog for all sub-folder in the base table folder that don't belong to any table partitions.


Like line 42 (before this line) and line 44 (after this line), the catalog -> the Hive external catalog consistently?

Actually, the command calls the session catalog which is an internal catalog servers as a proxy to an external catalog (In-Memory or Hive). Strictly speaking, the command adds/drops partitions in the session catalog. Let me update the doc to be more precise.

dongjoon-hyun · 2021-02-15T16:14:55Z

sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

@@ -229,7 +229,8 @@ statement
    | LOAD DATA LOCAL? INPATH path=STRING OVERWRITE? INTO TABLE
        multipartIdentifier partitionSpec?                             #loadData
    | TRUNCATE TABLE multipartIdentifier partitionSpec?                #truncateTable
-    | MSCK REPAIR TABLE multipartIdentifier                            #repairTable
+    | MSCK REPAIR TABLE multipartIdentifier
+      (option=(ADD|DROP|SYNC) PARTITIONS)?                             #repairTable


indentation?

MaxGekk · 2021-02-15T17:32:59Z

@dongjoon-hyun Thank you for reviewing this PR. Regarding to syntax for alternatives, I wasn't sure what should I use in docs. I just looked at existing examples:

ANALYZE TABLE (similar in EXPLAIN)

In docs (link):

[ NOSCAN | FOR COLUMNS col [ , ... ] | FOR ALL COLUMNS ]

In SqlBase.g4:

spark/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

Line 136 in ba974ea

(identifier | FOR COLUMNS identifierSeq | FOR ALL COLUMNS)? #analyze

SHOW TABLES

In docs (link)

{ FROM | IN }

In SqlBase.g4:

spark/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

Line 198 in ba974ea

| SHOW TABLES ((FROM | IN) multipartIdentifier)?

You proposed (ADD|DROP|SYNC) but I haven't found any examples with such syntax. Do you know what the syntax the Spark SQL guide uses?

dongjoon-hyun · 2021-02-15T18:13:52Z

For the first your example, [ NOSCAN | FOR COLUMNS col [ , ... ] | FOR ALL COLUMNS ] means we can omit all. So, we cannot write like that here.
For the second example, you mean {} is correct for this case because ( and ) is used as literal. Did I understand correctly?

+1 for your suggestion (2).

MaxGekk · 2021-02-15T19:20:29Z

@dongjoon-hyun I have looked at the SQL standard, it uses both notions:

{ UTF8 | UTF16 | UTF32}
GENERATED { ALWAYS | BY DEFAULT } AS IDENTITY

and

[ INSTANCE | STATIC | CONSTRUCTOR ] METHOD

It seems {alternative1 | alternative2 } means one of the alternatives must be specified, [alternative1 | alternative2] - both are optional.

I do believe we should use the syntax MSCK REPAIR TABLE .. [ { ADD | DROP | SYNC } PARTITIONS ] in docs/comments.

SparkQA · 2021-02-16T11:54:08Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39756/

SparkQA · 2021-02-16T13:30:29Z

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39756/

SparkQA · 2021-02-16T15:35:00Z

Test build #135175 has finished for PR 31499 at commit 7b9ee52.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala

MaxGekk · 2021-02-22T05:38:21Z

@dongjoon-hyun Could you take a look at this PR one more time, please.

dongjoon-hyun · 2021-02-23T04:34:17Z

Oops. Sorry, @MaxGekk . Could you rebase to the master once more please?

dongjoon-hyun · 2021-02-23T04:42:16Z

sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala

+      dropPartSpecs,
+      ignoreIfNotExists = true,
+      purge = false,
+      retainData = true)


Could you add a comment about the reason why we use retainData=true? I guess the reason is that fs.exists(..) is already false and we don't want addition file system calls. Did I understand correctly?

... we don't want addition file system calls. Did I understand correctly?

Yep, if we set retainData to true, the deleteData flag will false at https://github.com/apache/hive/blob/release-3.1.3-rc0/standalone-metastore/src/main/java/org/apache/hadoop/hive/metastore/HiveMetaStore.java#L4360-L4378 . So, Hive MeteStore will not try to delete the partition folders.

The same for the In-Memory catalog:

spark/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/InMemoryCatalog.scala

Lines 464 to 473 in bfc0235

if (existingParts.contains(p) && shouldRemovePartitionLocation) {

val partitionPath = new Path(existingParts(p).location)

try {

val fs = partitionPath.getFileSystem(hadoopConfig)

fs.delete(partitionPath, true)

} catch {

case e: IOException =>

throw QueryExecutionErrors.unableToDeletePartitionPathError(partitionPath, e)

}

}

dongjoon-hyun

+1, LGTM with one minor comment about adding comment.
Let's rebase and see the CI result.

…artitions # Conflicts: # sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLCommandTestUtils.scala

SparkQA · 2021-02-23T11:23:33Z

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39954/

SparkQA · 2021-02-23T11:49:16Z

Kubernetes integration test status success
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/39954/

SparkQA · 2021-02-23T14:52:55Z

Test build #135374 has finished for PR 31499 at commit fefea57.

This patch passes all tests.
This patch merges cleanly.
This patch adds no public classes.

dongjoon-hyun · 2021-02-23T21:44:31Z

Thank you for updating, @MaxGekk !

dongjoon-hyun · 2021-02-23T21:46:18Z

Merged to master for Apache Spark 3.2.0.

cloud-fan · 2021-02-24T05:51:56Z

docs/sql-ref-syntax-ddl-repair-table.md

@@ -39,6 +39,13 @@ MSCK REPAIR TABLE table_identifier

    **Syntax:** `[ database_name. ] table_name`

+* **`{ADD|DROP|SYNC} PARTITIONS`**
+
+    * If specified, `MSCK REPAIR TABLE` only adds partitions to the session catalog.


typo: should be If not specified.

I think it's better to put it in the end, and say If not specified, ADD is the default.

Here is the PR #31633

cloud-fan · 2021-02-24T06:00:30Z

sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/MsckRepairTableSuite.scala

+      checkPartitions(t, Map("part" -> "1"), Map("part" -> "2"))
+      checkAnswer(sql(s"SELECT col, part FROM $t"), Seq(Row(1, 1), Row(0, 2)))
+    }
+  }


shall we test ADD?

We already have many tests for ADD in AlterTableRecoverPartitionsSuite since ALTER TABLE .. RECOVER PARTITIONS is equal to MSCK REPAIR TABLE .. ADD PARTITIONS semantically.

@cloud-fan If you would like to test MSCK REPAIR TABLE .. ADD PARTITIONS explicitly, we could mix the v1.AlterTableRecoverPartitionsSuiteBase to MsckRepairTableSuiteBase to run the existing tests automatically.

cloud-fan · 2021-02-24T06:00:52Z

late LGTM

…pairTableCommand` ### What changes were proposed in this pull request? Rename the execution node `AlterTableRecoverPartitionsCommand` for the commands: - `MSCK REPAIR TABLE table [{ADD|DROP|SYNC} PARTITIONS]` - `ALTER TABLE table RECOVER PARTITIONS` to `RepairTableCommand`. ### Why are the changes needed? 1. After the PR #31499, `ALTER TABLE table RECOVER PARTITIONS` is equal to `MSCK REPAIR TABLE table ADD PARTITIONS`. And mapping of the generic command `MSCK REPAIR TABLE` to the more specific execution node `AlterTableRecoverPartitionsCommand` can confuse devs in the future. 2. `ALTER TABLE table RECOVER PARTITIONS` does not support any options/extensions. So, additional parameters `enableAddPartitions` and `enableDropPartitions` in `AlterTableRecoverPartitionsCommand` confuse as well. ### Does this PR introduce _any_ user-facing change? No because this is internal API. ### How was this patch tested? By running the existing test suites: ``` $ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *AlterTableRecoverPartitionsSuite" $ build/sbt "test:testOnly *AlterTableRecoverPartitionsParserSuite" $ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *MsckRepairTableSuite" $ build/sbt "test:testOnly *MsckRepairTableParserSuite" ``` Closes #31635 from MaxGekk/rename-recover-partitions. Authored-by: Max Gekk <[email protected]> Signed-off-by: Wenchen Fan <[email protected]>

…TITIONS]` ### What changes were proposed in this pull request? In the PR, I propose to extend the `MSCK REPAIR TABLE` command, and support new options `{ADD|DROP|SYNC} PARTITIONS`. In particular: 1. Extend the logical node `RepairTable`, and add two new flags `enableAddPartitions` and `enableDropPartitions`. 2. Add similar flags to the v1 execution node `AlterTableRecoverPartitionsCommand` 3. Add new method `dropPartitions()` to `AlterTableRecoverPartitionsCommand` which drops partitions from the catalog if their locations in the file system don't exist. 4. Updated public docs about the `MSCK REPAIR TABLE` command: <img width="1037" alt="Screenshot 2021-02-16 at 13 46 39" src="https://user-images.githubusercontent.com/1580697/108052607-7446d280-705d-11eb-8e25-7398254787a4.png"> Closes apache#31097 ### Why are the changes needed? - The changes allow to recover tables with removed partitions. The example below portraits the problem: ```sql spark-sql> create table tbl2 (col int, part int) partitioned by (part); spark-sql> insert into tbl2 partition (part=1) select 1; spark-sql> insert into tbl2 partition (part=0) select 0; spark-sql> show table extended like 'tbl2' partition (part = 0); default tbl2 false Partition Values: [part=0] Location: file:/Users/maximgekk/proj/apache-spark/spark-warehouse/tbl2/part=0 ... ``` Remove the partition (part = 0) from the filesystem: ``` $ rm -rf /Users/maximgekk/proj/apache-spark/spark-warehouse/tbl2/part=0 ``` Even after recovering, we cannot query the table: ```sql spark-sql> msck repair table tbl2; spark-sql> select * from tbl2; 21/01/08 22:49:13 ERROR SparkSQLDriver: Failed in [select * from tbl2] org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: file:/Users/maximgekk/proj/apache-spark/spark-warehouse/tbl2/part=0 ``` - To have feature parity with Hive: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-RecoverPartitions(MSCKREPAIRTABLE) ### Does this PR introduce _any_ user-facing change? Yes. After the changes, we can query recovered table: ```sql spark-sql> msck repair table tbl2 sync partitions; spark-sql> select * from tbl2; 1 1 spark-sql> show partitions tbl2; part=1 ``` ### How was this patch tested? - By running the modified test suite: ``` $ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *MsckRepairTableParserSuite" $ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *PlanResolutionSuite" $ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *AlterTableRecoverPartitionsSuite" $ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *AlterTableRecoverPartitionsParallelSuite" ``` - Added unified v1 and v2 tests for `MSCK REPAIR TABLE`: ``` $ build/sbt -Phive-2.3 -Phive-thriftserver "test:testOnly *MsckRepairTableSuite" ``` Closes apache#31499 from MaxGekk/repair-table-drop-partitions. Authored-by: Max Gekk <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>

Support MSCK REPAIR TABLE .. (ADD|DROP|SYNC) PARTITIONS

c313bdb

github-actions bot added the SQL label Feb 6, 2021

Document the SYNC keyword

1168390

github-actions bot added the DOCS label Feb 7, 2021

MaxGekk added 4 commits February 7, 2021 18:53

Unified tests

76fe1e7

Update docs

b5a4bab

Minor

dfc03ee

Add empty line at end of a file

79ec7a1

MaxGekk changed the title ~~[WIP][SPARK-31891][SQL] Support MSCK REPAIR TABLE .. (ADD|DROP|SYNC) PARTITIONS~~ [SPARK-31891][SQL] Support MSCK REPAIR TABLE .. [ADD|DROP|SYNC] PARTITIONS Feb 7, 2021

dongjoon-hyun self-requested a review February 13, 2021 00:19

dongjoon-hyun removed their request for review February 13, 2021 00:21

dongjoon-hyun self-assigned this Feb 13, 2021

dongjoon-hyun reviewed Feb 15, 2021

View reviewed changes

MaxGekk changed the title ~~[SPARK-31891][SQL] Support MSCK REPAIR TABLE .. [ADD|DROP|SYNC] PARTITIONS~~ [SPARK-31891][SQL] Support MSCK REPAIR TABLE .. [{ ADD | DROP |SYNC } PARTITIONS] Feb 16, 2021

MaxGekk changed the title ~~[SPARK-31891][SQL] Support MSCK REPAIR TABLE .. [{ ADD | DROP |SYNC } PARTITIONS]~~ [SPARK-31891][SQL] Support MSCK REPAIR TABLE .. [{ADD|DROP|SYNC} PARTITIONS] Feb 16, 2021

Address Dongjoon's review comments

7b9ee52

MaxGekk commented Feb 18, 2021

View reviewed changes

sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala Show resolved Hide resolved

dongjoon-hyun reviewed Feb 23, 2021

View reviewed changes

dongjoon-hyun approved these changes Feb 23, 2021

View reviewed changes

MaxGekk added 3 commits February 23, 2021 12:19

Merge remote-tracking branch 'origin/master' into repair-table-drop-p…

20cd456

…artitions # Conflicts: # sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLCommandTestUtils.scala

Add a comment for retainData = true

0cf0574

Fix comment

fefea57

dongjoon-hyun closed this in 7f27d33 Feb 23, 2021

cloud-fan reviewed Feb 24, 2021

View reviewed changes

MaxGekk mentioned this pull request Feb 24, 2021

[SPARK-34518][SQL] Rename AlterTableRecoverPartitionsCommand to RepairTableCommand #31635

Closed

dongjoon-hyun removed their assignment Apr 22, 2021

		@@ -37,6 +37,13 @@ MSCK REPAIR TABLE table_identifier

		Syntax: `[ database_name. ] table_name`

		* `[[ADD\|DROP\|SYNC] PARTITIONS]`

	if (existingParts.contains(p) && shouldRemovePartitionLocation) {
	val partitionPath = new Path(existingParts(p).location)
	try {
	val fs = partitionPath.getFileSystem(hadoopConfig)
	fs.delete(partitionPath, true)
	} catch {
	case e: IOException =>
	throw QueryExecutionErrors.unableToDeletePartitionPathError(partitionPath, e)
	}
	}

[SPARK-31891][SQL] Support MSCK REPAIR TABLE .. [{ADD|DROP|SYNC} PARTITIONS] #31499

[SPARK-31891][SQL] Support MSCK REPAIR TABLE .. [{ADD|DROP|SYNC} PARTITIONS] #31499

Conversation

MaxGekk commented Feb 6, 2021 • edited Loading

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

SparkQA commented Feb 6, 2021

SparkQA commented Feb 6, 2021

SparkQA commented Feb 7, 2021

SparkQA commented Feb 7, 2021

SparkQA commented Feb 7, 2021

SparkQA commented Feb 7, 2021

MaxGekk commented Feb 7, 2021

SparkQA commented Feb 7, 2021

SparkQA commented Feb 7, 2021

SparkQA commented Feb 7, 2021

MaxGekk commented Feb 10, 2021

MaxGekk commented Feb 10, 2021

dongjoon-hyun commented Feb 13, 2021

dongjoon-hyun commented Feb 13, 2021 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

MaxGekk commented Feb 15, 2021 • edited Loading

dongjoon-hyun commented Feb 15, 2021

MaxGekk commented Feb 15, 2021

SparkQA commented Feb 16, 2021

SparkQA commented Feb 16, 2021

SparkQA commented Feb 16, 2021

MaxGekk commented Feb 22, 2021

dongjoon-hyun commented Feb 23, 2021

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

dongjoon-hyun left a comment

Choose a reason for hiding this comment

SparkQA commented Feb 23, 2021

SparkQA commented Feb 23, 2021

SparkQA commented Feb 23, 2021

dongjoon-hyun commented Feb 23, 2021

dongjoon-hyun commented Feb 23, 2021

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

MaxGekk Feb 24, 2021 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

MaxGekk Feb 24, 2021 • edited Loading

Choose a reason for hiding this comment

Choose a reason for hiding this comment

cloud-fan commented Feb 24, 2021

[SPARK-31891][SQL] Support `MSCK REPAIR TABLE .. [{ADD|DROP|SYNC} PARTITIONS]` #31499

[SPARK-31891][SQL] Support `MSCK REPAIR TABLE .. [{ADD|DROP|SYNC} PARTITIONS]` #31499

MaxGekk commented Feb 6, 2021 •

edited

Loading

dongjoon-hyun commented Feb 13, 2021 •

edited

Loading

MaxGekk commented Feb 15, 2021 •

edited

Loading

MaxGekk Feb 24, 2021 •

edited

Loading

MaxGekk Feb 24, 2021 •

edited

Loading