Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-48413][SQL][FOLLOW-UP] Fix ALTER COLUMN with collation #48582

Closed
wants to merge 4 commits into from

Conversation

jovanm-db
Copy link
Contributor

@jovanm-db jovanm-db commented Oct 21, 2024

What changes were proposed in this pull request?

Fixing the analysis check error introduced in this PR, where the ALTER COLUMN command would fail on tables that contain catalog in their names, ensuring consistent behavior across all table naming conventions.

Why are the changes needed?

Change is needed to enable altering column with all datasources and identifier variations.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Added tests to CollationSuite.

Was this patch authored or co-authored using generative AI tooling?

No.

@github-actions github-actions bot added the SQL label Oct 21, 2024
Copy link
Contributor

@stefankandic stefankandic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please explain you change a bit more in the PR description

@@ -516,6 +516,16 @@ class CollationSuite extends DatasourceV2SQLBase with AdaptiveSparkPlanHelper {
}
}

test("SPARK-48413: Alter column with collation") {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can we also add tests for complex types (struct, map, array)?

@MaxGekk
Copy link
Member

MaxGekk commented Oct 22, 2024

+1, LGTM. Merging to master.
Thank you, @jovanm-db and @mihailom-db @stefankandic for review.

@MaxGekk MaxGekk closed this in 6e3dcdb Oct 22, 2024
ericm-db pushed a commit to ericm-db/spark that referenced this pull request Oct 22, 2024
### What changes were proposed in this pull request?
Fixing the analysis check error introduced in [this](apache#46734) PR, where the `ALTER COLUMN` command would fail on tables that contain catalog in their names, ensuring consistent behavior across all table naming conventions.

### Why are the changes needed?
Change is needed to enable altering column with all datasources and identifier variations.

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Added tests to `CollationSuite`.

### Was this patch authored or co-authored using generative AI tooling?
No.

Closes apache#48582 from jovanm-db/alterColumn.

Authored-by: Jovan Markovic <[email protected]>
Signed-off-by: Max Gekk <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants