Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Subtask] [spark-connector] support specifying scala version to build and test Gravitino #1530

Closed
Tracked by #1227
FANNG1 opened this issue Jan 16, 2024 · 0 comments
Closed
Tracked by #1227

[Subtask] [spark-connector] support specifying scala version to build and test Gravitino #1530

FANNG1 opened this issue Jan 16, 2024 · 0 comments
Assignees
@FANNG1
Milestone
Gravitino 0.4.0

Comments

@FANNG1
Copy link
Contributor

FANNG1 commented Jan 16, 2024

Describe the subtask

spark hive connector just supports scala 2.12, scala-related jars now just infect Iceberg.

Parent issue

#1227
@FANNG1 FANNG1 mentioned this issue Jan 17, 2024
Open
23 tasks
@FANNG1 FANNG1 changed the title [Subtask] downgrade scala related jars from 2.13 to 2.12 [Subtask] [spark-connector] downgrade scala related jars from 2.13 to 2.12 Jan 17, 2024
@FANNG1 FANNG1 mentioned this issue Jan 17, 2024
Merged
@FANNG1 FANNG1 added this to the Gravitino 0.4.0 milestone Jan 19, 2024
@FANNG1 FANNG1 changed the title [Subtask] [spark-connector] downgrade scala related jars from 2.13 to 2.12 [Subtask] [spark-connector] support specifying scala version to build and test Gravitino Jan 22, 2024
@FANNG1 FANNG1 self-assigned this Jan 22, 2024
FANNG1 added a commit that referenced this issue Jan 22, 2024
@FANNG1
[#1530] feat(spark-connector): support specifying scala version to bu…
27ce25b 
…ild and test Gravitino (#1582)

### What changes were proposed in this pull request?
support specify scala versions, by two methods:
1. `gradle build -PscalaVersion=xx`
2. set `defaultScalaVersion` in gradle.properties

method2 will be overwrite  by method1 if both existing, 
and supports scala 2.12 for now.

### Why are the changes needed?
spark hive connector just supports scala 2.12

Fix: #1530 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
existing UTs
@FANNG1 FANNG1 closed this as completed Jan 22, 2024
@FANNG1 FANNG1 mentioned this issue Feb 2, 2024
Closed
FANNG1 added a commit to FANNG1/gravitino that referenced this issue Feb 6, 2024
@FANNG1
[apache#1530] feat(spark-connector): support specifying scala version…
62b96c0 
… to build and test Gravitino (apache#1582)

### What changes were proposed in this pull request?
support specify scala versions, by two methods:
1. `gradle build -PscalaVersion=xx`
2. set `defaultScalaVersion` in gradle.properties

method2 will be overwrite  by method1 if both existing, 
and supports scala 2.12 for now.

### Why are the changes needed?
spark hive connector just supports scala 2.12

Fix: apache#1530 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
existing UTs
FANNG1 added a commit to FANNG1/gravitino that referenced this issue Feb 7, 2024
@FANNG1
[apache#1530] feat(spark-connector): support specifying scala version…
68a1318 
… to build and test Gravitino (apache#1582)

### What changes were proposed in this pull request?
support specify scala versions, by two methods:
1. `gradle build -PscalaVersion=xx`
2. set `defaultScalaVersion` in gradle.properties

method2 will be overwrite  by method1 if both existing, 
and supports scala 2.12 for now.

### Why are the changes needed?
spark hive connector just supports scala 2.12

Fix: apache#1530 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
existing UTs
@FANNG1 FANNG1 mentioned this issue Feb 7, 2024
Merged
FANNG1 added a commit that referenced this issue Feb 7, 2024
@FANNG1
[#1530] feat(spark-connector): support specifying scala version to bu…
3c6ac6d 
…ild and test Gravitino (#2131)

### What changes were proposed in this pull request? 
support specify scala versions, by two methods:
1. `gradle build -PscalaVersion=xx`
2. set `defaultScalaVersion` in gradle.properties

method2 will be overwrite by method1 if both existing, and supports
scala 2.12 for now.

### Why are the changes needed?
spark hive connector just supports scala 2.12

### Does this PR introduce _any_ user-facing change? no

### How was this patch tested?
existing UTs
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@FANNG1 FANNG1

Labels
None yet
Projects
None yet
Milestone
Gravitino 0.4.0
Development

No branches or pull requests
1 participant
@FANNG1