Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Bug report] spark connector create hive table failed for using hive #3129

Closed
FANNG1 opened this issue Apr 23, 2024 · 0 comments · Fixed by #3169
Closed

[Bug report] spark connector create hive table failed for using hive #3129

FANNG1 opened this issue Apr 23, 2024 · 0 comments · Fixed by #3169
Assignees
@FANNG1
Labels
bug Something isn't working
Milestone
Gravitino June Re...

Comments

@FANNG1
Copy link
Contributor

FANNG1 commented Apr 23, 2024

Version

main branch

Describe what's wrong

failed to create hive table

Error message and/or stacktrace

Doesn't support hive file format: hive
javax.ws.rs.NotSupportedException: Doesn't support hive file format: hive
	at com.datastrato.gravitino.spark.connector.hive.HivePropertiesConverter.toGravitinoTableProperties(HivePropertiesConverter.java:81)
	at com.datastrato.gravitino.spark.connector.catalog.BaseCatalog.createTable(BaseCatalog.java:177)
	at org.apache.spark.sql.execution.datasources.v2.CreateTableExec.run(CreateTableExec.scala:44)
	at org.apache.spark.sql.execution.datasources.v2.V2CommandExec.result$lzycompute(V2CommandExec.scala:43)
	at org.apache.spark.sql.execution.datasources.v2.V2CommandExec.result(V2CommandExec.scala:43)
	at org.apache.spark.sql.execution.datasources.v2.V2CommandExec.executeCollect(V2CommandExec.scala:49)

How to reproduce

CREATE TABLE t1(aa int) using hive;

Additional context

No response
@FANNG1 FANNG1 added the bug Something isn't working label Apr 23, 2024
@FANNG1 FANNG1 mentioned this issue Apr 24, 2024
Merged
@FANNG1 FANNG1 self-assigned this Apr 24, 2024
@jerryshao jerryshao added this to the Gravitino June Release milestone Apr 24, 2024
qqqttt123 pushed a commit that referenced this issue Apr 24, 2024
@FANNG1
[#3129] fix(spark-connector): fix create table failed for using hive (#…
299e666 
…3169)

### What changes were proposed in this pull request?
transform `hive` provider to `text` format

### Why are the changes needed?
Fix: #3129 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
add UT and IT
github-actions bot pushed a commit that referenced this issue Apr 24, 2024
@FANNG1 @web-flow
[#3129] fix(spark-connector): fix create table failed for using hive (#…
2dfeefa 
…3169)

### What changes were proposed in this pull request?
transform `hive` provider to `text` format

### Why are the changes needed?
Fix: #3129 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
add UT and IT
@jerryshao jerryshao mentioned this issue Apr 24, 2024
Merged
jerryshao added a commit that referenced this issue Apr 24, 2024
@jerryshao @FANNG1
[#3129] fix(spark-connector): fix create table failed for using hive (#…
b7e5704 
…3182)

### What changes were proposed in this pull request?
transform `hive` provider to `text` format

### Why are the changes needed?
Fix: #3129 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
add UT and IT

Co-authored-by: FANNG <[email protected]>
diqiu50 pushed a commit to diqiu50/gravitino that referenced this issue Jun 13, 2024
@FANNG1 @diqiu50
[apache#3129] fix(spark-connector): fix create table failed for using…
a42b05a 
… hive (apache#3169)

### What changes were proposed in this pull request?
transform `hive` provider to `text` format

### Why are the changes needed?
Fix: apache#3129 

### Does this PR introduce _any_ user-facing change?
no

### How was this patch tested?
add UT and IT
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@FANNG1 FANNG1

Labels
bug Something isn't working
Projects
None yet
Milestone
Gravitino June Release
Development

Successfully merging a pull request may close this issue.

[#3129] fix(spark-connector): fix create table failed for using hive FANNG1/gravitino
2 participants
@jerryshao @FANNG1