[Bug report] Log4jLoggerFactory package conflict when running on spark 3.3 #3320
Assignees
Labels
bug
Something isn't working
Comments
jerryshao
pushed a commit
that referenced
this issue
May 10, 2024
### What changes were proposed in this pull request? shadow slf4j for client-java-runtime and spark-connector-runtime ### Why are the changes needed? some systems like spark 3.3 need low version log4j, will encounter the conflict bug: ``` java.lang.NoSuchMethodError: org.apache.logging.slf4j.Log4jLoggerFactory: method 'void <init>()' not found ``` fix: #3320 ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? existing tests
github-actions bot
pushed a commit
that referenced
this issue
May 10, 2024
### What changes were proposed in this pull request? shadow slf4j for client-java-runtime and spark-connector-runtime ### Why are the changes needed? some systems like spark 3.3 need low version log4j, will encounter the conflict bug: ``` java.lang.NoSuchMethodError: org.apache.logging.slf4j.Log4jLoggerFactory: method 'void <init>()' not found ``` fix: #3320 ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? existing tests
FANNG1
added a commit
that referenced
this issue
May 10, 2024
### What changes were proposed in this pull request? shadow slf4j for client-java-runtime and spark-connector-runtime ### Why are the changes needed? some systems like spark 3.3 need low version log4j, will encounter the conflict bug: ``` java.lang.NoSuchMethodError: org.apache.logging.slf4j.Log4jLoggerFactory: method 'void <init>()' not found ``` fix: #3320 ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? existing tests Co-authored-by: FANNG <[email protected]>
6 tasks
diqiu50
pushed a commit
to diqiu50/gravitino
that referenced
this issue
Jun 13, 2024
…he#3318) ### What changes were proposed in this pull request? shadow slf4j for client-java-runtime and spark-connector-runtime ### Why are the changes needed? some systems like spark 3.3 need low version log4j, will encounter the conflict bug: ``` java.lang.NoSuchMethodError: org.apache.logging.slf4j.Log4jLoggerFactory: method 'void <init>()' not found ``` fix: apache#3320 ### Does this PR introduce _any_ user-facing change? no ### How was this patch tested? existing tests
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Version
main branch
Describe what's wrong
run spark connector with spark 3.3 failed because of Log4jLoggerFactory package conflict, the slf4j packaged in
Gravitino-java-runtimeis 2.0.9, while spark 3.3 relies on1.7.32Error message and/or stacktrace
How to reproduce
run with spark 3.3
Additional context
No response
The text was updated successfully, but these errors were encountered: