Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] [seatunnel-core-spark] Spark userClassPathFirst classloader not working #2474

Closed
2 of 3 tasks
hailin0 opened this issue Aug 19, 2022 · 3 comments
Closed
2 of 3 tasks

Comments

@hailin0
Copy link
Member

hailin0 commented Aug 19, 2022

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

userClassPathFirst classloader not working when running spark connector-v2 e2e

SeaTunnel Version

dev branch

SeaTunnel Config

env {
    ...
    spark.executor.userClassPathFirst = true
    spark.driver.userClassPathFirst = true
}

source {..}
sink {...}

Running Command

running spark e2e

Error Exception

logger package conflict

Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

企业微信截图_0f00d02f-b56f-4db8-a39a-b9c9d71b495c

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@hailin0 hailin0 added the bug label Aug 19, 2022
@hailin0
Copy link
Member Author

hailin0 commented Aug 19, 2022

Maybe it's related to our use of maven-shade-plugin to package log4j

@github-actions
Copy link

github-actions bot commented Jan 2, 2023

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

@github-actions github-actions bot added the stale label Jan 2, 2023
@github-actions
Copy link

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant