[BUG] Log4j 1.x conflict with Databricks runtime version 11 which uses Log4j 2.x

[Yuqing-cat]

Willingness to contribute

Yes. I can contribute a fix for this bug independently.

Feathr version

0.10.4-rc1

System information

• OS Platform and Distribution (e.g., Linux Ubuntu 20.0):
• Python version:
• Spark version, if reporting runtime issue:

Describe the problem

Log4j version conflict causes the following problem:

Tracking information

No response

Code to reproduce bug

No response

What component(s) does this bug affect?

• Python Client: This is the client users use to interact with most of our API. Mostly written in Python.
• Computation Engine: The computation engine that execute the actual feature join and generation work. Mostly in Scala and Spark.
• Feature Registry API: The frontend API layer supports SQL, Purview(Atlas) as storage. The API layer is in Python(FAST API)
• Feature Registry Web UI: The Web UI for feature registry. Written in React