[Discuss][seatunnel-api] How can a user-defined ConfigShade class load external files

[wntp]

Search before asking

• I had searched in the feature and found no similar feature requirement.

Description

In our scenario, we need to override ConfigShade to implement our custom encryption and decryption methods. However, while simple encryption and decryption can be achieved by overriding ConfigShade, we have found that if the encryption and decryption tools depend on external decryption files, there is currently no particularly effective way to load these decryption files.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[litiliu]

Could you give an example of your use case? Does the external decryption files mean local file? If yes, you should be able to read it in the encrypt/decrypt method using the FileInputStream.

[wntp]

Could you give an example of your use case? Does the external decryption files mean local file? If yes, you should be able to read it in the encrypt/decrypt method using the FileInputStream.

When dealing with encryption and decryption methods, the current issue is figuring out a particularly elegant way to pass file paths.

[litiliu]

I think we can add a param named shade.props in the values env block, like this
"env": { "jobMode": "batch", "parallelism": 1, "shade.identifier": "base64", "shade.props": { "userKey1": "userValue1", "userKey2": "userValue2" } },

and call method to load the shade.props before decrypt/encrypt