Skip to content

Release Spark Connector 2.11.3
Compare
Choose a tag to compare
@sfc-gh-mrui sfc-gh-mrui released this 21 Apr 16:23
· 32 commits to master since this release
v2.11.3-spark_3.3
812ace9

Updated the mechanism for writing DataFrames to accounts on GCP:

  1. Updated the mechanism for writing DataFrames to accounts on GCP. After December 2023, previous versions of the Spark Connector will no longer be able to write DataFrames, due to changes in GCP.
  2. Added the option to disable preactions and postactions validation for session sharing.
    • To disable validation, set the option FORCE_SKIP_PRE_POST_ACTION_CHECK_FOR_SHARED_SESSION to true. The default is false.
    • Important: Before setting this option, make sure that the queries in preactions and postactions don't affect the session settings. Otherwise, you may encounter issues with results.
  3. Fixed an issue when performing a join or union across different schemas when the two DataFrames are accessing tables with different sfSchema and the same name table in sfSchema is in the left DataFrame.
  4. Updated the connector to use the Snowflake JDBC driver 3.13.30.
Assets 2
Loading