Add release notes for 0.285 #21500
Add release notes for 0.285 #21500
Conversation
|
Codenotify: Notifying subscribers in CODENOTIFY files for diff e718f7a...db0570f.
|
wanglinsong
force-pushed
the
release-notes-0.285
branch
from
23505ba to
a075444
Compare
|
@tdcmeehan @steveburnett please coordinate with the code contributor to review the release notes. |
There was a problem hiding this comment.
@wanglinsong some comments. I will review the issues you linked in the PR.
I will also be coordinating with the code contributors for missing release notes.
|
|
||
| Prestissimo (native Execution) Changes | ||
| ______________________________________ | ||
| * Add support for internal authentication using JWT. It can be configured using configs "internal-communication.jwt.enabled=[true/false]", "internal-communication.shared-secret=<shared-secret-value>" and "internal-communication.jwt.expiration-seconds=<value in seconds>". |
There was a problem hiding this comment.
Let's add a link to the JWT documentation.
There was a problem hiding this comment.
@nmahadevuni Please update.
There was a problem hiding this comment.
@czentgr Can you update the Prestissimo doc ?
There was a problem hiding this comment.
The option is documented at
../develop/presto-native.rst. This contains a list of options for prestissimo.
The actual link with anchor should be
../develop/presto-native.html#jwt-authentication-support.
Do I need to do anything else?
|
|
||
| Hive Changes | ||
| ____________ | ||
| * Changes in ParquetPageSourceFactory so that the type-check does not fail with the new widenings supported. |
There was a problem hiding this comment.
We need to fix this statement. It is not clear what changes were made and what new widenings mean.
There was a problem hiding this comment.
@aaneja can you update this?
There was a problem hiding this comment.
The general change this is part of is already mentioned ' Added type widening support to the parquet column readers (int, bigint, and float) to be able to perform type conversions between inmediate numerical types.'
This release note for a class level change is not needed, IMO
| Hive Changes | ||
| ____________ | ||
| * Changes in ParquetPageSourceFactory so that the type-check does not fail with the new widenings supported. | ||
| * Support for Parquet writer versions V1 and V2 is now added for Hive and Iceberg catalogs. It can be toggled using session property `parquet_writer_version` and config property `hive.parquet.writer.version`. Valid values for these properties are PARQUET_1_0 and PARQUET_2_0. Default is PARQUET_2_0. E.g., set session parquet_writer_version=PARQUET_1_0 / hive.parquet.writer.version=PARQUET_1_0. |
There was a problem hiding this comment.
Support Parquet writer versions V1 and V2 in Hive and Iceberg catalogs.
Let's add a link to the document for the config.
There was a problem hiding this comment.
@nmahadevuni can you update the hive/iceberg connector docs?
| Hive Changes | ||
| ____________ | ||
| * Changes in ParquetPageSourceFactory so that the type-check does not fail with the new widenings supported. | ||
| * Support for Parquet writer versions V1 and V2 is now added for Hive and Iceberg catalogs. It can be toggled using session property `parquet_writer_version` and config property `hive.parquet.writer.version`. Valid values for these properties are PARQUET_1_0 and PARQUET_2_0. Default is PARQUET_2_0. E.g., set session parquet_writer_version=PARQUET_1_0 / hive.parquet.writer.version=PARQUET_1_0. |
There was a problem hiding this comment.
@nmahadevuni can you update the hive/iceberg connector docs?
|
|
||
| Prestissimo (native Execution) Changes | ||
| ______________________________________ | ||
| * Add support for internal authentication using JWT. It can be configured using configs "internal-communication.jwt.enabled=[true/false]", "internal-communication.shared-secret=<shared-secret-value>" and "internal-communication.jwt.expiration-seconds=<value in seconds>". |
There was a problem hiding this comment.
@nmahadevuni Please update.
|
|
||
| Hive Changes | ||
| ____________ | ||
| * Changes in ParquetPageSourceFactory so that the type-check does not fail with the new widenings supported. |
There was a problem hiding this comment.
@aaneja can you update this?
|
Closing in favor of #21579 |
Missing Release Notes
Avinash Jain
Beinan
Bikramjeet Vig
JiamingMai
Jimmy Lu
Ke
Kevin Wilfong
Lyublena Antova
Pratyush Verma
Sotirios Delimanolis
Zac Blanco
kedia,Akanksha
xiaoxmeng
Extracted Release Notes
enable_hbo_for_scaled_writerand default to false.task.memory-based-slowdown-threshold.parquet_writer_versionand config propertyhive.parquet.writer.version. Valid values for these properties are PARQUET_1_0 and PARQUET_2_0. Default is PARQUET_2_0. E.g., set session parquet_writer_version=PARQUET_1_0 / hive.parquet.writer.version=PARQUET_1_0.DELETE FROM <table> [where <filter>]statements to delete one or more entire partitions.remove_redundant_cast_to_varchar_in_joinand enabled by default.history_input_table_statistics_matching_thresholdto set the threshold for input statistics match in HBO.ALTER TABLE <table> ADD COLUMN <column> [WITH (partitioning = '<transform_func>')]statements to indicate partition transform when add column to table.experimental.task.high-memory-task-killer-enabled. There are two strategies for the task killer which can be set viaexperiemental.task.high-memory-task-killer-strategy. (default:FREE_MEMORY_ON_FULL_GC,FREE_MEMORY_ON_FREQUENT_FULL_GC).experimental.task.high-memory-task-killer-heap-memory-thresholdand Full GC reclaim memory threhold is set byexperimental.task.high-memory-task-killer-reclaim-memory-threshold.experimental.task.high-memory-task-killer-frequent-full-gc-duration-thresholdand reclaim memory threshold is configured viaexperimental.task.high-memory-task-killer-reclaim-memory-threshold.@babel/traversenpm package #21322 (Author: Yihong Wang): Solve critical vulnerability of Presto UI from@babel/traversenpm packageexperiemental.task.high-memory-task-killer-strategytoexperimental.task.high-memory-task-killer-stragtegy.All Commits