CHANGELOG.md

Changelog

41.0.0 (2023-06-02)

Full Changelog

Breaking changes:

• Rename list contains kernels to in_list (#4289) #4342 [parquet] [arrow] (tustvold)
• Move BooleanBufferBuilder and NullBufferBuilder to arrow_buffer #4338 [arrow] (tustvold)
• Add separate row_count and level_count to PageMetadata (#4321) #4326 [parquet] (tustvold)
• Treat legacy TIMSETAMP_X converted types as UTC #4309 [parquet] (sergiimk)
• Simplify parquet PageIterator #4306 [parquet] (tustvold)
• Add Builder style APIs and docs for FlightData, FlightInfo, FlightEndpoint, Locaation and Ticket #4294 [arrow] [arrow-flight] (alamb)
• Make GenericColumnWriter Send #4287 [parquet] (tustvold)
• feat: update flight-sql to latest specs #4250 [arrow] [arrow-flight] (roeap)
• feat(api!): make ArrowArrayStreamReader Send #4232 [arrow] (wjones127)

Implemented enhancements:

• Make SerializedRowGroupReader::new() Public #4330 [parquet]
• Speed up i256 division and remainder operations #4302 [arrow]
• export function parquet_to_array_schema_and_fields #4298 [parquet]
• FLightSQL: add helpers to create CommandGetCatalogs, CommandGetSchemas, and CommandGetTables requests #4295 [arrow] [arrow-flight]
• Make ColumnWriter Send #4286 [parquet]
• Add Builder for FlightInfo to make it easier to create new requests #4281 [arrow] [arrow-flight]
• Support Writing/Reading Decimal256 to/from Parquet #4264 [parquet]
• FlightSQL: Add helpers to create CommandGetSqlInfo responses (SqlInfoValue and builders) #4256 [arrow] [arrow-flight]
• Update flight-sql implementation to latest specs #4249 [arrow] [arrow-flight]
• Make ArrowArrayStreamReader Send #4222 [arrow]
• Support writing FixedSizeList to Parquet #4214 [parquet]
• Cast between Intervals #4181 [arrow]
• Splice Parquet Data #4155 [parquet]
• CSV Schema More Flexible Timestamp Inference #4131 [arrow]

Fixed bugs:

• Doc for arrow_flight::sql is missing enums that are Xdbc related #4339 [arrow] [arrow-flight]
• concat_batches panics with total_len <= bit_len assertion for records with lists #4324 [arrow]
• Incorrect PageMetadata Row Count returned for V1 DataPage #4321 [parquet]
• [parquet] Not following the spec for TIMESTAMP_MILLIS legacy converted types #4308 [parquet]
• ambiguous glob re-exports of contains_utf8 #4289 [parquet] [arrow]
• flight_sql_client --header "key: value" yields a value with a leading whitespace #4270 [arrow] [arrow-flight]
• Casting Timestamp to date is off by one day for dates before 1970-01-01 #4211 [arrow]

Merged pull requests:

• Don't infer 16-byte decimal as decimal256 #4349 [parquet] (tustvold)
• Fix MutableArrayData::extend_nulls (#1230) #4343 [arrow] (tustvold)
• Update FlightSQL metadata locations, names and docs #4341 [arrow] [arrow-flight] (alamb)
• chore: expose Xdbc related FlightSQL enums #4340 [arrow] [arrow-flight] (appletreeisyellow)
• Update pyo3 requirement from 0.18 to 0.19 #4335 [arrow] (dependabot[bot])
• Skip unnecessary null checks in MutableArrayData #4333 [arrow] (tustvold)
• feat: add read parquet by custom rowgroup examples #4332 [parquet] (sundy-li)
• Make SerializedRowGroupReader::new() public #4331 [parquet] (burmecia)
• Don't split record across pages (#3680) #4327 [parquet] (tustvold)
• fix date conversion if timestamp below unixtimestamp #4323 [arrow] (comphead)
• Short-circuit on exhausted page in skip_records #4320 [parquet] (tustvold)
• Handle trailing padding when skipping repetition levels (#3911) #4319 [parquet] (tustvold)
• Use page_size consistently, deprecate pagesize in parquet WriterProperties #4313 [parquet] (alamb)
• Add roundtrip tests for Decimal256 and fix issues (#4264) #4311 [parquet] (tustvold)
• Expose page-level arrow reader API (#4298) #4307 [parquet] (tustvold)
• Speed up i256 division and remainder operations #4303 [arrow] (viirya)
• feat(flight): support int32_to_int32_list_map in sql infos #4300 [arrow] [arrow-flight] (roeap)
• feat(flight): add helpers to handle CommandGetCatalogs, CommandGetSchemas, and CommandGetTables requests #4296 [arrow] [arrow-flight] (roeap)
• Improve docs and tests for `SqlInfoList #4293 [arrow] [arrow-flight] (alamb)
• minor: fix arrow_row docs.rs links #4292 [arrow] (roeap)
• Update proc-macro2 requirement from =1.0.58 to =1.0.59 #4290 [arrow] [arrow-flight] (dependabot[bot])
• Improve ArrowWriter memory usage: Buffer Pages in ArrowWriter instead of RecordBatch (#3871) #4280 [parquet] (tustvold)
• Minor: Add more docstrings in arrow-flight #4279 [arrow] [arrow-flight] (alamb)
• Add Debug impls for ArrowWriter and SerializedFileWriter #4278 [parquet] (alamb)
• Expose RecordBatchWriter to arrow crate #4277 [arrow] (alexandreyc)
• Update criterion requirement from 0.4 to 0.5 #4275 [parquet] [arrow] (dependabot[bot])
• Add parquet-concat #4274 [parquet] (tustvold)
• Convert FixedSizeListArray to GenericListArray #4273 [arrow] (tustvold)
• feat: support 'Decimal256' for parquet #4272 [parquet] (Weijun-H)
• Strip leading whitespace from flight_sql_client custom header values #4271 [arrow] [arrow-flight] (mkmik)
• Add Append Column API (#4155) #4269 [parquet] (tustvold)
• Derive Default for WriterProperties #4268 [parquet] (tustvold)
• Parquet Reader/writer for fixed-size list arrays #4267 [parquet] (dexterduck)
• feat(flight): add sql-info helpers #4266 [arrow] [arrow-flight] (roeap)
• Convert parquet metadata back to builders #4265 [parquet] (tustvold)
• Add constructors for FixedSize array types (#3879) #4263 [arrow] (tustvold)
• Extract IPC ArrayReader struct #4259 [arrow] (tustvold)
• Update object_store requirement from 0.5 to 0.6 #4258 [parquet] (dependabot[bot])
• Support Absolute Timestamps in CSV Schema Inference (#4131) #4217 [arrow] (tustvold)
• feat: cast between Intervals #4182 [arrow] (izveigor)

* This Changelog was automatically generated by github_changelog_generator