Cherry pick Allow proc-macro2 dependency to be flexible (#1102) #1105
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…atting with nightly (#845) (#850) * Clippy fixes * Test formatting fixes * Test formatting fixes * Fixup Co-authored-by: Daniël Heres <[email protected]>
fix readme with invalid markdown syntax Co-authored-by: Jiayu Liu <[email protected]>
* Use kernel utility for parsing timestamps in csvs. * Remove cruft. * Cleanup. * Lint. * Remove erroneous stringify. Co-authored-by: Navin <[email protected]>
…ublish) (#856) * fix parquet_derive with default features (and fix `cargo publish`) (#837) * Run all tests and do dry runs of cargo publish * Add test for building parquet derive with default features' * fix feature flags in parquet crate * fixup rat * fix default feature test * Update parquet_derive/test/dependency/default-features/Cargo.toml * Remove merge issue
* Implement boolean equality kernels * Respect offset * Simplify Co-authored-by: Daniël Heres <[email protected]>
…865) * fix(ipc): Support serializing structs containing dictionaries Dictionary fields nested in structs were not properly marked as dictionary fields when serializing to fb. * style: cargo fmt Co-authored-by: Helgi Kristvin Sigurbjarnarson <[email protected]>
Co-authored-by: Jiayu Liu <[email protected]>
The `value_offset` function only read the least significant byte in the offset array, causing issues with unions with more than 255 rows of any given variant. Fix the issue by reading the entire i32 offset and add a unit test. Co-authored-by: Helgi Kristvin Sigurbjarnarson <[email protected]>
Co-authored-by: Jiayu Liu <[email protected]>
* Update changelog for 6.1 release * Update version to 6.1.0
…870) (#915) * feat(ipc): Support for writing dictionaries nested in structs and unions Dictionaries are lost when serializing a RecordBatch for IPC, producing invalid arrow data. This PR changes encoded_batch to recursively find all dictionary fields within the schema (currently only in structs and unions) so nested dictionaries are properly serialized. * address lint and clippy Co-authored-by: Helgi Kristvin Sigurbjarnarson <[email protected]>
) * Fix unaligned access in bit-packing * Fix creation of unaligned reference in murmur_hash2_64a * Remove now-unnecessary unsafe Co-authored-by: Andrew Lamb <[email protected]> Co-authored-by: Ben Kimock <[email protected]>
Co-authored-by: Jiayu Liu <[email protected]>
Co-authored-by: kingeasternsun <[email protected]>
Co-authored-by: kingeasternsun <[email protected]>
Co-authored-by: Jiayu Liu <[email protected]>
…ary fields (#923) (#931) * feat(ipc): read a message containing nested dictionary fields * Apply suggestions from code review Co-authored-by: Andrew Lamb <[email protected]> * address lints Co-authored-by: Andrew Lamb <[email protected]> Co-authored-by: Helgi Kristvin Sigurbjarnarson <[email protected]>
Co-authored-by: Jiayu Liu <[email protected]>
Co-authored-by: Jiayu Liu <[email protected]>
* add check for appending i128 to decimal builder * remove the ArrowError(DecimalError) Co-authored-by: Kun Liu <[email protected]>
Co-authored-by: Ben Chambers <[email protected]>
* reproduce validation error * Fix validation bug Co-authored-by: Ben Chambers <[email protected]> Co-authored-by: Ben Chambers <[email protected]>
…977) (#1005) Co-authored-by: Carlos <[email protected]>
* Add full data validation for ArrayData::try_new() (#921) * Add full data validation for ArrayData::try_new() * Only look at offset+len indexes Co-authored-by: Jörn Horstmann <[email protected]> * fix test * fmt * test for array indexes Co-authored-by: Jörn Horstmann <[email protected]> * Fix: clippy Co-authored-by: Jörn Horstmann <[email protected]>
* Docstrings for TimestampSecondArray. * fixup! Docstrings for TimestampSecondArray. Co-authored-by: Navin <[email protected]>
Fixes #989. This feature opts into impls for `Rc` and `Arc`, but none of the data structures that use Serialize/Deserialize actually contain `Rc` or `Arc`s. See: - [Serde docs](https://serde.rs/feature-flags.html#-features-rc) - [PR adding this](apache/arrow#3016) Co-authored-by: Carol (Nichols || Goulding) <[email protected]>
…rate docs (#1013) (#1019) Co-authored-by: Adam Gutglick <[email protected]>
* Update version to 6.4.0 * 6.4.0 release notes * Correct changelog date
Co-authored-by: Andrew Lamb <[email protected]> Co-authored-by: Raphael Taylor-Davies <[email protected]>
* Need to use type from data so that we do not lose, for example, timezone information * add test for take preseving timezone Co-authored-by: Max Burke <[email protected]>
* Allow Schema and RecordBatch to project schemas on specific columns returning a new schema with those columns only * Addressing PR updates and adding a test for out of range projection * switch to &[usize] * fix: clippy and fmt Co-authored-by: Andrew Lamb <[email protected]> Co-authored-by: Stephen Carman <[email protected]>
Signed-off-by: Dmitry Patsura <[email protected]> Co-authored-by: Dmitry Patsura <[email protected]>
* support cast signed numeric to decimal * add test for i8,i16,i32,i64,f32,f64 casted to decimal * change format of float64 * add none test; merge integer test together Co-authored-by: Kun Liu <[email protected]>
Co-authored-by: Raphael Taylor-Davies <[email protected]>
* Box RleDecoder index buffer (#1061) * Format Co-authored-by: Raphael Taylor-Davies <[email protected]>
* add cast test macro function; refactor other type to decimal type; add decimal to signed numeric type support decimal to unsigned numeric * address the comments and fix the clippy Co-authored-by: Kun Liu <[email protected]>
* Fix like regex escaping * Fix like regex escaping * Fix doctest * Simplify Co-authored-by: Daniël Heres <[email protected]>
* support cast decimal to decimal * add test case * remove meaningless code Co-authored-by: Kun Liu <[email protected]>
* Update version to 6.5.0 * Update changelog
Codecov Report
@@ Coverage Diff @@
## active_release #1105 +/- ##
===============================================
Coverage 82.45% 82.45%
===============================================
Files 168 168
Lines 49413 49413
===============================================
Hits 40742 40742
Misses 8671 8671
Continue to review full report at Codecov.
|
|
Plan is we are going to do do #1120 instead of backporting this, so closing this PR |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Manual Cherry Pick of 3dca969 which originally appeared in #1102
Re #1101