Releases: data-engineering-collective/plateau
Releases · data-engineering-collective/plateau
plateau 4.4.0
What's Changed
- Improve support for Dask's query planner.
- Support column projection when using
dask-expr
'sfrom_map
. - Include pyarrow 15.0.0 in CI
- Fix tests for dask 2024.1.1
- Account for breaking changes in nightly builds of Pandas which would have caused issues upon the release of Pandas 3.
plateau 4.3.0
- Add
is distinct from
predicate operation. This follows the behaviour of the SQL operation of the same name, i.e. it treats two null values as the same. This is also the current behaviour of the!=
operation. - Deprecates the current behaviour of the
!=
predicate operation. From 5.0.0 onwards, the new behaviour will be the same as its SQL counterpart, i.e. it will filter out null/missing values. Where the current behaviour of!=
is needed,is distinct from
should be used instead. - Add tests for pyarrow 14.0.1
- Add tests for Python 3.12
- Migrate setup.cfg to pyproject.toml completely
- Port to ruff, remove isort, black, and flake8
plateau 4.2.1
- Add support for pandas 2.1
- Fix a bug to do with timestamp dtype conversion
- Add timestamp unit coercion as
plateau
currently only supports nanosecond units on timestamps
plateau 4.2.0
- Support pandas 2
- Test pyarrow 12 and 13
- Prevent dask from casting all object dtypes to strings
- Remove tests for pyarrow<=3 as they fail with pandas>=2
- Adds support for dask 2023.9.2
plateau 4.1.5
- Enable dask column projection.
- Test pyarrow 11
- Remove usage of pkg_resources.
plateau 4.1.4
What's Changed
- Use pip for readthedocs installation by @xhochy in #59
- Bump mamba-org/provision-with-micromamba from 13 to 14 by @dependabot in #60
- Update pre-commit hooks by @xhochy in #63
- Test for pyarrow=10 and Python=3.11 by @xhochy in #69
- Add code scanning with CodeQL by @xhochy in #62
- Don't package tests by @jtilly in #61
- Create CODEOWNERS by @xhochy in #70
- Update pre-commit hook to numpy=1.23 by @xhochy in #71
Full Changelog: 4.1.3...4.1.4
plateau 4.1.3
What's Changed
- Patch to load partition with only nulls as a category by @DamianBarabonkovQC in #56
Full Changelog: 4.1.2...4.1.3
plateau 4.1.2
What's Changed
- Remove pyarrow upper-bound version pin by @DamianBarabonkovQC in #58
Full Changelog: 4.1.1...4.1.2
plateau 4.1.1
What's Changed
Full Changelog: 4.1.0...4.1.1
plateau 4.1.0
What's Changed
- Bump actions/cache from 2.1.7 to 3.0.2 by @dependabot in #31
- Bump codecov/codecov-action from 2.1.0 to 3.1.0 by @dependabot in #32
- Bump actions/cache from 3.0.2 to 3.0.8 by @dependabot in #41
- Bump pre-commit/action from 2.0.3 to 3.0.0 by @dependabot in #34
- Bump actions/setup-python from 3 to 4.1.0 by @dependabot in #37
- Support pyarrow=6.* by @xhochy in #42
- Support numpy 1.23, pandas 1.4.{3,4}, pyarrow=4.0.1 by @xhochy in #43
- Support pyarrow={7,8,9}, dask>=2022.4.2; update mypy by @xhochy in #44
- Bump codecov/codecov-action from 3.1.0 to 3.1.1 by @dependabot in #46
- Bump actions/cache from 3.0.8 to 3.0.10 by @dependabot in #48
- Update packaging setup by @xhochy in #49
- Check untyped defs by @xhochy in #50
- Replace
storefact
andsimplekv
usages with minimalkv by @xhochy in #51 - Test for pyarrow 5 by @xhochy in #52
- Update pre-commit hooks and add pyupgrade by @xhochy in #53
- Use mamba for readthedocs. by @jtilly in #54
New Contributors
Full Changelog: 4.0.4...4.1.0