ImportError with deltalake=0.16.0

[jrbourbeau]

When using the deltalake=0.16.0 release (released yesterday), I get the following error when attempting to import dask_deltatable

Traceback (most recent call last):
  File "/Users/james/projects/coiled/etl-tpch/workflow.py", line 8, in <module>
    from pipeline.reduce import query_reduce
  File "/Users/james/projects/coiled/etl-tpch/pipeline/reduce.py", line 6, in <module>
    import dask_deltatable as ddt
  File "/Users/james/mambaforge/envs/etl-tpch/lib/python3.11/site-packages/dask_deltatable/__init__.py", line 9, in <module>
    from .write import to_deltalake as to_deltalake
  File "/Users/james/mambaforge/envs/etl-tpch/lib/python3.11/site-packages/dask_deltatable/write.py", line 18, in <module>
    from deltalake.writer import (
ImportError: cannot import name 'MAX_SUPPORTED_WRITER_VERSION' from 'deltalake.writer' (/Users/james/mambaforge/envs/etl-tpch/lib/python3.11/site-packages/deltalake/writer.py)

[ItSolGood]

FYI, I have to go back to deltalake==0.13.0 to be able to run import dask_deltatable as ddt. Recent versions don't seem to be compatible anymore.

To be more precise, here my dependencies that break:

dask==2024.2.1
dask-deltatable==0.3.1
deltalake==0.14.0

[jrbourbeau]

@ItSolGood FWIW you may try using the current main branch of this repo if using a more recent version of deltalake is important to you. The changes in #68 (on main, but not yet released) should allow you to use something more recent than 0.13.0

[ItSolGood]

Good to know, thank you.

[avriiil]

hey @jrbourbeau :) any ETA on a new release of dask-deltatable? It would be nice to remove the version warning on this delta docs page since #68 and #78 seem to have resolved the version pinning issues