Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add SQL Support for ADBC Drivers #53869

Merged
merged 78 commits into from
Nov 22, 2023
Merged
Show file tree
Hide file tree
Changes from 50 commits
Commits
Show all changes
78 commits
Select commit Hold shift + click to select a range
4f2b760
close to complete implementation
WillAyd Jun 26, 2023
a4ebbb5
working implementation for postgres
WillAyd Jun 26, 2023
b2cd149
sqlite implementation
WillAyd Jun 26, 2023
512bd00
Added ADBC to CI
WillAyd Jun 26, 2023
f49115c
Doc updates
WillAyd Jun 26, 2023
a8512b5
Whatsnew update
WillAyd Jun 26, 2023
c1c68ef
Better optional dependency import
WillAyd Jun 26, 2023
3d7fb15
min versions fix
WillAyd Jun 26, 2023
1093bc8
import updates
WillAyd Jun 27, 2023
926e567
docstring fix
WillAyd Jun 27, 2023
093dd86
Merge remote-tracking branch 'upstream/main' into adbc-integration
WillAyd Jun 27, 2023
fcc21a8
doc fixup
WillAyd Jun 27, 2023
88642f7
Merge remote-tracking branch 'upstream/main' into adbc-integration
WillAyd Jul 14, 2023
156096d
Updates for 0.6.0
WillAyd Jul 14, 2023
dd26edb
fix sqlite name escaping
WillAyd Jul 20, 2023
4d8a233
more cleanups
WillAyd Jul 20, 2023
5238e69
more 0.6.0 updates
WillAyd Aug 2, 2023
51c6c98
typo
WillAyd Aug 2, 2023
39b462b
Merge remote-tracking branch 'upstream/main' into adbc-integration
WillAyd Aug 28, 2023
428c4f7
remove warning
WillAyd Aug 28, 2023
84d95bb
test_sql expectations
WillAyd Aug 28, 2023
a4d5b31
revert whatsnew issues
WillAyd Aug 28, 2023
21b35f6
pip deps
WillAyd Aug 28, 2023
e709d52
Suppress pyarrow warning
WillAyd Aug 28, 2023
6077fa9
Updated docs
WillAyd Aug 28, 2023
5bba566
mypy fixes
WillAyd Aug 28, 2023
236e12b
Remove stacklevel check from test
WillAyd Aug 29, 2023
b35374c
typo fix
WillAyd Aug 29, 2023
8d814e1
compat
WillAyd Aug 30, 2023
cfac2c7
Joris feedback
WillAyd Aug 31, 2023
47caaf1
Merge remote-tracking branch 'upstream/main' into adbc-integration
WillAyd Aug 31, 2023
a22e5d1
Better test coverage with ADBC
WillAyd Aug 31, 2023
c51b7f4
cleanups
WillAyd Aug 31, 2023
7f5e6ac
feedback
WillAyd Sep 1, 2023
9ee6255
Merge remote-tracking branch 'upstream/main' into adbc-integration
WillAyd Sep 19, 2023
a8b645f
checkpoint
WillAyd Sep 19, 2023
902df4f
more checkpoint
WillAyd Sep 19, 2023
90ca2cb
more skips
WillAyd Sep 20, 2023
d753c3c
updates
WillAyd Sep 20, 2023
d469e24
implement more
WillAyd Sep 21, 2023
2bc11a1
bump to 0.7.0
WillAyd Sep 24, 2023
f205f90
fixups
WillAyd Oct 2, 2023
2755100
Merge remote-tracking branch 'upstream/main' into adbc-integration
WillAyd Oct 2, 2023
3577a59
cleanups
WillAyd Oct 2, 2023
c5bf7f8
sqlite fixups
WillAyd Oct 2, 2023
98d22ce
pyarrow compat
WillAyd Oct 2, 2023
4f72010
revert to using pip instead of conda
WillAyd Oct 2, 2023
7223e63
documentation cleanups
WillAyd Oct 2, 2023
c2cd90a
compat fixups
WillAyd Oct 3, 2023
de65ec0
Fix stacklevel
WillAyd Oct 3, 2023
7645727
remove unneeded code
WillAyd Oct 3, 2023
3dc914c
Merge remote-tracking branch 'upstream/main' into adbc-integration
WillAyd Oct 16, 2023
6dbaae5
commit after drop in fixtures
WillAyd Oct 16, 2023
3bf550c
close cursor
WillAyd Oct 17, 2023
492301f
Merge branch 'main' into adbc-integration
WillAyd Oct 23, 2023
fc463a4
Merge remote-tracking branch 'upstream/main' into adbc-integration
WillAyd Oct 23, 2023
cc72ecd
Merge branch 'main' into adbc-integration
WillAyd Oct 25, 2023
f5fd529
Merge branch 'main' into adbc-integration
WillAyd Oct 30, 2023
1207bc4
fix table dropping
WillAyd Oct 30, 2023
e8d93c7
Merge branch 'main' into adbc-integration
WillAyd Nov 10, 2023
3eed897
Bumped ADBC min to 0.8.0
WillAyd Nov 10, 2023
adef2f2
Merge remote-tracking branch 'upstream/main' into adbc-integration
WillAyd Nov 10, 2023
67101fd
documentation
WillAyd Nov 10, 2023
ea5dcb9
doc updates
WillAyd Nov 10, 2023
fb38411
more fixups
WillAyd Nov 10, 2023
a0bed67
documentation fixups
WillAyd Nov 11, 2023
150e267
Merge branch 'main' into adbc-integration
WillAyd Nov 13, 2023
1e77f2b
fixes
WillAyd Nov 13, 2023
97ed24f
more documentation
WillAyd Nov 13, 2023
7dc07da
doc spacing
WillAyd Nov 13, 2023
52ee8d3
doc target fix
WillAyd Nov 14, 2023
1de8488
pyarrow warning compat
WillAyd Nov 14, 2023
21edaea
Merge branch 'main' into adbc-integration
WillAyd Nov 17, 2023
2d077e9
feedback
WillAyd Nov 17, 2023
accbd49
updated io documentation
WillAyd Nov 17, 2023
64b63bd
Merge branch 'main' into adbc-integration
WillAyd Nov 17, 2023
f84f63a
install updates
WillAyd Nov 18, 2023
391d045
Merge remote-tracking branch 'upstream/main' into adbc-integration
WillAyd Nov 21, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions ci/deps/actions-310.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -58,5 +58,7 @@ dependencies:
- zstandard>=0.17.0

- pip:
- adbc-driver-postgresql>=0.7.0
- adbc-driver-sqlite>=0.7.0
- pyqt5>=5.15.6
- tzdata>=2022.1
2 changes: 2 additions & 0 deletions ci/deps/actions-311-downstream_compat.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -72,6 +72,8 @@ dependencies:
- pyyaml
- py
- pip:
- adbc-driver-postgresql>=0.7.0
- adbc-driver-sqlite>=0.7.0
- dataframe-api-compat>=0.1.7
- pyqt5>=5.15.6
- tzdata>=2022.1
2 changes: 2 additions & 0 deletions ci/deps/actions-311.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -58,5 +58,7 @@ dependencies:
- zstandard>=0.17.0

- pip:
- adbc-driver-postgresql>=0.7.0
- adbc-driver-sqlite>=0.7.0
- pyqt5>=5.15.6
- tzdata>=2022.1
2 changes: 2 additions & 0 deletions ci/deps/actions-39-minimum_versions.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -60,6 +60,8 @@ dependencies:
- zstandard=0.17.0

- pip:
- adbc-driver-postgresql==0.7.0
- adbc-driver-sqlite==0.7.0
- dataframe-api-compat==0.1.7
- pyqt5==5.15.6
- tzdata==2022.1
2 changes: 2 additions & 0 deletions ci/deps/actions-39.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -58,5 +58,7 @@ dependencies:
- zstandard>=0.17.0

- pip:
- adbc-driver-postgresql>=0.7.0
- adbc-driver-sqlite>=0.7.0
- pyqt5>=5.15.6
- tzdata>=2022.1
4 changes: 4 additions & 0 deletions ci/deps/circle-310-arm64.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -57,3 +57,7 @@ dependencies:
- xlrd>=2.0.1
- xlsxwriter>=3.0.3
- zstandard>=0.17.0

- pip:
- adbc-driver-postgresql>=0.7.0
- adbc-driver-sqlite>=0.7.0
5 changes: 4 additions & 1 deletion doc/source/getting_started/install.rst
Original file line number Diff line number Diff line change
Expand Up @@ -335,7 +335,8 @@ lxml 4.8.0 xml XML parser for read
SQL databases
^^^^^^^^^^^^^

Installable with ``pip install "pandas[postgresql, mysql, sql-other]"``.
Traditional drivers are installable with ``pip install "pandas[postgresql, mysql, sql-other]"``. ADBC drivers
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is no longer anymore since you added them to the postgresql and sql-other extra in the pyproject.toml

must be installed separately.

========================= ================== =============== =============================================================
Dependency Minimum Version pip extra Notes
Expand All @@ -345,6 +346,8 @@ SQLAlchemy 1.4.36 postgresql, SQL support for dat
sql-other
psycopg2 2.9.3 postgresql PostgreSQL engine for sqlalchemy
pymysql 1.0.2 mysql MySQL engine for sqlalchemy
adbc-driver-postgresql 0.7.0 ADBC Driver for PostgreSQL
adbc-driver-sqlite 0.7.0 ADBC Driver for SQLite
========================= ================== =============== =============================================================

Other data sources
Expand Down
2 changes: 2 additions & 0 deletions environment.yml
Original file line number Diff line number Diff line change
Expand Up @@ -114,6 +114,8 @@ dependencies:
- pygments # Code highlighting

- pip:
- adbc-driver-postgresql>=0.7.0
- adbc-driver-sqlite>=0.7.0
- dataframe-api-compat>=0.1.7
- sphinx-toggleprompt # conda-forge version has stricter pins on jinja2
- typing_extensions; python_version<"3.11"
Expand Down
2 changes: 2 additions & 0 deletions pandas/compat/_optional.py
Original file line number Diff line number Diff line change
Expand Up @@ -15,6 +15,8 @@
# Update install.rst & setup.cfg when updating versions!

VERSIONS = {
"adbc-driver-postgresql": "0.7.0",
"adbc-driver-sqlite": "0.7.0",
"bs4": "4.11.1",
"blosc": "1.21.0",
"bottleneck": "1.3.4",
Expand Down
Loading