Skip to content

v0.7.0 - Iceberg support!

Pre-release
Pre-release
Compare
Choose a tag to compare
@dacort dacort released this 11 Jul 18:16
· 1 commit to main since this release
v0.7.0
8b50557
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

With the introduction of PyIceberg, we can now create Iceberg tables.

Iceberg requires a catalog to store the table definition, so with this initial release, we support Iceberg tables in AWS Glue with the data on S3.

fake -n 10 pyint,user_name,date_this_year -f iceberg -C glue://default.iceberg_sample -o s3://YOUR_BUCEKT/iceberg/

With that command, faker-cli will generate a 10-row dataset, upload it to S3 and create the table in the Glue Data Catalog. It assumes your AWS credentials are already setup with the necessary permissions.

Assets 2
Loading