You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The s3_sync module reports wrong etags compared to the one calculated from AWS S3 on server side.
The etag algorithm is based on the chunk_size used during multipart upload. The s3_sync module uses the boto3 defaults for the S3 Transfer, but the function that calculates the local etags does not use those defaults (it uses an hardcoded value instead)
Upload some folder with s3_sync module and compare the local_etag calculated by the module with the S3 remote tags (calculated with the chunk_size used by boto3 - underlying library to tranfer the file)
EXPECTED RESULTS
The local_etags of the file just uploaded should match the etags on S3
ACTUAL RESULTS
The local_etags of the files just uploaded are mismatching S3 etags due to the wrong chunk_size hardcoded in the module:
DEFAULT_CHUNK_SIZE = 5 * 1024 * 1024
The text was updated successfully, but these errors were encountered:
SUMMARY
The s3_sync module reports wrong etags compared to the one calculated from AWS S3 on server side.
The etag algorithm is based on the chunk_size used during multipart upload. The s3_sync module uses the boto3 defaults for the S3 Transfer, but the function that calculates the local etags does not use those defaults (it uses an hardcoded value instead)
ISSUE TYPE
COMPONENT NAME
plugins/modules/s3_sync.py
ANSIBLE VERSION
CONFIGURATION
no changes
OS / ENVIRONMENT
Mac OS 10.15.7
STEPS TO REPRODUCE
Upload some folder with s3_sync module and compare the local_etag calculated by the module with the S3 remote tags (calculated with the chunk_size used by boto3 - underlying library to tranfer the file)
EXPECTED RESULTS
The local_etags of the file just uploaded should match the etags on S3
ACTUAL RESULTS
The local_etags of the files just uploaded are mismatching S3 etags due to the wrong chunk_size hardcoded in the module:
The text was updated successfully, but these errors were encountered: