- Add
aws_profile
option to use custom AWS profile
- Add
s3_acl
option to support ACL for S3 upload
- Switch jsonschema to use Draft7Validator
- Add
validate_records
option - Add
skip_updates
option to skip updates in case of immutable records - Add
temp_dir
optional parameter to config - Fixed an issue when JSON values sometimes not sent correctly
- Support usage of reserved words as table and column names
- Use stream name as temp file suffix
- Log inserts, updates and csv size_bytes in a more consumable format
- Switch to
psychopg-binary
2.8.5
- Support custom logging configuration by setting
LOGGING_CONF_FILE
env variable to the absolute path of a .conf file
- Fixed an issue when AWS credentials are not collected correctly from AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY environment variables
- Add
slices
option - Add
compression
option - Fixed an issue when ECS credentials not being correctly picked up by boto3 when no keys are provided
- Emit new state message as soon as data flushed to Redshift
- Add
flush_all_streams
option - Add
max_parallelism
option - Documentation fixes
- Allow STS token to be used
- Fix None being passed to iam_role in COPY command when role arn is None
- Allow S3 COPY role arn to be provided, remove required AWS credentials
- Add
parallelism
option - Add
copy_options
option - Fixed issue when permissions not granted properly
- Log SQLs only in debug mode
- Fixed loading float data types into double precision Redshift columns
- Set varchar column length dynamically
- Add license details
- Fixed loading numeric data types
- Fixed loading numeric data types
- Initial release