- The synced data lives in your S3 bucket.
- Humm still manages the Glue catalog and query path.
- Humm and Airbyte assume a role in your AWS account to write, validate, and query the synced data.
Before You Start
You will need:- Permission in your AWS account to create or update an S3 bucket, IAM policy, and IAM role, and IAM user
- Organization admin access in Humm
1. Create or Choose an S3 Bucket
Create a new bucket or choose an existing one for Humm sync data. Recommendations:- Use a dedicated bucket for Humm sync data
- Keep Block Public Access enabled
- Choose the AWS region you want Humm to use for sync storage
- Avoid pointing Humm at a bucket that contains unrelated production data
2. Create an IAM Permission Policy
Create an IAM policy that gives the Humm sync role access to the bucket. ReplaceYOUR_BUCKET_NAME and YOUR_GLUE_ACCOUNT_ID
s3:ListBucket*lets Humm discover objects and prefixess3:GetBucketVersioninglets Humm verify immutable object versioning before uses3:PutObjectlets Humm write synced data and run connection validations3:DeleteObjectlets Humm clean up connector-owned data and remove the validation files3:GetObject*lets Humm query synced dataglue:*allows Humm to create and manage databases and tables on your behalfathena:*allows Humm to execute queries against the data warehouse
3. Enable S3 Bucket Versioning
Enable versioning on the bucket before testing the connection. New S3 buckets are unversioned by default, and Humm requires versioning to verify immutable synced data. Using the AWS CLI:4. Create an IAM User for Humm
Create an IAM user for Humm; attach the policy above directly, or via a role definition. Generate5. Enter the Settings in Humm
In Humm:- Go to Settings > Data Storage
- Select Customer-hosted
- Enter your S3 bucket name, AWS region, Access Key ID, and Secret Access Key
- Click Test connection
- If successful, click Save
- Reach the bucket
- Write a temporary validation object
- Delete that validation object
.humm/validation.txt.
6. Start or Re-run Your Sync
Once the storage settings are saved, create a new Data Sync connector or re-run setup for an existing one. Humm will then:- Configure itself to write into your S3 bucket
- Keep the Glue catalog in Humm-managed AWS
- Query the synced data through Athena