Amazon S3

Amazon S3

  • Purpose: Read CSV or JSON files stored in an Amazon S3 bucket.
  • When to use it: Ideal for analyzing data exports, logs, or reports uploaded to S3 without moving files to a database.
  • How to create it:
    1. Go to Data Sources and click Add.
    2. Select Amazon S3.
    3. Name: Enter a unique name for this connection.
    4. Region: AWS region of your bucket (e.g., us-east-1).
    5. Access Key ID: Your AWS IAM access key.
    6. Secret Access Key: The corresponding secret key.
    7. Bucket: Name of the S3 bucket.
    8. Prefix: (Optional) Folder path within the bucket to filter files.
    9. File Path: (Optional) Specific file path inside the bucket.
    10. File Format: Set to auto to detect CSV or JSON automatically, or specify manually.
    11. Click Test Connection to verify, then Save.

Amazon S3 Configuration

Note: The IAM user must have at least s3:GetObject and s3:ListBucket permissions on the target bucket.