pbPassingBI
/
Data sources & datasets beginner 6 min

Connecting to data sources

AWS services, databases, files, and what each connection implies.

What you'll be able to do
  • Connect to the common sources
  • Choose between SPICE and direct query
  • Understand VPC and permission requirements

The sources

SourceNotes
S3Needs a manifest file describing the objects
AthenaQuery S3 with SQL; the common lake pattern
RedshiftNative, fast, the usual warehouse
RDS / AuroraPostgres, MySQL, SQL Server
FilesCSV, Excel, JSON — uploaded, SPICE only
SaaSSalesforce, ServiceNow, Jira and others
Third-party databasesSnowflake, Teradata, Presto

The S3 manifest

S3 is the source people trip on. QuickSight does not simply read a bucket — it needs a manifest file, a small JSON document listing the URIs or prefixes and describing the format:

{
  "fileLocations": [{ "URIPrefixes": ["s3://bucket/sales/"] }],
  "globalUploadSettings": { "format": "CSV", "delimiter": "," }
}

Using URIPrefixes rather than listing individual files means new files in that prefix are picked up on refresh.

Permissions

Permissions are the usual first obstacle

QuickSight needs its own access, separate from yours. In Manage QuickSight → Security & permissions, grant it access to the specific S3 buckets, Athena workgroups and other services.

A source that works in the console but not in QuickSight is almost always this.

VPC connections

For a database in a private subnet, QuickSight needs a VPC connection — created in Manage QuickSight, then selected when creating the data source.

The security group on the database must allow inbound traffic from the QuickSight connection's security group. That reciprocal rule is the second common obstacle.

Reusing data sources

A data source is the connection; a dataset is a prepared view built on it. One data source supports many datasets, so define the connection once and build datasets on top rather than reconnecting each time.

Key points
  • S3 needs a manifest file; URIPrefixes picks up new files automatically
  • QuickSight needs its own service permissions, separate from yours
  • One data source supports many datasets — define the connection once
Check yourself