Data and Analytics on AWS: Athena, Glue, Kinesis, EMR, Redshift, QuickSight and OpenSearch

AWS Technical Essentials 50 min min read Updated: Nov 17, 2026 Beginner
Data and Analytics on AWS: Athena, Glue, Kinesis, EMR, Redshift, QuickSight and OpenSearch
Beginner Topic 2 of 3

The Typical Analytics Flow

text Sources (apps, logs, IoT) ─► Ingest (Kinesis / Firehose / DMS) ─► Store (S3 data lake) ─► Prepare (Glue / EMR) ─► Analyze (Athena / Redshift / OpenSearch) ─► Visualize (QuickSight)
ServiceWhat it isThink of it as
S3Cheap, durable storage for any dataThe data lake
AWS GlueServerless ETL, crawlers and Data CatalogData cleaner and index
Amazon AthenaRun SQL directly on files in S3. Pay per data scannedSQL on your files
Kinesis Data StreamsReal-time stream you read with your own consumersA live conveyor belt
Kinesis Data FirehoseLoad streaming data into S3, Redshift, OpenSearch with no codeDelivery truck
Amazon EMRManaged Hadoop and Spark clusters (or serverless)Big data processing
Amazon RedshiftColumnar data warehouse for fast complex SQLWarehouse for BI
Amazon QuickSightBI dashboards and reportsCharts for managers
OpenSearch ServiceSearch and log analyticsSearch engine
Lake FormationCentral permissions and setup for the data lakeData lake security guard
MSKManaged Apache KafkaKafka without servers to manage

Athena in Five Minutes

sql CREATE EXTERNAL TABLE sales ( order_id string, amount double, country string, order_date date ) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',' LOCATION 's3://my-data-lake/sales/' TBLPROPERTIES ('skip.header.line.count'='1'); SELECT country, SUM(amount) AS revenue FROM sales WHERE order_date >= DATE '2026-11-01' GROUP BY country ORDER BY revenue DESC;
  • Store data in Parquet and partition by date to scan less and pay less
  • Save query results to an S3 location
  • No servers to manage

Glue Crawler and ETL

bash aws glue create-database --database-input Name=lake aws glue create-crawler --name sales-crawler --role AWSGlueServiceRole-demo --database-name lake --targets '{"S3Targets":[{"Path":"s3://my-data-lake/sales/"}]}' aws glue start-crawler --name sales-crawler aws glue get-tables --database-name lake --query 'TableList[].Name'

Streaming With Kinesis

bash aws kinesis create-stream --stream-name clicks --shard-count 1 aws kinesis put-record --stream-name clicks --partition-key user1 --data "$(echo '{"page":"/home"}' | base64)" aws kinesis get-shard-iterator --stream-name clicks --shard-id shardId-000000000000 --shard-iterator-type TRIM_HORIZON

Which One When?

NeedChoose
Quick SQL on S3 files, no setupAthena
Fast dashboards on large structured data every dayRedshift
Custom Spark or Hadoop jobsEMR (or Glue for simple ETL)
Real-time ingestion and processingKinesis Data Streams / MSK
Land streaming data in S3 with no codeFirehose
Search and log explorationOpenSearch
Business dashboardsQuickSight

Practice

  1. Upload a CSV to S3 and query it with Athena
  2. Convert it to Parquet and compare the data scanned
  3. Create a Glue crawler and look at the table it creates
  4. Make a QuickSight chart from the Athena table
  5. Delete streams and clusters when done

Conclusion

S3 is the data lake. Ingest with Kinesis or Firehose, prepare with Glue or EMR, analyze with Athena, Redshift or OpenSearch and visualize with QuickSight. Use Parquet and partitions to save money.

Quick Summary: flow; services; Athena; Glue; Kinesis; choosing.

Get Newsletter

Subscibe to our newsletter and we will notify you about the newest updates on Edugators