Data Lake Architecture

Ingest, store, catalogue, query.

Data Lake Architecture: rendered example
Rendered by Gnomon from the source below. No edits.

The source

53 lines of PlantUML, and pulls in AWS icons. Copy it, or open the template inside Gnomon and render it as it is.

@startuml
!define AWSPuml https://raw.githubusercontent.com/awslabs/aws-icons-for-plantuml/main/dist
!include AWSPuml/AWSCommon.puml
!include AWSPuml/Storage/SimpleStorageService.puml
!include AWSPuml/Analytics/Glue.puml
!include AWSPuml/Analytics/Athena.puml
!include AWSPuml/Analytics/Redshift.puml
!include AWSPuml/Analytics/QuickSight.puml
!include AWSPuml/Analytics/KinesisDataStreams.puml
!include AWSPuml/Analytics/LakeFormation.puml
!include AWSPuml/Database/RDS.puml

title AWS Data Lake Architecture

' Data Sources
RDS(sourceDb, "Source Database", "")
KinesisDataStreams(stream, "Kinesis Stream", "Real-time")

' Data Lake
LakeFormation(lakeFormation, "Lake Formation", "Governance")
SimpleStorageService(rawZone, "Raw Zone", "Landing")
SimpleStorageService(cleanZone, "Clean Zone", "Processed")
SimpleStorageService(curatedZone, "Curated Zone", "Analytics")

' Processing
Glue(crawler, "Glue Crawler", "")
Glue(etlJob, "Glue ETL", "")

' Analytics
Athena(athena, "Athena", "Ad-hoc Queries")
Redshift(redshift, "Redshift", "Data Warehouse")
QuickSight(quicksight, "QuickSight", "Dashboards")

' Flow
sourceDb --> rawZone : Batch
stream --> rawZone : Streaming

rawZone --> crawler
crawler --> etlJob
etlJob --> cleanZone
cleanZone --> etlJob
etlJob --> curatedZone

lakeFormation --> rawZone
lakeFormation --> cleanZone
lakeFormation --> curatedZone

curatedZone --> athena
curatedZone --> redshift
athena --> quicksight
redshift --> quicksight

@enduml

Render this offline

This template ships in Gnomon and renders on your machine, with no account and nothing sent to a server. The browser editor is free and needs no install.

Get GnomonOpen the browser editor

Others in AWS architecture diagrams