Data Lake Architecture

Ingest, store, catalogue, query.

Format.puml
Length53 lines
LibraryAWS icons

The source

53 lines of PlantUML, and pulls in AWS icons. Copy it, or open the template inside Gnomon and render it as it is.

@startuml
!define AWSPuml https://raw.githubusercontent.com/awslabs/aws-icons-for-plantuml/main/dist
!include AWSPuml/AWSCommon.puml
!include AWSPuml/Storage/SimpleStorageService.puml
!include AWSPuml/Analytics/Glue.puml
!include AWSPuml/Analytics/Athena.puml
!include AWSPuml/Analytics/Redshift.puml
!include AWSPuml/Analytics/QuickSight.puml
!include AWSPuml/Analytics/KinesisDataStreams.puml
!include AWSPuml/Analytics/LakeFormation.puml
!include AWSPuml/Database/RDS.puml

title AWS Data Lake Architecture

' Data Sources
RDS(sourceDb, "Source Database", "")
KinesisDataStreams(stream, "Kinesis Stream", "Real-time")

' Data Lake
LakeFormation(lakeFormation, "Lake Formation", "Governance")
SimpleStorageService(rawZone, "Raw Zone", "Landing")
SimpleStorageService(cleanZone, "Clean Zone", "Processed")
SimpleStorageService(curatedZone, "Curated Zone", "Analytics")

' Processing
Glue(crawler, "Glue Crawler", "")
Glue(etlJob, "Glue ETL", "")

' Analytics
Athena(athena, "Athena", "Ad-hoc Queries")
Redshift(redshift, "Redshift", "Data Warehouse")
QuickSight(quicksight, "QuickSight", "Dashboards")

' Flow
sourceDb --> rawZone : Batch
stream --> rawZone : Streaming

rawZone --> crawler
crawler --> etlJob
etlJob --> cleanZone
cleanZone --> etlJob
etlJob --> curatedZone

lakeFormation --> rawZone
lakeFormation --> cleanZone
lakeFormation --> curatedZone

curatedZone --> athena
curatedZone --> redshift
athena --> quicksight
redshift --> quicksight

@enduml

Render this offline

This template ships in Gnomon and renders on your machine, with no account and no diagram uploads. The browser editor is free and needs no install.

Get Gnomon Open the browser editor

Others in AWS architecture diagrams

Simple ArchitectureThe starting point: a handful of services and the traffic between them.
VPC ArchitectureSubnets, availability zones and what is actually reachable from where.
Serverless ArchitectureAPI Gateway, Lambda, DynamoDB: the pattern most greenfield work starts from.
Microservices ArchitectureService-per-container with the plumbing between them.
CI/CD PipelineCodePipeline and friends, end to end.