Data Platform

Pub/Sub into Dataflow. The pipeline shape, where ordering and replay matter.

Format.puml
Length21 lines
LibraryGoogle Cloud icons

The source

21 lines of PlantUML, and pulls in Google Cloud icons. Copy it, or open the template inside Gnomon and render it as it is.

@startuml
!include <gcp/GCPCommon>
!include <gcp/pubsub>
!include <gcp/dataflow>
!include <gcp/cloud_storage>
!include <gcp/bigquery>

title GCP — Data platform

left to right direction

GCP_PUBSUB(ps, "Pub/Sub", "ingest")
GCP_DATAFLOW(df, "Dataflow", "streaming ETL")
GCP_CLOUD_STORAGE(gcs, "Cloud Storage", "raw landing zone")
GCP_BIGQUERY(bq, "BigQuery", "warehouse")

ps --> df
df --> gcs
df --> bq
gcs --> bq
@enduml

Render this offline

This template ships in Gnomon and renders on your machine, with no account and nothing sent to a server. The browser editor is free and needs no install.

Get Gnomon Open the browser editor

Others in Google Cloud architecture diagrams

Simple ArchitectureLoad balancer, compute, database. The shape most projects start as.
VPC NetworkingDNS, CDN and the network edge. Draw this when latency or egress is the question.
Serverless ArchitectureAPI Gateway and Cloud Run. Scales to zero, which is the whole argument.
Microservices (GKE)GKE with a load balancer in front. The heavier option, and sometimes the right one.
CI/CD PipelineCloud Build and Artifact Registry. The path from commit to running service.