Database Backup & Verification Pipeline
Automatically backups snapshot of database daily. Does verification checks inside a Ephemeral Docker Container. Incase of failure, alerts concerned team.
Scheduler
Nightly cron fires at 2:00 AM
pg_dump
Run backup command
Object Storage
Object Storage
Integrity Check
Generate & store checksum
Ephemeral Restore Sandbox
Spin up temp DB container
Corruption Check
Download & verify checksum
Restore into container
Run restore command
Sanity Queries
Run validation queries
#ops-alerts
Post success notification
Metrics
Emit backup success metric
#ops-alerts
Send urgent failure alert
On-Call
Page on-call engineer
Incident Tracking
Auto-create incident ticket
Cleanup
Destroy ephemeral container
Recipe
16 nodes · 4 phasesDatabase Backup & Verification Pipeline
Automatically backups snapshot of database daily. Does verification checks inside a Ephemeral Docker Container. Incase of failure, alerts concerned team.