A pattern for ingesting a continuous external stream in Go: a dumb, fast Kafka consumer that lands raw messages in Postgres, with per-partition fan-out, idempotent batched writes, and a landing table that never expires.

After losing a PostgreSQL database by blindly following AI-generated commands, I developed a structured approach to working with AI that separates generation from judgement

A Go service for consuming real-time UK railway data from Kafka, with table partitioning and integration testing using Docker