CI/CD Pipelines for Data Engineers
Data pipelines are production software. Here's how to build CI/CD that catches bad transforms before they corrupt dashboards: testing strategy, environment promotion, slim runs, and rollback patterns.
The Augmented Dev ยท Archive
Dynamics 365, Power Platform, AI, system design, and web development โ filter by theme or search across every post.
Newsletter
One email per post. No spam, no tracking pixels, unsubscribe anytime.
8 of 179 articles tagged devops
Data pipelines are production software. Here's how to build CI/CD that catches bad transforms before they corrupt dashboards: testing strategy, environment promotion, slim runs, and rollback patterns.
Shipping code and releasing a feature are different events that most teams accidentally fuse together. Feature flags split them โ and unlock trunk-based development, safe rollouts, and instant rollback.
Instrument your .NET services once with OpenTelemetry and ship traces to Jaeger, Grafana Tempo, or Azure Monitor โ all without changing application code.
Most alerting setups produce noise that teams learn to ignore. Here is how to design alerts around the four golden signals, set thresholds that mean something, and build a system where every alert is worth waking someone up for.
A first-person account of a production outage caused by skipping staging. The small fix, the cascading failure, the 3am scramble, and the process changes that followed.
How to build a deployment pipeline that swaps staging and production slots on Azure App Service โ with smoke tests, warm-up, rollback strategy, and a real YAML pipeline you can steal.
ARM templates are painful. Bicep fixes the developer experience with cleaner syntax, modules, and first-class Azure CLI integration. Here is how to migrate and start using it in your CI/CD pipelines.
How to resolve execution policy errors when running .ps1 scripts, and why you should care about script signing in 2026.