Projects

Every Monday Someone Forgot the Import. Data Team Angry. So I Automated It.

Every Monday morning. Someone forgot to trigger the import. Again. The data team is waiting. The product team is angry. And the person responsible? On vacation. A critical data import job triggered manually by one person, credentials stored who-knows-where, no monitoring - failures discovered hours later when someone downstream finally complained. The automation replaced all of it: Azure scheduled triggers firing every Monday at 6 AM before anyone is awake, Bash scripts that orchestrate the import, validate the data, and retry on failure, and credentials stored in Key Vault instead of someone's notebook. If retries exhaust, the team gets a Slack alert instantly - so they know before standup, not after. Every single run is logged and tracked. The thing about manual processes like this is that they feel fine until they are not. One person holds all the context. They go on leave, change jobs, or just have a bad Monday - and suddenly the whole pipeline is down with nobody knowing why. That is not a people problem. That is an engineering gap. Since automation went live: zero missed imports. Not one. Data ready before standup. Nobody needs to remember, nobody needs to be awake. And…