Pipeline failed after merge
Identify the failed stage, preserve logs and artifacts, compare the last successful run, isolate whether the failure is code, configuration, dependency or environment related, then choose rollback or forward fix.
Scenario practice
Use the structure: establish impact, gather evidence, contain risk, diagnose, recover, validate and prevent recurrence.
Identify the failed stage, preserve logs and artifacts, compare the last successful run, isolate whether the failure is code, configuration, dependency or environment related, then choose rollback or forward fix.
Check synthetic monitoring, application logs, traces, dependency health, recent feature flags and regional differences. A green deployment is not proof of a healthy user journey.
Stop. Review provider changes, immutable attributes, state drift, moved blocks and lifecycle rules. Do not apply until replacement impact and recovery are understood.
Inspect pod events, exit codes, resource limits, probes, application logs, node pressure and dependency failures. Separate application crashes from orchestration responses.
Revoke and rotate the secret first, then remove it from history, invalidate caches, audit use, add secret scanning and document the incident. Deleting the visible line is insufficient.
Compare before-and-after service metrics, traces and database calls. Define rollback thresholds, confirm whether autoscaling masks the issue, and avoid treating extra capacity as the root-cause fix.