On this page
- Quick read
- Readiness check
- Define read-only before the shift
- Capture a timeline with sources
- Prepare options without choosing
- Hand off with the next check
- Review the shift afterward
- Keep the practice ready
- Keep a decision log during the shift
- Protect the evidence from cleanup
- Define the end of the shift
- Role brief
- Frequently asked questions
- Sources
Is the handoff ready?
Use these checks before access expands or the first ticket begins.
Access
Ready: The programmer has named read-only roles for the logs, metrics, and repositories in scope.
Needs work: The programmer is using a shared account with broad production access.
Timeline
Ready: Each event has a timestamp, source, identifier, and observed result.
Needs work: The timeline is a narrative based on memory and chat messages.
Authority
Ready: The incident owner authorizes any production action explicitly and records it.
Needs work: The programmer is expected to fix the issue if they find the cause.
Handoff
Ready: The next responder receives the state, hypotheses, evidence, and next check time.
Needs work: The shift ends with a message that says keep looking.
Define read-only before the shift
A read-only incident triage shift should start with a written boundary: which logs, dashboards, metrics, and repositories the programmer may inspect, and which systems they may not change. Read-only access is not a vague promise. It should be enforced by the account, the role. The tools available during the shift.
Record the incident or symptom that triggered the triage, the affected service, and the customer impact known at the start. The programmer can gather evidence, correlate timestamps. Prepare hypotheses. The incident owner keeps the decision to roll back, scale, disable a feature, or communicate with customers.
Capture a timeline with sources
Build a timeline from source records rather than memory. For each event, record the timestamp, the system that produced it, the relevant identifier, and the observed result. Keep raw links or query references so another responder can reproduce the finding. A timeline that says traffic dropped at some point is less useful than one that names the metric, the window, and the comparison baseline.
The programmer should distinguish observation from inference. Write what the data shows, then write the hypothesis separately. If a dashboard is stale or a log source is missing, record that limitation instead of filling the gap with a plausible story. That check belongs in the capture a timeline with sources note, with the owner and the next action visible.
Prepare options without choosing
A useful triage note gives the incident owner options with consequences. For each option, record the expected effect, the risk, the required authority, and the evidence that would confirm the result. The programmer can prepare the commands or the rollback steps. Should not execute a production change unless the incident owner explicitly authorizes it.
This separation keeps the responder useful during pressure without turning a read-only shift into an unapproved change window. If the owner asks for an action outside the boundary, the programmer should pause and ask for a named approval rather than relying on an urgent chat message. That check belongs in the prepare options without choosing note, with the owner and the next action visible. A written boundary also protects the programmer from being asked to make an unauthorized change under pressure.
Hand off with the next check
At the end of the shift, summarize the current state, the leading hypotheses, the evidence for and against each. The next check. Name the person who accepted the handoff and the time the next check is due. A handoff that ends with keep investigating leaves the next responder without a starting point.
If the incident is stable, the handoff can propose a follow-up task for the next business day. If it is active, the handoff should identify the decision the incident owner needs to make and the latest safe time to make it. The next responder should not have to reconstruct the entire timeline. That check belongs in the hand off with the next check note, with the owner and the next action visible.
Review the shift afterward
After the incident, review the triage record for missing sources, unclear ownership, and actions that required repeated clarification. Ask whether the read-only boundary helped or hindered the response. Whether the account permissions matched the task. Record the answer as a process change rather than a personal critique.
The review should also check whether any sensitive customer or employee data appeared in a channel where it did not belong. If it did, route the issue through the privacy or security process and remove unnecessary copies. A good incident review improves both the technical response and the handling of restricted information. That check belongs in the review the shift afterward note, with the owner and the next action visible.
Keep the practice ready
A read-only triage capability is only useful if the programmer can navigate the dashboards before an incident. Provide a short orientation, a list of the key services. A recent example of a normal request flow. Test the access during a calm period so the first use is not also the first login.
Update the orientation when services, dashboards, or on-call contacts change. A stale runbook can send the responder to a dashboard that no longer exists. The client owner should confirm the access and the contacts at a fixed cadence. That check belongs in the keep the practice ready note, with the owner and the next action visible.
Keep a decision log during the shift
Record each decision the incident owner makes, the evidence used, and the time. A decision log is not a transcript; it is a short record of what changed and why. It helps the next responder understand the current state without replaying every message. The keep a decision log during the shift record should be dated and linked so a second reviewer can reproduce the result.
If a decision is reversed, preserve the earlier entry and add the new one. The log should show who had authority and what condition triggered the change. That history is useful in the incident review and in any later customer communication. That check belongs in the keep a decision log during the shift note, with the owner and the next action visible.
Protect the evidence from cleanup
During recovery, teams often delete temporary resources, rotate credentials, or clear queues. Before cleanup, preserve the logs, metrics, and configuration that explain the failure. Assign an owner for the evidence and record where it lives. A tidy environment can erase the information needed to prevent the next incident.
The programmer should follow the client evidence-retention instruction, not decide alone what to keep. If a system is about to be destroyed, pause and ask the incident owner. The cost of preserving a small evidence set is usually lower than reconstructing the incident later. That check belongs in the protect the evidence from cleanup note, with the owner and the next action visible.
Define the end of the shift
The shift should end with an explicit handoff, not a gradual loss of attention. Record the current state, the next check, and the person who owns it. If the incident is stable, say so; if it is not, say what could change quickly. The define the end of the shift record should be dated and linked so a second reviewer can reproduce the result.
A written end state prevents the next responder from assuming the incident is quieter than it is. It also gives the programmer a clean boundary for logging out of read-only access. The review can then compare the handoff with what happened next. That check belongs in the define the end of the shift note, with the owner and the next action visible.
Copy-ready brief
Put the operating agreement in writing.
Inspect the named services and logs; do not change production, secrets, customer records, or feature flags.
Attach timestamped queries, dashboard links, log excerpts, and the limitations of each source.
The client incident owner decides on rollback, scaling, feature changes, and customer communication.
Pause when a requested action leaves the read-only boundary or requires access the programmer does not have.
Frequently asked questions
Can a read-only programmer prepare a rollback command?
Yes, preparing and reviewing the command is useful. Executing it requires explicit authorization from the client incident owner.
What should the handoff contain?
The current state, leading hypotheses, evidence for and against them, open decisions, and the next check time.
Sources
- NIST SP 800-61, Computer Security Incident Handling Guide
Provides incident handling context for preparation, detection, and response.
- Google SRE Book: Incident Management
Describes incident roles and clear decision ownership.
- GitHub Docs: About pull request reviews
Supports review evidence tied to a specific change.
