Runbooks & On-call
Infrastructure and support engineering teams
Infrastructure and support engineers: runbooks per service plus a weekly on-call schedule.
Use this templateRunbooks & On-call
When an alert fires, find the matching runbook, follow its steps, and write down anything that was wrong. The schedule below says who to call.
Who is on call
Runbook health
On-call handbook
Engineers
On-call schedule
| Shift | Starts | Ends | Primary | Secondary | Handoff notes | Phase |
|---|---|---|---|---|---|---|
| Marisa and Devraj | Nov 1, 2026 | Nov 7, 2026 | Marisa Kowalczyk | Devraj Pillai | Replica lag spiked twice overnight; both cleared on their own. | |
| Devraj and Oskar | Nov 8, 2026 | Nov 14, 2026 | Devraj Pillai | Oskar Lindqvist-Reyes | Quiet. Certificate renewal reminder is still open. | |
| Oskar and Halima | Nov 15, 2026 | Nov 21, 2026 | Oskar Lindqvist-Reyes | Halima Yusuf-Greene | Watch the queue depth after Thursday’s release. | |
| Halima and Marisa | Nov 22, 2026 | Nov 28, 2026 | Halima Yusuf-Greene | Marisa Kowalczyk | Planned database maintenance on the first evening. | |
| Marisa and Ping | Nov 29, 2026 | Dec 5, 2026 | Marisa Kowalczyk | Ping Wang-Ellison | Clinic holiday hours begin; expect fewer portal logins. | |
| Devraj and Halima | Dec 6, 2026 | Dec 12, 2026 | Devraj Pillai | Halima Yusuf-Greene | — |
Runbooks
Open any runbook to find the full outline (when to use it, checks, steps, rollback) already inside it.
| Runbook | Service | Type | Owner | Severity covered | Last tested | Freshness |
|---|---|---|---|---|---|---|
| Promote a read replica | Records database | Halima Yusuf-Greene | Jul 1, 2026 | |||
| Purge a poisoned queue message | Message queue | Devraj Pillai | Jul 31, 2026 | |||
| Rotate the VPN gateway certificate | Office network | Oskar Lindqvist-Reyes | Aug 15, 2026 | |||
| Office network down at the clinic | Office network | Oskar Lindqvist-Reyes | Sep 9, 2026 | |||
| Diagnose slow queries | Records database | Halima Yusuf-Greene | Sep 19, 2026 | |||
| Roll back an appointment API release | Appointment API | Marisa Kowalczyk | Sep 29, 2026 | |||
| Nightly report job did not finish | Reporting jobs | Halima Yusuf-Greene | Oct 4, 2026 | |||
| Restart the portal safely | Patient portal | Devraj Pillai | Oct 14, 2026 |
Services
| Service | Tier | Owner |
|---|---|---|
| Patient portal | Devraj Pillai | |
| Appointment API | Marisa Kowalczyk | |
| Records database | Halima Yusuf-Greene | |
| Message queue | Devraj Pillai | |
| Reporting jobs | Halima Yusuf-Greene | |
| Office network | Oskar Lindqvist-Reyes |
Primary answers the page within five minutes. If they do not, the secondary is paged automatically.
| Shift | Starts | Ends | Primary | Secondary | Handoff notes | Phase |
|---|---|---|---|---|---|---|
| Marisa and Devraj | Nov 1, 2026 | Nov 7, 2026 | Marisa Kowalczyk | Devraj Pillai | Replica lag spiked twice overnight; both cleared on their own. | |
| Devraj and Oskar | Nov 8, 2026 | Nov 14, 2026 | Devraj Pillai | Oskar Lindqvist-Reyes | Quiet. Certificate renewal reminder is still open. | |
| Oskar and Halima | Nov 15, 2026 | Nov 21, 2026 | Oskar Lindqvist-Reyes | Halima Yusuf-Greene | Watch the queue depth after Thursday’s release. |
Handoff checklist
Open incidents and who is handling them
Alerts that fired and what was done
Anything that looks like it will break soon
Planned maintenance in the next shift
| Runbook | Service | Type | Owner | Severity covered | Last tested | Freshness |
|---|---|---|---|---|---|---|
| Promote a read replica | Records database | Halima Yusuf-Greene | Jul 1, 2026 | |||
| Purge a poisoned queue message | Message queue | Devraj Pillai | Jul 31, 2026 | |||
| Rotate the VPN gateway certificate | Office network | Oskar Lindqvist-Reyes | Aug 15, 2026 |
| Runbook | Service | Type | Owner | Severity covered | Last tested | Freshness |
|---|---|---|---|---|---|---|
| Promote a read replica | Records database | Halima Yusuf-Greene | Jul 1, 2026 | |||
| Purge a poisoned queue message | Message queue | Devraj Pillai | Jul 31, 2026 | |||
| Rotate the VPN gateway certificate | Office network | Oskar Lindqvist-Reyes | Aug 15, 2026 |
| Service | Tier | Owner |
|---|---|---|
| Patient portal | Devraj Pillai | |
| Appointment API | Marisa Kowalczyk | |
| Records database | Halima Yusuf-Greene |
Keeping runbooks alive
A runbook nobody has tested is a guess. Every runbook should be run through once a quarter, ideally by someone who did not write it.
Pick Tested this month and Stale from the lists above.
Run the steps against a safe environment. Fix anything that no longer matches.
Set the tested date and press Mark current.
Stale runbooks
| Runbook | Service | Type | Owner | Severity covered | Last tested | Freshness |
|---|---|---|---|---|---|---|
| Promote a read replica | Records database | Halima Yusuf-Greene | Jul 1, 2026 | |||
| Purge a poisoned queue message | Message queue | Devraj Pillai | Jul 31, 2026 | |||
| Rotate the VPN gateway certificate | Office network | Oskar Lindqvist-Reyes | Aug 15, 2026 |
Coverage by service
| Service | Tier | Owner |
|---|---|---|
| Patient portal | Devraj Pillai | |
| Appointment API | Marisa Kowalczyk | |
| Records database | Halima Yusuf-Greene |
Your first shift
Install the paging app and test a page.
Read the three newest postmortems.
Shadow the current primary for one evening.
During a shift
Acknowledge every page within five minutes.
Open the runbook before touching anything.
Write what you did in the incident channel as you go.
If you need to swap
Find a teammate, change the schedule yourself, and tell the head of infrastructure.
If you are exhausted
Hand over. A tired engineer makes the second incident.
What's inside
4 tables · 14 views · 1 form · 1 row action · 1 agent5 pages
- Runbooks & On-call
- Who is on call
- Runbook health
- On-call handbook
- Engineers
3 tables
- Runbooks6 views · 12 sample rows
- Services2 views · 6 sample rows
- On-call schedule5 views · 6 sample rows
Questions
- What is included in the Runbooks & On-call template?
- 5 pages (Runbooks & On-call, Who is on call, Runbook health, On-call handbook and Engineers) and 3 tables (Runbooks, Services and On-call schedule), filled with 24 sample rows so every view opens with realistic data.
- Who is the Runbooks & On-call template for?
- Infrastructure and support engineering teams.
- Is the Runbooks & On-call template free?
- Yes. Sign up free, press Use this template, and a full copy is added to your workspace.
- Can I change the template after I use it?
- Yes. Every page, table, column and view in your copy is yours to rename, edit or delete, and the sample rows can be cleared.
Related workspaces
Agency OSSmall agencies: clients, retainers, projects, capacity and proposals in one place.
Incident PostmortemsEngineering and ops teams: log incidents, write blameless postmortems, track the fixes.
Small Business OSOwners of 1 to 15 person businesses: sales, projects, money, team and goals in one.
Event PlannerEvent organisers: guests and RSVPs, vendors, tasks, budget and run of show.
Inventory TrackerSmall shops and makers: track stock, suppliers and orders so you reorder in time.
Support and Feedback TrackerSmall support teams: triage tickets, track feature requests, link help articles.