Accuracy limits and human review
AI can misread, leave things out or state something with more confidence than it should. In SOPCompass the AI proposes and a person approves, and nothing AI written reaches your team without that step.
Large language models are good at structure and wording, and they make mistakes. SOPCompass is designed so those mistakes are caught by a person before anyone relies on them.
What can go wrong
- Misreading a source. A blurry frame, a misheard word in a transcript or a messy document can produce a wrong step.
- Leaving things out. A draft can skip a step that was implied rather than said.
- Overconfident summaries. Ask can summarize a step less precisely than the SOP says it, even with a citation.
- Stale or conflicting SOPs. Ask answers from what is written. If an SOP is out of date, the answer will be too.
- Wrong highlight boxes. On video drafts, a box can land on the wrong control. The AI is told to leave boxes out when unsure, but it can still be wrong.
- Instructions hidden in content. Text in a web page, document or screenshot could try to steer the AI. Each feature tells the AI that source material is data, never instructions, which lowers this risk but can’t remove it.
How each feature keeps a person in charge
| Feature | What the AI produces | What a person does |
|---|---|---|
| Ask | An answer with numbered citations and a coverage judgment | Reads it, opens the cited SOPs before acting on anything important |
| Build with AI | Proposals, each with a reason | Approves or rejects each item; only approved items are applied |
| Document, audio and video imports | A draft SOP and notes on what to check | Edits and saves it, or discards it |
| Quiz drafting | Draft questions marked AI draft | Keeps or discards each one; Save stays off until all are decided |
| Capture rewrite | New wording for each step | Reviews, edits or undoes it, then publishes |
| AI sort | A proposed pillar and departments per item | An admin approves or corrects every item |
Changes the AI proposes to existing SOPs are saved to version history first, so they can be restored. See How Build with AI works.
Checking an AI draft
- Walk it against the real process. Better still, have the person who does the work follow it once.
- Check every number, name and threshold against the source.
- Look for missing steps between steps, especially approvals and handoffs.
- Read the AI’s notes. Imports and proposals say what was dropped, inferred or contradictory.
- Assign it for review before assigning it to the whole team.
Important: Don’t rely on AI output alone for safety critical, legal, medical or financial procedures. SOPCompass can’t verify that a draft is correct, complete or compliant with any law or standard.
Common questions
Who is responsible for an SOP drafted by AI?
The person who approves and publishes it, the same as an SOP written by hand. The AI's draft is a starting point, not a verified procedure.
Should we use AI drafted SOPs for safety critical or regulated work?
Only after a qualified person has checked every step against the real process. The AI can't verify that a draft is correct, complete or compliant.