Expected → Verdict → Reinforce
pdsa closes the improvement loop with three linked ideas: a verifiable expectation in Plan, an LLM
verdict in Study, and an automatic reinforcement link carried into the next Plan.
1. Expected (Plan)
Section titled “1. Expected (Plan)”When you run pdsa plan, the LLM turns your intent into a one-sentence expected evaluation — a success
criterion or metric you can actually check later. This is the hypothesis the cycle will be judged against.
pdsa plan "Cache the models list so repeat calls avoid a network round-trip"# → expected: "A second `models` call within the TTL returns with zero network requests."Override it explicitly when you already know your criterion:
pdsa plan "..." --expect "p95 latency of the second call < 5ms"2. Verdict (Study)
Section titled “2. Verdict (Study)”pdsa study compares your reported result to that expectation and records one of:
met — the expected outcome was fully achieved · partial — partially achieved · unmet — not achieved.
Alongside the verdict it stores the measured actual and a short learning narrative. The verdict is an LLM judgment, normalized to those categories.
3. Reinforce (Act → next Plan)
Section titled “3. Reinforce (Act → next Plan)”pdsa act decides whether immediate reinforcement is needed. If the verdict wasn’t met — or something
clearly still needs work — the next pdsa plan is automatically linked to this cycle with a
REINFORCES edge, forming a chain of follow-up cycles.
pdsa act # auto-decides based on the verdictpdsa act --reinforce "..." # force reinforcement of a specific thingpdsa plan "..." --fresh # opt OUT of linking; start an independent cycleThis is what makes the history a loop rather than a list: unfinished work threads forward until it’s resolved, and the graph shows the chain.
Putting it together
Section titled “Putting it together”Plan(expected) ──> Do ──> Study(verdict, actual) ──> Act ▲ │ └──────────── REINFORCES (if verdict ≠ met) ──────┘The health of the whole loop is summarized by Recall — the share of cycles that met their expectation.