OR Key
drop another .md file to compare - side-by-side diff against snappy-go-outcome-gate

snappy-go-outcome-gate

Grades your background helpers by what they ship, not just whether they ran.
description: "Triggers on prompt mention of 'snappy-go-outcome-gate'."
personal 2 files

What it does for you

Grades your background helpers by what they ship, not just whether they ran.

What it produces

A recent result, so you can see the kind of work it returns.

loading…

How to get it

These run inside the Snappy workspace. Want this working in your business? I set skills like this up with you, in one focused week.

Work with me
For developers how this skill is built, graded, and how it runs

at a glance- the short version

eval modeauto-shape
categoryOps
stages1

what's inside - the parts that make up a skill 2/4 present

A skill is just a few plain-text files. Only the main one is required. The rest are optional, added as the work needs them. This is what the skill is made of; how it runs is just below.

The skill
state/skills/snappy-go-outcome-gate/SKILL.md present
the skill itself, in plain text
The main file. It says what the skill is and lays out the steps in plain English.
Code
state/lib/snappy-go-outcome-gate.ts not present
code the skill can run
Optional. Many skills are just words and need no code at all.
Scripts
state/bin/snappy-go-outcome-gate/ not present
helper scripts
Optional. Added when a skill has a few commands to run.
Loader
state/skills/snappy-go-outcome-gate/AGENTS.md present
what the AI loads on the fly
Loaded automatically the moment this skill is needed. Kept short on purpose.

how it's graded - what counts as a good run 5 criteria · 5 deterministic

Each row is one thing a good run has to get right. deterministic means a quick check decides, pass or fail. judge means the AI reads the result and rates it. Grading each piece on its own (instead of one overall score) shows exactly where a run fell short, so the fix is obvious.

name
kind
check
eval_row_format_and_fields
deterministic
Each 'verb: tick' row in 'evals.ndjson' must contain 'ts', 'skill', 'verb', 'score', 'tick', 'max_ticks', 'dur_secs', 'exit', 'commits', 'open_before', 'open_after', 'open_delta', 'head_before', 'head_after', and 'note' fields.
score_correctness_exit_code
deterministic
If 'exit' is not 0, then 'score' must be 0 and 'note' must be 'tick-failed'.
score_correctness_progress
deterministic
If 'exit' is 0 AND ('commits' > 0 OR 'open_delta' > 0), then 'score' must be 1 and 'note' must be 'progress'.
score_correctness_no_op
deterministic
If 'exit' is 0 AND ('commits' is 0 AND 'open_delta' is 0), then 'score' must be 0 and 'note' must be 'tick-no-op'.
open_delta_calculation
deterministic
'open_delta' must equal 'open_before' minus 'open_after' for all 'verb: tick' rows.

how it runs - the shared frame every skill uses 3/5 present

Every skill runs the same way. One part does the work, a separate part checks it, and a short loader hands the AI exactly what it needs for the job. Anything this skill doesn't use shows a one-line note saying why, on purpose, not by accident.

makes the work The worker
not present

No work step here. This is probably a skill that reads or coordinates, not one that produces something.

checks the work The reviewer
inferred
shape gate an automatic check
The check is an automatic pass or fail on the shape of the result, run separately from the work itself.
frame
learns Self-correction
present
fixes itself learns from gaps
When a run hits a gap, the skill gets edited on the spot [FIXED] or queued for a bigger rewrite [LOGGED], so it keeps getting better.
tidies up Background fixes
present
queued for rewrite runs in the background
Bigger fixes that can't be made on the spot get queued and rewritten in the background later.
remembers Run history
present
state/log/evals.ndjson unknown runs
Every run is written down here, so the next time this skill is used it already knows how the last runs went.
Critical rules the things this skill must not get wrong
  1. NEVER treat a dormant skill as runnable without reviving its spec
  2. ALWAYS prefer an existing active skill over resurrecting a dormant one

what it has learned - fixes written back in over time sample

When a run hits something this skill didn't handle, the fix gets written back into the skill so it doesn't happen again. FIXED means it was corrected on the spot. LOGGED means it's queued for a bigger rewrite. Either way, the skill gets a little better and never makes the same mistake twice.

  1. Loading feedback rows…

how the work flows- step by step

1 data
eval log
`state/log/evals.ndjson` (skill: "snappy-go" — historical only)

SKILL.md- the skill, written out in plain English

snappy-go (outcome-gate spec)

Historical eval bucket for the directive-tick cron driver. The live invocation skill is state/skills/go.md (the multi-agent /snappy-go command). This page owns the per-tick outcome-gate that scores every directive tick and the audit trail behind it.

Originally reclaimed as a dormant ghost by state/bin/orphan-audit/fix.ts on 2026-04-18 (20 historical rows had no doc). Resurrected the same day by Pod X to anchor the outcome-gate fix to Pod K's audit (commit ae19fee).

Why this page exists

Pod K's audit found that every directive tick was scoring 1.0 in state/log/evals.ndjson simply because claude -p exited 0 - a participation trophy. A tick that ran for 20 minutes producing nothing got the same score as a tick that closed three p0 frictions and shipped two commits. The eval log was lying to the PID loop.

The fix is in state/bin/agents/tick.sh. This page is the spec.

Eval

Shape-gate at invocation lives in state/skills/go.md (verb: "set"). That gate validates the agent file was created correctly. Unchanged.

Outcome-gate per tick is implemented in state/bin/agents/tick.sh around the claude -p call (verb: "tick", skill: "agent-<id>"). For every tick the driver:

  1. Snapshots git rev-parse HEAD and the count of distinct OPEN p0/p1

areas in state/log/breakage-report.ndjson (latest-row-per-area wins, status == "open", sev ∈ {p0, p1}) before the tick.

  1. Runs the claude -p subprocess with the directive prompt.
  2. Re-snapshots both values after the subprocess returns.
  3. Scores the row using:
ConditionScoreNote
subprocess EXIT != 00tick-failed
EXIT == 0 AND (COMMITS > 0 OR OPEN_DELTA > 0)1progress
EXIT == 0 AND no commits AND no friction-drop0tick-no-op

COMMITS is the delta of git rev-list --count HEAD across the tick (positive = HEAD advanced). OPEN_DELTA is OPEN_BEFORE - OPEN_AFTER (positive = frictions closed).

Each eval row carries the full forensic payload so the PID loop and any auditor can re-derive the score:

{"ts":"...","skill":"agent-default","verb":"tick","score":1,
 "tick":15,"max_ticks":40,"dur_secs":207,"exit":0,
 "commits":2,"open_before":7,"open_after":5,"open_delta":2,
 "head_before":"a4b4d2f","head_after":"c1a84c3","note":"progress"}

A run of tick-no-op rows for the same agent is the load-bearing signal that the directive is stale (verify-only, agent has nothing to do); the PID loop should retire the agent rather than keep firing it.

Actor != auditor

The set verb's actor is state/bin/agents/go.sh; its auditor is the shape-check in go.md. The tick verb's actor is state/bin/agents/tick.sh running claude -p; its auditor is the deterministic git rev-list / jq snapshot pair surrounding the call. Two different mechanisms, per program.md's rule.

Dormancy note

This skill page does not have its own runnable command - invocation is handled by /snappy-go (see state/skills/go.md). The page exists to document the outcome-gate spec and to give historical eval rows a catalog home so structural lint stops flagging them as ghosts.

Rubric

criteria:
  - name: eval_row_format_and_fields
    kind: deterministic
    check: "Each 'verb: tick' row in 'evals.ndjson' must contain 'ts', 'skill', 'verb', 'score', 'tick', 'max_ticks', 'dur_secs', 'exit', 'commits', 'open_before', 'open_after', 'open_delta', 'head_before', 'head_after', and 'note' fields."
  - name: score_correctness_exit_code
    kind: deterministic
    check: "If 'exit' is not 0, then 'score' must be 0 and 'note' must be 'tick-failed'."
  - name: score_correctness_progress
    kind: deterministic
    check: "If 'exit' is 0 AND ('commits' > 0 OR 'open_delta' > 0), then 'score' must be 1 and 'note' must be 'progress'."
  - name: score_correctness_no_op
    kind: deterministic
    check: "If 'exit' is 0 AND ('commits' is 0 AND 'open_delta' is 0), then 'score' must be 0 and 'note' must be 'tick-no-op'."
  - name: open_delta_calculation
    kind: deterministic
    check: "'open_delta' must equal 'open_before' minus 'open_after' for all 'verb: tick' rows."

AGENTS.md- what the AI loads when this skill comes up

snappy-go-outcome-gate - loader (dormant)

Full reference: state/skills/snappy-go-outcome-gate/SKILL.md. This skill is dormant; new runs are not expected.

Critical Rules

  • NEVER treat a dormant skill as runnable without reviving its spec
  • ALWAYS prefer an existing active skill over resurrecting a dormant one

Commands

| ui dashboard | state/skills/snappy-go-outcome-gate/resources/ui.openui | |full spec: state/skills/snappy-go-outcome-gate/SKILL.md |eval log: state/log/evals.ndjson (skill: "snappy-go" - historical only)

OpenUI Resource

  • Skill-owned OpenUI Lang resource: state/skills/snappy-go-outcome-gate/resources/ui.openui. Read it before rendering or editing this skill's generated component surface.
  • Treat this resource as a first-class artifact of the skill, not a generic chat response. Improve it when the skill's user-facing output needs to become richer.
  • System resources compose OpenUI primitives and inherit SnappyChat tokens. Use ui_contract: branded in SKILL.md only for deliberate platform or client visuals.

Known Pitfalls

_(reclaimed ghost - no failures recorded in the new catalog yet.)_

Self-Test

  1. [ ] Is this skill truly needed, or should I use an active neighbor?

<!-- kernel-ok: historical attribution for the PID-loader pattern. -->

Self-correcting loader (PID feedback)

This is the rule that makes loaders learn. Ported from snappy-kernel, where it demonstrably worked: the snappy-dom-cartographer skill mapped Skool admin UI once, every later ship-agent inherited the full map for free.

Before you finish, do two things:

1. Fix gaps (P - proportional). MANDATORY. If this loader didn't cover your case - if you had to read another file, run an undocumented command, work around a wrong selector, or discover a quirk - you MUST attempt an Edit to this AGENTS.md before you log.

  • Default action: edit this file. Surgical. Add the missing line, table

row, or code example where it belongs. No restructuring.

  • Only LOGGED is allowed when: the fix needs >10 lines, spans multiple

files, or requires a structural rewrite. In that case the state/regen/drain.sh queue picks it up asynchronously.

  • "I didn't have time" / "it's minor" / "the next agent will figure it out"

are NOT valid reasons. Minor gaps compound - that's the whole point of this loop.

  • Concrete example of a valid P-fix: discover agent-browser screenshot

takes path positionally not as --output <path>. One line in a table. Edit it in. Do not just log it.

  • The goal: the next agent never has to leave the loader.

2. Log the result.

echo "[$(date -u +%FT%TZ)] snappy-go-outcome-gate: <what was missing or fixed> [FIXED|LOGGED]" >> state/log/loader-feedback.log
  • FIXED = you patched this loader inline (P-fix).
  • LOGGED = too large for inline; the PostToolUse enqueue + Stop-hook drain

will rewrite the loader from scratch on next session-end.

Do not skip this. Every agent run must leave the system better than it found it. The loader is the setpoint; you are the sensor; the gap is the error signal; closing the gap is the correction.

api.ts- the code it can call

⚠ no api.ts - this skill has no typed action surface

scripts- helper scripts it can run

prose-only skill - 2 inline code blocks live in SKILL.md above (no state/bin/ sidecar yet).

how we check it- the checks, plus the last 10 runs

rubric auto-shape no rubric declared
recent no runs actor/auditor: unverifiable
deps none declared

no recent runs logged - the eval contract is declared but nothing has been graded yet