OR Key
drop another .md file to compare - side-by-side diff against agent-default

agent-default

Keeps your always-on helper working in the background and scores what it ships.
description: "Triggers on prompt mention of 'agent-default'."
personal 2 files 10 recent evals

What it does for you

Keeps your always-on helper working in the background and scores what it ships.

What it produces

A recent result, so you can see the kind of work it returns.

loading…

How to get it

These run inside the Snappy workspace. Want this working in your business? I set skills like this up with you, in one focused week.

Work with me
For developers how this skill is built, graded, and how it runs

at a glance- the short version

actorClaude -p subprocess
auditorGit rev-list HEAD-delta
eval modeauto-shape
categoryOps
stages1

what's inside - the parts that make up a skill 2/4 present

A skill is just a few plain-text files. Only the main one is required. The rest are optional, added as the work needs them. This is what the skill is made of; how it runs is just below.

The skill
state/skills/agent-default/SKILL.md present
the skill itself, in plain text
The main file. It says what the skill is and lays out the steps in plain English.
Code
state/lib/agent-default.ts not present
code the skill can run
Optional. Many skills are just words and need no code at all.
Scripts
state/bin/agent-default/ not present
helper scripts
Optional. Added when a skill has a few commands to run.
Loader
state/skills/agent-default/AGENTS.md present
what the AI loads on the fly
Loaded automatically the moment this skill is needed. Kept short on purpose.

how it's graded - what counts as a good run 4 criteria · 4 deterministic

Each row is one thing a good run has to get right. deterministic means a quick check decides, pass or fail. judge means the AI reads the result and rates it. Grading each piece on its own (instead of one overall score) shows exactly where a run fell short, so the fix is obvious.

name
kind
check
eval_row_schema_adherence
deterministic
The eval row in state/log/evals.ndjson for 'agent-default' MUST strictly conform to the specified JSON schema for fields: ts, skill, verb, score, tick, max_ticks, dur_secs, exit, commits, open_before, open_after, open_delta, head_before, head_after, and note.
score_matches_exit_status
deterministic
If the 'exit' field in the eval row is not 0, the 'score' field MUST be 0 and the 'note' field MUST be 'tick-failed'.
score_matches_progress
deterministic
If the 'exit' field is 0, the 'score' field MUST be 1 IF 'commits' > 0 OR 'open_delta' > 0, and the 'note' field MUST be 'progress'.
score_matches_no_op
deterministic
If the 'exit' field is 0, the 'score' field MUST be 0 IF 'commits' == 0 AND 'open_delta' <= 0, and the 'note' field MUST be 'tick-no-op'.

how it runs - the shared frame every skill uses 5/5 present

Every skill runs the same way. One part does the work, a separate part checks it, and a short loader hands the AI exactly what it needs for the job. Anything this skill doesn't use shows a one-line note saying why, on purpose, not by accident.

makes the work The worker
present
Claude -p subprocess an AI model
Does the actual work. Whatever it produces is what gets checked next.
checks the work The reviewer
present
Git rev-list HEAD-delta the checker
A separate checker grades the work, so the part that made it can't approve its own work.
frame
learns Self-correction
present
fixes itself learns from gaps
When a run hits a gap, the skill gets edited on the spot [FIXED] or queued for a bigger rewrite [LOGGED], so it keeps getting better.
tidies up Background fixes
present
queued for rewrite runs in the background
Bigger fixes that can't be made on the spot get queued and rewritten in the background later.
remembers Run history
present
state/log/evals.ndjson unknown runs
Every run is written down here, so the next time this skill is used it already knows how the last runs went.
Critical rules the things this skill must not get wrong
  1. NEVER score a tick 1 based solely on claude -p exit code — that was the Pod K cheater pattern. Score is 1 only if commits > 0 OR open_delta > 0.
  2. ALWAYS include the commits, open_delta, and note fields in any new tick row written under skill="agent-default" — state/bin/agents/tick.sh is the canonical writer; do not bypass it.
  3. ALWAYS use note tick-no-op (with score=0) for ticks that ran cleanly but shipped nothing — this is the load-bearing signal that the agent should be retired.

what it has learned - fixes written back in over time sample

When a run hits something this skill didn't handle, the fix gets written back into the skill so it doesn't happen again. FIXED means it was corrected on the spot. LOGGED means it's queued for a bigger rewrite. Either way, the skill gets a little better and never makes the same mistake twice.

  1. Loading feedback rows…

how the work flows- who makes it, who checks it

actor Claude -p subprocess
auditor Git rev-list HEAD-delta
1 data
eval log
`state/log/evals.ndjson` (skill: "agent-default")

SKILL.md- the skill, written out in plain English

agent-default

The scheduled autopilot agent named default (config in state/agents/default.json) writes its per-tick eval rows under this skill name. The cron entry */10 * * * * state/bin/agents/tick.sh fires this agent every 10 minutes until max_ticks is reached, then auto-marks it done.

This is not a "dormant ghost." It is the catch-all lane for the autopilot loop. Pod K's audit (2026-04-18) flagged the prior gate as a cheater because it scored every tick 1.0 based on the claude-p subprocess exit code, which ignored whether the agent actually shipped any work. Pods X + Z replaced it with a real outcome gate.

Contract

Per-tick eval row written by state/bin/agents/tick.sh:

{"ts":"...","skill":"agent-default","verb":"tick","score":<0|1>,
 "tick":N,"max_ticks":M,"dur_secs":N,"exit":N,
 "commits":N,"open_before":N,"open_after":N,"open_delta":N,
 "head_before":"sha","head_after":"sha","note":"progress|tick-no-op|tick-failed"}

Eval

Outcome gate (actor: claude -p subprocess; auditor: git rev-list HEAD-delta + state/log/breakage-report.ndjson open-friction-delta, both computed deterministically by tick.sh):

exitcommitsopen_deltascorenotemeaning
!= 0anyany0tick-failedsubprocess failed - investigate
00<= 00tick-no-opnothing shipped, no frictions closed
0> 0any1progresscommit landed on disk
0any> 01progressopen p0/p1 friction count dropped

No 0.5 lane. A tick either shipped work or it didn't. The tick-no-op note is the load-bearing signal for the PID loop: a string of tick-no-op rows means the agent has nothing to do - retire it instead of re-firing every 10 minutes. Trend monitor: state/lint/pid-trends.ts.

Pass criteria (unambiguous): score=1 requires the git rev-list --count HEAD delta > 0 OR the breakage-report.ndjson open p0/p1 count dropped between tick start and end. Both are measured by tick.sh using deterministic shell arithmetic - not by LLM self-report.

Fail criteria (unambiguous): score=0 when (a) exit != 0note=tick-failed, or (b) exit == 0 but no HEAD advance and no friction drop → note=tick-no-op. Exit 255 always maps to tick-failed.

Shape gate (auditor: this skill page + state/lib/agents.ts):

  • Every row MUST have skill="agent-<id>" where <id> matches a file in

state/agents/<id>.json - orphan IDs (no config file) are lint errors.

  • The commits, open_delta, and note fields are required. Rows missing

them are pre-Pod-K legacy rows; lint warns on any new row without them.

Failure modes and diagnostics

exit=255 (dispatch timeout / rate-limit / API error). This is the dominant failure pattern (ticks 25-40 of the 2026-04-18 run all hit exit=255). dispatch-tick.ts exits 255 when the underlying dispatch() call fails at the API layer - not a Claude coding error. Diagnose via:

# Most recent per-agent run log:
ls -t ~/robot-rob/logs/claude-cron-agent-default.*.log | head -1 | xargs tail -40

Usual causes: Claude API rate-limit, network drop, or SNAPPY_AGENT_MODEL set to an unrecognized model name. Fix: wait for rate-limit window, check ~/.claude/.env.cache credentials, or clear SNAPPY_AGENT_MODEL.

Directive-complete drift (tick-no-op string after success). When the agent's directive is fully shipped (e.g., at tick 14), subsequent ticks re-verify the same completed work and score tick-no-op. This is expected and correct - the PID loop uses the tick-no-op string to auto-retire the agent. Do NOT re-score these 1; that would mask the retirement signal. The open friction (2026-04-25) about detecting completed work is a prompt-level optimization, not a scoring change.

Self-reported ok:true rows are NOT the score. An agent that writes {"ok":true} to evals.ndjson from within its own context is an actor scoring its own work - the cheater pattern. The score for agent-default ticks comes exclusively from tick.sh (HEAD-delta + open-friction-delta). Any ok:true rows written by the agent's subshell are logged under a different verb (e.g., verb:"regen-brief") and do not override the tick score.

Why "agent-default" specifically

The default agent is the standing autopilot lane that picks up work nobody else claimed: regen-briefs, graduations, tick-tock cleanup. Other named agents (agent-content, agent-sync, etc.) get spawned for specific directives. default is the always-running residual.

If the default agent has been running >5 ticks scoring tick-no-op, kill it with:

python3 -c "
import json
p = 'state/agents/default.json'
d = json.load(open(p))
d['status'] = 'done'
json.dump(d, open(p, 'w'), indent=2)
"

Rubric

criteria:
  - name: eval_row_schema_adherence
    kind: deterministic
    check: "The eval row in state/log/evals.ndjson for 'agent-default' MUST strictly conform to the specified JSON schema for fields: ts, skill, verb, score, tick, max_ticks, dur_secs, exit, commits, open_before, open_after, open_delta, head_before, head_after, and note."
  - name: score_matches_exit_status
    kind: deterministic
    check: "If the 'exit' field in the eval row is not 0, the 'score' field MUST be 0 and the 'note' field MUST be 'tick-failed'."
  - name: score_matches_progress
    kind: deterministic
    check: "If the 'exit' field is 0, the 'score' field MUST be 1 IF 'commits' > 0 OR 'open_delta' > 0, and the 'note' field MUST be 'progress'."
  - name: score_matches_no_op
    kind: deterministic
    check: "If the 'exit' field is 0, the 'score' field MUST be 0 IF 'commits' == 0 AND 'open_delta' <= 0, and the 'note' field MUST be 'tick-no-op'."

AGENTS.md- what the AI loads when this skill comes up

agent-default - loader

Per-turn rules. Full reference: state/skills/agent-default/SKILL.md. Do not skip these.

Critical Rules

  • NEVER score a tick 1 based solely on claude -p exit code - that was the Pod K cheater pattern. Score is 1 only if commits > 0 OR open_delta > 0.
  • ALWAYS include the commits, open_delta, and note fields in any new tick row written under skill="agent-default" - state/bin/agents/tick.sh is the canonical writer; do not bypass it.
  • ALWAYS use note tick-no-op (with score=0) for ticks that ran cleanly but shipped nothing - this is the load-bearing signal that the agent should be retired.

Commands

| ui dashboard | state/skills/agent-default/resources/ui.openui | |writer: state/bin/agents/tick.sh (cron: */10 * * * *) |config: state/agents/default.json |eval log: state/log/evals.ndjson (skill: "agent-default") |kill agent: edit state/agents/default.json set status: "done"

OpenUI Resource

  • Skill-owned OpenUI Lang resource: state/skills/agent-default/resources/ui.openui. Read it before rendering or editing this skill's generated component surface.
  • Treat this resource as a first-class artifact of the skill, not a generic chat response. Improve it when the skill's user-facing output needs to become richer.
  • System resources compose OpenUI primitives and inherit SnappyChat tokens. Use ui_contract: branded in SKILL.md only for deliberate platform or client visuals.

Known Pitfalls

  • Bare exit-code scoring is a cheater gate (Pod K audit, 2026-04-18). Outcome = commits delta OR open p0/p1 friction delta, not subprocess success.
  • The default agent has no special status - it is the standing autopilot lane. Other agents (content, sync, etc.) follow the same gate.
  • Don't write rows under skill="agent-default" from anywhere except tick.sh - orphan writers will trip the shape gate.
  • No 0.5 lane in the current gate (Pod X version superseded an earlier 0.5 design). A tick either shipped work or it didn't.

Self-Test

  1. [ ] Does the new tick row include commits, open_delta, and note fields?
  2. [ ] Is the score 0 (with note tick-no-op) when the agent shipped no commits AND closed no frictions?
  3. [ ] Is the score 0 (with note tick-failed) when exit code is non-zero?
  4. [ ] Is the score 1 (with note progress) when commits > 0 OR open_delta > 0?

Self-report

If this loader fell short, append a line:

echo "[$(date -u +%FT%TZ)] agent-default: <what was missing>" >> state/log/loader-feedback.log

<!-- kernel-ok: historical attribution for the PID-loader pattern. -->

Self-correcting loader (PID feedback)

This is the rule that makes loaders learn. Ported from snappy-kernel, where it demonstrably worked: the snappy-dom-cartographer skill mapped Skool admin UI once, every later ship-agent inherited the full map for free.

Before you finish, do two things:

1. Fix gaps (P - proportional). MANDATORY. If this loader didn't cover your case - if you had to read another file, run an undocumented command, work around a wrong selector, or discover a quirk - you MUST attempt an Edit to this AGENTS.md before you log.

  • Default action: edit this file. Surgical. Add the missing line, table

row, or code example where it belongs. No restructuring.

  • Only LOGGED is allowed when: the fix needs >10 lines, spans multiple

files, or requires a structural rewrite. In that case the state/regen/drain.sh queue picks it up asynchronously.

  • "I didn't have time" / "it's minor" / "the next agent will figure it out"

are NOT valid reasons. Minor gaps compound - that's the whole point of this loop.

  • Concrete example of a valid P-fix: discover agent-browser screenshot

takes path positionally not as --output <path>. One line in a table. Edit it in. Do not just log it.

  • The goal: the next agent never has to leave the loader.

2. Log the result.

echo "[$(date -u +%FT%TZ)] agent-default: <what was missing or fixed> [FIXED|LOGGED]" >> state/log/loader-feedback.log
  • FIXED = you patched this loader inline (P-fix).
  • LOGGED = too large for inline; the PostToolUse enqueue + Stop-hook drain

will rewrite the loader from scratch on next session-end.

Do not skip this. Every agent run must leave the system better than it found it. The loader is the setpoint; you are the sensor; the gap is the error signal; closing the gap is the correction.

api.ts- the code it can call

⚠ no api.ts - this skill has no typed action surface

scripts- helper scripts it can run

prose-only skill - 4 inline code blocks live in SKILL.md above (no state/bin/ sidecar yet).

how we check it- the checks, plus the last 10 runs

rubric auto-shape no rubric declared
recent mean 0.50 · 10 runs actor/auditor: unverifiable
deps none declared
timestamp verb score primary_issue artifact
2026-04-25 04:11Z - 1.00 - -
2026-04-21 15:58Z - 1.00 - -
2026-04-21 15:56Z - 1.00 - -
2026-04-21 03:53Z - 1.00 - -
2026-04-21 03:49Z - 1.00 - -
2026-04-19 10:12Z - 0.00 - -
2026-04-19 10:02Z - 0.00 - -
2026-04-19 09:52Z - 0.00 - -
2026-04-19 09:42Z - 0.00 - -
2026-04-19 09:32Z - 0.00 - -