Route handler at GET /kpis-snapshot plus the prose .md file to compare - side-by-side diff against kpis-snapshot
kpis-snapshot
description: "Triggers on prompt mention of 'kpis-snapshot', 'snappy-os pulse', 'system pulse', 'health snapshot', 'skills count', 'how many skills'."
What it does for you
Shows your key business metrics in one quick snapshot.
What it produces
A recent result, so you can see the kind of work it returns.
loading…
How to get it
These run inside the Snappy workspace. Want this working in your business? I set skills like this up with you, in one focused week.
For developers how this skill is built, graded, and how it runs
at a glance- the short version
what's inside - the parts that make up a skill 3/4 present
A skill is just a few plain-text files. Only the main one is required. The rest are optional, added as the work needs them. This is what the skill is made of; how it runs is just below.
state/skills/kpis-snapshot/SKILL.md
present
state/lib/kpis-snapshot.ts
present
state/bin/kpis-snapshot/
not present
state/skills/kpis-snapshot/AGENTS.md
present
how it's graded - what counts as a good run 3 criteria · 3 deterministic
Each row is one thing a good run has to get right. deterministic means a quick check decides, pass or fail. judge means the AI reads the result and rates it. Grading each piece on its own (instead of one overall score) shows exactly where a run fell short, so the fix is obvious.
how it runs - the shared frame every skill uses 5/5 present
Every skill runs the same way. One part does the work, a separate part checks it, and a short loader hands the AI exactly what it needs for the job. Anything this skill doesn't use shows a one-line note saying why, on purpose, not by accident.
state/log/evals.ndjson what it has learned - fixes written back in over time sample
When a run hits something this skill didn't handle, the fix gets written back into the skill so it doesn't happen again. FIXED means it was corrected on the spot. LOGGED means it's queued for a bigger rewrite. Either way, the skill gets a little better and never makes the same mistake twice.
- Loading feedback rows…
how the work flows- who makes it, who checks it
SKILL.md- the skill, written out in plain English
kpis-snapshot
Producer skill that closes the catalog-to-cockpit drift gap for the KPIBlock shape: when the cockpit asks "give me a snappy-os pulse" or "what's the health of the system", the dispatcher used to fall back to plain text because no skill emitted a KPIBlock. kpis-snapshot reads three on-disk signals - distinct slugs in state/log/evals.ndjson over the last 7 days, scheduled agents in state/agents/*.json, and pending queue depth in state/log/regen-pending.txt plus state/log/eval-pending.txt - and emits one inline marker:
[[TOOL:KPIBlock]]{"title":"snappy-os pulse","value":"<N> skills","delta":"<M> scheduled","deltaTone":"info","subtitle":"<P> pending"}[[/TOOL]]
The server lifts the marker into a TOOL_CALL_START / TOOL_CALL_ARGS / TOOL_CALL_END triple; snappy-chat renders the KPIBlock card via web/src/genui-library.tsx → KPIBlockComponent.
The route handler at GET /kpis-snapshot (in state/bin/head-screen/server.ts) returns the same JSON shape so the LLM has a deterministic example it can mimic when it chooses to emit a KPIBlock during an SSE chat stream.
Pure read. Never writes. Scope-only by snappy-os convention.
Steps
- Read
state/log/evals.ndjson. Count distinctskillfield values whose
ts is within the last 7 days (rolling). That count is value - render it as "<N> skills".
- Read every JSON file in
state/agents/*.json. Count those whose
status is "running" or "scheduled". That count is delta - render it as "<M> scheduled". Tone stays "info" regardless; this shape is informational, not pass/fail.
- Read
state/log/regen-pending.txtandstate/log/eval-pending.txt.
Sum the non-empty line counts. That sum is subtitle - render it as "<P> pending".
- Build the JSON object `{title:"snappy-os pulse", value, delta,
deltaTone:"info", subtitle} and emit a single [[TOOL:KPIBlock]]{...}[[/TOOL]]` marker on its own line in the assistant text stream. The server's marker-lifter does the rest.
Trigger phrases the dispatcher should recognize: "snappy-os pulse", "system pulse", "kpi snapshot", "health snapshot", "skills count", "how many skills".
Route handler
GET /kpis-snapshot on 127.0.0.1:3147 returns:
{
"ok": true,
"marker": "[[TOOL:KPIBlock]]{\"title\":\"snappy-os pulse\",\"value\":\"157 skills\",\"delta\":\"10 scheduled\",\"deltaTone\":\"info\",\"subtitle\":\"0 pending\"}[[/TOOL]]",
"kpis": { "skills": 157, "scheduled": 10, "pending": 0 }
}
The kpis field carries the raw integers so callers (other skills, the brain layer) can read the same numbers without re-parsing the marker. The marker string is the canonical inline form the LLM mimics.
Eval
Actor: the route handler at GET /kpis-snapshot plus the prose Steps above (the agent walks the three reads and emits one marker). Auditor: independent shape check - the emitted marker MUST match the KPIBlockComponent Zod schema in snappy-chat/web/src/genui-library.tsx (positional order: title, value, delta, deltaTone, subtitle; deltaTone ∈ {ok, warn, info}).
| Outcome | Score |
|---|---|
| Marker emitted with all five fields, deltaTone in enum, all three integers >= 0 | 1.0 |
| Marker emitted but a count is wrong (e.g. agents miscounted) | 0.5 |
| Plain text fallback or marker malformed | 0.0 |
Rubric
criteria:
- name: shape_matches_schema
kind: deterministic
check: "marker has title, value, delta, deltaTone, subtitle keys; deltaTone in {ok,warn,info}; value/delta/subtitle are strings."
- name: numbers_match_disk
kind: deterministic
check: "skills count equals distinct-slug count in evals.ndjson last 7d; scheduled equals running+scheduled agents in state/agents/*.json; pending equals non-empty line count across the two queue files."
- name: single_emit_per_turn
kind: deterministic
check: "exactly one [[TOOL:KPIBlock]] marker per response; the dispatcher MUST NOT re-emit if llmEmittedNames already contains KPIBlock."AGENTS.md- what the AI loads when this skill comes up
kpis-snapshot - loader
Per-turn rules for the kpis-snapshot skill. Full reference: state/skills/kpis-snapshot/SKILL.md. Do not skip these.
Critical Rules
- Pure read. NEVER writes. Scope-only by snappy-os convention; no probe is allowed to mutate state. If asked to "refresh" or "rebuild" the pulse, re-read the three signals - do not write a derived cache.
deltaToneenum isok|warn|info- exactly. TheKPIBlockComponentZod schema insnappy-chat/web/src/genui-library.tsxvalidates this; any off-enum value renders nothing or trips the fallback. For pulse snapshots default toinfo.- Single emit per turn. Exactly one
[[TOOL:KPIBlock]]marker per response. The dispatcher MUST NOT re-emit ifllmEmittedNamesalready containsKPIBlock. - Three reads, three numbers, no fabrication.
value← distinctskillslugs instate/log/evals.ndjsonwhosetsis within the last 7 days (rolling,Date.now() - 7*86400_000- NOT calendar-week).delta← agents whosestatusisrunningorscheduledinstate/agents/*.json.subtitle← non-empty line count summed acrossstate/log/regen-pending.txtANDstate/log/eval-pending.txt. If a file is missing, its contribution is0; do not invent a number. - Marker stays on its own line. The server's marker-lifter scans the assistant text stream; markers split across tokens are tolerated, but a marker buried mid-prose can collide with surrounding punctuation.
- Positional-key order matters. The marker JSON shape is fixed:
{title, value, delta, deltaTone, subtitle}. The renderer reads by name (Zod), but the SKILL.md contract documents the order - keep emitter and rubric in lockstep.
Commands
| ui dashboard | state/skills/kpis-snapshot/resources/ui.openui |
| step | command | |||||
|---|---|---|---|---|---|---|
| invoke (LLM emit) | emit [[TOOL:KPIBlock]]{"title":"snappy-os pulse","value":"<N> skills","delta":"<M> scheduled","deltaTone":"info","subtitle":"<P> pending"}[[/TOOL]] on its own line | |||||
| route (deterministic) | GET http://127.0.0.1:3147/kpis-snapshot → {ok, marker, kpis:{skills, scheduled, pending}} | |||||
| reads | state/log/evals.ndjson \ | state/agents/*.json \ | state/log/regen-pending.txt \ | state/log/eval-pending.txt | ||
| trigger phrases | "snappy-os pulse" \ | "system pulse" \ | "kpi snapshot" \ | "health snapshot" \ | "skills count" \ | "how many skills" |
| score | shape ok + tone in enum + 3 ints ≥0 → 1.0 ; shape ok but a count wrong → 0.5 ; plain text fallback or marker malformed → 0.0 | |||||
| eval log | state/log/evals.ndjson (skill: kpis-snapshot, eval_mode: auto-shape) | |||||
| reference | state/skills/kpis-snapshot/SKILL.md | |||||
| writeback | state/log/loader-feedback.log |
OpenUI Resource
- Skill-owned OpenUI Lang resource:
state/skills/kpis-snapshot/resources/ui.openui. Read it before rendering or editing this skill's generated component surface. - Treat this resource as a first-class artifact of the skill, not a generic chat response. Improve it when the skill's user-facing output needs to become richer.
- System resources compose OpenUI primitives and inherit SnappyChat tokens. Use
ui_contract: brandedin SKILL.md only for deliberate platform or client visuals.
Known Pitfalls
KPIBlockComponentacceptsvalueas string OR number. The route renders"<N> skills"(string) by convention; a bare number renders but loses the unit.- On a fresh clone with empty
evals.ndjson,valueis"0 skills". That's honest, not a bug. Do not pad. - Adding a fourth signal (e.g. open PRs) requires lockstep changes in BOTH
state/bin/head-screen/server.ts(route handler) ANDstate/skills/kpis-snapshot/SKILL.mdrubric block. - The marker MUST land on its own line in the SSE text stream. Mid-prose embedding is tolerated by the lifter but increases false-negative rate against punctuation neighbours.
- Distinct-slug count is a 7-day ROLLING window, not "this week". Off-by-one bugs come from interpreting "this week" as calendar-week.
Self-Test
An agent reading this should correctly:
- [ ] Know this is a prose-only producer skill backed by
GET /kpis-snapshotinstate/bin/head-screen/server.ts(no separatestate/lib/kpis-snapshot.ts)? - [ ] Pick
deltaTonefrom{ok, warn, info}only, defaulting toinfofor pulse snapshots? - [ ] Refuse to emit a KPIBlock if
llmEmittedNamesalready contains it (single-emit-per-turn)? - [ ] Read three on-disk signals - last-7-days distinct slugs, running+scheduled agents, non-empty pending-queue lines - without fabricating?
- [ ] Append the run to
state/log/evals.ndjsonwith skill"kpis-snapshot"andeval_mode: auto-shapefrom the SKILL.md frontmatter?
<!-- kernel-ok: historical attribution for the PID-loader pattern. -->
Self-correcting loader (PID feedback)
This is the rule that makes loaders learn. Ported from snappy-kernel, where it demonstrably worked: the snappy-dom-cartographer skill mapped Skool admin UI once, every later ship-agent inherited the full map for free.
Before you finish, do two things:
1. Fix gaps (P - proportional). MANDATORY. If this loader didn't cover your case - if you had to read another file, run an undocumented command, work around a wrong selector, or discover a quirk - you MUST attempt an Edit to this AGENTS.md before you log.
- Default action: edit this file. Surgical. Add the missing line, table
row, or code example where it belongs. No restructuring.
- Only
LOGGEDis allowed when: the fix needs >10 lines, spans multiple
files, or requires a structural rewrite. In that case the state/regen/drain.sh queue picks it up asynchronously.
- "I didn't have time" / "it's minor" / "the next agent will figure it out"
are NOT valid reasons. Minor gaps compound - that's the whole point of this loop.
- Concrete example of a valid P-fix: discover
agent-browser screenshot
takes path positionally not as --output <path>. One line in a table. Edit it in. Do not just log it.
- The goal: the next agent never has to leave the loader.
2. Log the result.
echo "[$(date -u +%FT%TZ)] kpis-snapshot: <what was missing or fixed> [FIXED|LOGGED] action_kind=<kind>" >> state/log/loader-feedback.log
<slug>MUST be the literal folder name of this loader
(state/skills/<slug>/AGENTS.md). The class token between [ts] and : is the producer slug, the writeback class, AND the grade class - they must be equal so state/lib/controller-tune.ts can pair the brief.
FIXED= you patched this loader inline (P-fix).LOGGED= too large for inline; the PostToolUse enqueue + Stop-hook drain
will rewrite the loader from scratch on next session-end.
action_kindis the SECOND pairing predicate (added 2026-04-27, task #327).
Pick the value that describes what you actually did - same slug, different action_kind means the writeback satisfies a different brief layer:
shape-ok- only frontmatter-shape verification passed (rare from
a human; usually emitted by the lint, not a loader echo)
skill-ran- the skill ran end-to-end and an eval row landed
in state/log/evals.ndjson
loader-rewritten- you EDITED this AGENTS.md inline (the FIXED case),
OR the regen drain rewrote it
pattern-elevated- you promoted a recurring failure to a Critical Rule
(rule fix or new-skill scaffold) If you LOGGED (couldn't fix inline), omit action_kind - the inferrer will pick it up from body keywords.
Do not skip this. Every agent run must leave the system better than it found it. The loader is the setpoint; you are the sensor; the gap is the error signal; closing the gap is the correction.
api.ts- the code it can call
#!/usr/bin/env npx tsx
/**
* snappy-kpis-snapshot/api.ts — emit KPIBlock marker for snappy-os health.
*/
import { score, dispatchRunId } from './eval.ts';
import { readFileSync, readdirSync } from 'fs';
// Step 1: Count distinct skills in evals.ndjson from last 7 days
const evalsData = readFileSync('./state/log/evals.ndjson', 'utf8')
.split('\n')
.filter((l) => l.trim());
const now = new Date();
const sevenDaysAgo = new Date(now.getTime() - 7 * 24 * 60 * 60 * 1000);
const skills = new Set<string>();
for (const line of evalsData) {
try {
const row = JSON.parse(line);
const ts = new Date(row.ts);
if (ts > sevenDaysAgo) {
const skillName = row.skill || row.verb;
if (skillName) skills.add(skillName);
}
} catch {
// skip parse errors
}
}
const skillsCount = skills.size;
// Step 2: Count running/scheduled agents
let scheduledCount = 0;
try {
const agentFiles = readdirSync('./state/agents').filter((f) => f.endsWith('.json'));
for (const file of agentFiles) {
try {
const agent = JSON.parse(readFileSync(`./state/agents/${file}`, 'utf8'));
if (agent.status === 'running' || agent.status === 'scheduled') {
scheduledCount++;
}
} catch {
// skip parse errors
}
}
} catch {
// skip if directory doesn't exist
}
// Step 3: Count pending items
const pendingFiles = ['./state/log/regen-pending.txt', './state/log/eval-pending.txt'];
let pendingCount = 0;
for (const file of pendingFiles) {
try {
const content = readFileSync(file, 'utf8');
const lines = content.split('\n').filter((l) => l.trim().length > 0);
pendingCount += lines.length;
} catch {
// skip missing files
}
}
// Step 4: Build and emit marker
const marker = `[[TOOL:KPIBlock]]{"title":"snappy-os pulse","value":"${skillsCount} skills","delta":"${scheduledCount} scheduled","deltaTone":"info","subtitle":"${pendingCount} pending"}[[/TOOL]]`;
console.log(marker);
// Score: all fields present, deltaTone in enum, all ints >= 0
const isValid =
skillsCount >= 0 && scheduledCount >= 0 && pendingCount >= 0;
const runId = dispatchRunId() || 'kpis-' + Date.now().toString(36);
score('kpis-snapshot', runId, {
score: isValid ? 1.0 : 0.5,
primary_issue: isValid ? null : 'shape-validation-failed',
skills: skillsCount,
scheduled: scheduledCount,
pending: pendingCount,
});
scripts- helper scripts it can run
prose-only skill - 3 inline code blocks live in SKILL.md above (no state/bin/ sidecar yet).
how we check it- the checks, plus the last 10 runs
| timestamp | verb | score | primary_issue | artifact |
|---|---|---|---|---|
| 2026-05-03 04:40Z | - | 1.00 | - | - |
| 2026-05-02 22:43Z | - | 1.00 | - | - |
| 2026-05-02 16:41Z | - | 1.00 | - | - |
| 2026-05-02 10:42Z | - | 1.00 | - | - |
| 2026-05-02 04:41Z | - | 1.00 | - | - |
| 2026-05-01 22:42Z | - | 1.00 | - | - |
| 2026-05-01 16:43Z | - | 1.00 | - | - |
| 2026-05-01 10:42Z | - | 1.00 | - | - |
| 2026-05-01 04:40Z | - | 1.00 | - | - |
| 2026-04-30 22:41Z | - | 1.00 | - | - |