OR Key
drop another .md file to compare - side-by-side diff against kpis-snapshot

kpis-snapshot

Shows your key business metrics in one quick snapshot.
description: "Triggers on prompt mention of 'kpis-snapshot', 'snappy-os pulse', 'system pulse', 'health snapshot', 'skills count', 'how many skills'."
personal 2 files 10 recent evals

What it does for you

Shows your key business metrics in one quick snapshot.

What it produces

A recent result, so you can see the kind of work it returns.

loading…

How to get it

These run inside the Snappy workspace. Want this working in your business? I set skills like this up with you, in one focused week.

Work with me
For developers how this skill is built, graded, and how it runs

at a glance- the short version

actorRoute handler at GET /kpis-snapshot plus the prose
auditorIndependent shape
eval modeauto-shape

what's inside - the parts that make up a skill 3/4 present

A skill is just a few plain-text files. Only the main one is required. The rest are optional, added as the work needs them. This is what the skill is made of; how it runs is just below.

The skill
state/skills/kpis-snapshot/SKILL.md present
the skill itself, in plain text
The main file. It says what the skill is and lays out the steps in plain English.
Code
state/lib/kpis-snapshot.ts present
code the skill can run
Reusable code this skill can call when it needs to.
Scripts
state/bin/kpis-snapshot/ not present
helper scripts
Optional. Added when a skill has a few commands to run.
Loader
state/skills/kpis-snapshot/AGENTS.md present
what the AI loads on the fly
Loaded automatically the moment this skill is needed. Kept short on purpose.

how it's graded - what counts as a good run 3 criteria · 3 deterministic

Each row is one thing a good run has to get right. deterministic means a quick check decides, pass or fail. judge means the AI reads the result and rates it. Grading each piece on its own (instead of one overall score) shows exactly where a run fell short, so the fix is obvious.

name
kind
check
shape_matches_schema
deterministic
marker has title, value, delta, deltaTone, subtitle keys; deltaTone in {ok,warn,info}; value/delta/subtitle are strings.
numbers_match_disk
deterministic
skills count equals distinct-slug count in evals.ndjson last 7d; scheduled equals running+scheduled agents in state/agents/*.json; pending equals non-empty line count across the two queue files.
single_emit_per_turn
deterministic
exactly one [[TOOL:KPIBlock]] marker per response; the dispatcher MUST NOT re-emit if llmEmittedNames already contains KPIBlock.

how it runs - the shared frame every skill uses 5/5 present

Every skill runs the same way. One part does the work, a separate part checks it, and a short loader hands the AI exactly what it needs for the job. Anything this skill doesn't use shows a one-line note saying why, on purpose, not by accident.

makes the work The worker
present
Route handler at GET /kpis-snapshot plus the prose an AI model
Does the actual work. Whatever it produces is what gets checked next.
checks the work The reviewer
present
Independent shape the checker
A separate checker grades the work, so the part that made it can't approve its own work.
frame
learns Self-correction
present
fixes itself learns from gaps
When a run hits a gap, the skill gets edited on the spot [FIXED] or queued for a bigger rewrite [LOGGED], so it keeps getting better.
tidies up Background fixes
present
queued for rewrite runs in the background
Bigger fixes that can't be made on the spot get queued and rewritten in the background later.
remembers Run history
present
state/log/evals.ndjson auto-shape runs
Every run is written down here, so the next time this skill is used it already knows how the last runs went.
Critical rules the things this skill must not get wrong
No must-not-break rules called out for this skill. Anything important lives in the writeup below.

what it has learned - fixes written back in over time sample

When a run hits something this skill didn't handle, the fix gets written back into the skill so it doesn't happen again. FIXED means it was corrected on the spot. LOGGED means it's queued for a bigger rewrite. Either way, the skill gets a little better and never makes the same mistake twice.

  1. Loading feedback rows…

how the work flows- who makes it, who checks it

actor Route handler at GET /kpis-snapshot plus the prose
auditor Independent shape

SKILL.md- the skill, written out in plain English

kpis-snapshot

Producer skill that closes the catalog-to-cockpit drift gap for the KPIBlock shape: when the cockpit asks "give me a snappy-os pulse" or "what's the health of the system", the dispatcher used to fall back to plain text because no skill emitted a KPIBlock. kpis-snapshot reads three on-disk signals - distinct slugs in state/log/evals.ndjson over the last 7 days, scheduled agents in state/agents/*.json, and pending queue depth in state/log/regen-pending.txt plus state/log/eval-pending.txt - and emits one inline marker:

[[TOOL:KPIBlock]]{"title":"snappy-os pulse","value":"<N> skills","delta":"<M> scheduled","deltaTone":"info","subtitle":"<P> pending"}[[/TOOL]]

The server lifts the marker into a TOOL_CALL_START / TOOL_CALL_ARGS / TOOL_CALL_END triple; snappy-chat renders the KPIBlock card via web/src/genui-library.tsx → KPIBlockComponent.

The route handler at GET /kpis-snapshot (in state/bin/head-screen/server.ts) returns the same JSON shape so the LLM has a deterministic example it can mimic when it chooses to emit a KPIBlock during an SSE chat stream.

Pure read. Never writes. Scope-only by snappy-os convention.

Steps

  1. Read state/log/evals.ndjson. Count distinct skill field values whose

ts is within the last 7 days (rolling). That count is value - render it as "<N> skills".

  1. Read every JSON file in state/agents/*.json. Count those whose

status is "running" or "scheduled". That count is delta - render it as "<M> scheduled". Tone stays "info" regardless; this shape is informational, not pass/fail.

  1. Read state/log/regen-pending.txt and state/log/eval-pending.txt.

Sum the non-empty line counts. That sum is subtitle - render it as "<P> pending".

  1. Build the JSON object `{title:"snappy-os pulse", value, delta,

deltaTone:"info", subtitle} and emit a single [[TOOL:KPIBlock]]{...}[[/TOOL]]` marker on its own line in the assistant text stream. The server's marker-lifter does the rest.

Trigger phrases the dispatcher should recognize: "snappy-os pulse", "system pulse", "kpi snapshot", "health snapshot", "skills count", "how many skills".

Route handler

GET /kpis-snapshot on 127.0.0.1:3147 returns:

{
  "ok": true,
  "marker": "[[TOOL:KPIBlock]]{\"title\":\"snappy-os pulse\",\"value\":\"157 skills\",\"delta\":\"10 scheduled\",\"deltaTone\":\"info\",\"subtitle\":\"0 pending\"}[[/TOOL]]",
  "kpis": { "skills": 157, "scheduled": 10, "pending": 0 }
}

The kpis field carries the raw integers so callers (other skills, the brain layer) can read the same numbers without re-parsing the marker. The marker string is the canonical inline form the LLM mimics.

Eval

Actor: the route handler at GET /kpis-snapshot plus the prose Steps above (the agent walks the three reads and emits one marker). Auditor: independent shape check - the emitted marker MUST match the KPIBlockComponent Zod schema in snappy-chat/web/src/genui-library.tsx (positional order: title, value, delta, deltaTone, subtitle; deltaTone ∈ {ok, warn, info}).

OutcomeScore
Marker emitted with all five fields, deltaTone in enum, all three integers >= 01.0
Marker emitted but a count is wrong (e.g. agents miscounted)0.5
Plain text fallback or marker malformed0.0

Rubric

criteria:
  - name: shape_matches_schema
    kind: deterministic
    check: "marker has title, value, delta, deltaTone, subtitle keys; deltaTone in {ok,warn,info}; value/delta/subtitle are strings."
  - name: numbers_match_disk
    kind: deterministic
    check: "skills count equals distinct-slug count in evals.ndjson last 7d; scheduled equals running+scheduled agents in state/agents/*.json; pending equals non-empty line count across the two queue files."
  - name: single_emit_per_turn
    kind: deterministic
    check: "exactly one [[TOOL:KPIBlock]] marker per response; the dispatcher MUST NOT re-emit if llmEmittedNames already contains KPIBlock."

AGENTS.md- what the AI loads when this skill comes up

kpis-snapshot - loader

Per-turn rules for the kpis-snapshot skill. Full reference: state/skills/kpis-snapshot/SKILL.md. Do not skip these.

Critical Rules

  1. Pure read. NEVER writes. Scope-only by snappy-os convention; no probe is allowed to mutate state. If asked to "refresh" or "rebuild" the pulse, re-read the three signals - do not write a derived cache.
  2. deltaTone enum is ok|warn|info - exactly. The KPIBlockComponent Zod schema in snappy-chat/web/src/genui-library.tsx validates this; any off-enum value renders nothing or trips the fallback. For pulse snapshots default to info.
  3. Single emit per turn. Exactly one [[TOOL:KPIBlock]] marker per response. The dispatcher MUST NOT re-emit if llmEmittedNames already contains KPIBlock.
  4. Three reads, three numbers, no fabrication. value ← distinct skill slugs in state/log/evals.ndjson whose ts is within the last 7 days (rolling, Date.now() - 7*86400_000 - NOT calendar-week). delta ← agents whose status is running or scheduled in state/agents/*.json. subtitle ← non-empty line count summed across state/log/regen-pending.txt AND state/log/eval-pending.txt. If a file is missing, its contribution is 0; do not invent a number.
  5. Marker stays on its own line. The server's marker-lifter scans the assistant text stream; markers split across tokens are tolerated, but a marker buried mid-prose can collide with surrounding punctuation.
  6. Positional-key order matters. The marker JSON shape is fixed: {title, value, delta, deltaTone, subtitle}. The renderer reads by name (Zod), but the SKILL.md contract documents the order - keep emitter and rubric in lockstep.

Commands

| ui dashboard | state/skills/kpis-snapshot/resources/ui.openui |

stepcommand
invoke (LLM emit)emit [[TOOL:KPIBlock]]{"title":"snappy-os pulse","value":"<N> skills","delta":"<M> scheduled","deltaTone":"info","subtitle":"<P> pending"}[[/TOOL]] on its own line
route (deterministic)GET http://127.0.0.1:3147/kpis-snapshot{ok, marker, kpis:{skills, scheduled, pending}}
readsstate/log/evals.ndjson \state/agents/*.json \state/log/regen-pending.txt \state/log/eval-pending.txt
trigger phrases"snappy-os pulse" \"system pulse" \"kpi snapshot" \"health snapshot" \"skills count" \"how many skills"
scoreshape ok + tone in enum + 3 ints ≥0 → 1.0 ; shape ok but a count wrong → 0.5 ; plain text fallback or marker malformed → 0.0
eval logstate/log/evals.ndjson (skill: kpis-snapshot, eval_mode: auto-shape)
referencestate/skills/kpis-snapshot/SKILL.md
writebackstate/log/loader-feedback.log

OpenUI Resource

  • Skill-owned OpenUI Lang resource: state/skills/kpis-snapshot/resources/ui.openui. Read it before rendering or editing this skill's generated component surface.
  • Treat this resource as a first-class artifact of the skill, not a generic chat response. Improve it when the skill's user-facing output needs to become richer.
  • System resources compose OpenUI primitives and inherit SnappyChat tokens. Use ui_contract: branded in SKILL.md only for deliberate platform or client visuals.

Known Pitfalls

  • KPIBlockComponent accepts value as string OR number. The route renders "<N> skills" (string) by convention; a bare number renders but loses the unit.
  • On a fresh clone with empty evals.ndjson, value is "0 skills". That's honest, not a bug. Do not pad.
  • Adding a fourth signal (e.g. open PRs) requires lockstep changes in BOTH state/bin/head-screen/server.ts (route handler) AND state/skills/kpis-snapshot/SKILL.md rubric block.
  • The marker MUST land on its own line in the SSE text stream. Mid-prose embedding is tolerated by the lifter but increases false-negative rate against punctuation neighbours.
  • Distinct-slug count is a 7-day ROLLING window, not "this week". Off-by-one bugs come from interpreting "this week" as calendar-week.

Self-Test

An agent reading this should correctly:

  1. [ ] Know this is a prose-only producer skill backed by GET /kpis-snapshot in state/bin/head-screen/server.ts (no separate state/lib/kpis-snapshot.ts)?
  2. [ ] Pick deltaTone from {ok, warn, info} only, defaulting to info for pulse snapshots?
  3. [ ] Refuse to emit a KPIBlock if llmEmittedNames already contains it (single-emit-per-turn)?
  4. [ ] Read three on-disk signals - last-7-days distinct slugs, running+scheduled agents, non-empty pending-queue lines - without fabricating?
  5. [ ] Append the run to state/log/evals.ndjson with skill "kpis-snapshot" and eval_mode: auto-shape from the SKILL.md frontmatter?

<!-- kernel-ok: historical attribution for the PID-loader pattern. -->

Self-correcting loader (PID feedback)

This is the rule that makes loaders learn. Ported from snappy-kernel, where it demonstrably worked: the snappy-dom-cartographer skill mapped Skool admin UI once, every later ship-agent inherited the full map for free.

Before you finish, do two things:

1. Fix gaps (P - proportional). MANDATORY. If this loader didn't cover your case - if you had to read another file, run an undocumented command, work around a wrong selector, or discover a quirk - you MUST attempt an Edit to this AGENTS.md before you log.

  • Default action: edit this file. Surgical. Add the missing line, table

row, or code example where it belongs. No restructuring.

  • Only LOGGED is allowed when: the fix needs >10 lines, spans multiple

files, or requires a structural rewrite. In that case the state/regen/drain.sh queue picks it up asynchronously.

  • "I didn't have time" / "it's minor" / "the next agent will figure it out"

are NOT valid reasons. Minor gaps compound - that's the whole point of this loop.

  • Concrete example of a valid P-fix: discover agent-browser screenshot

takes path positionally not as --output <path>. One line in a table. Edit it in. Do not just log it.

  • The goal: the next agent never has to leave the loader.

2. Log the result.

echo "[$(date -u +%FT%TZ)] kpis-snapshot: <what was missing or fixed> [FIXED|LOGGED] action_kind=<kind>" >> state/log/loader-feedback.log
  • <slug> MUST be the literal folder name of this loader

(state/skills/<slug>/AGENTS.md). The class token between [ts] and : is the producer slug, the writeback class, AND the grade class - they must be equal so state/lib/controller-tune.ts can pair the brief.

  • FIXED = you patched this loader inline (P-fix).
  • LOGGED = too large for inline; the PostToolUse enqueue + Stop-hook drain

will rewrite the loader from scratch on next session-end.

  • action_kind is the SECOND pairing predicate (added 2026-04-27, task #327).

Pick the value that describes what you actually did - same slug, different action_kind means the writeback satisfies a different brief layer:

  • shape-ok - only frontmatter-shape verification passed (rare from

a human; usually emitted by the lint, not a loader echo)

  • skill-ran - the skill ran end-to-end and an eval row landed

in state/log/evals.ndjson

  • loader-rewritten - you EDITED this AGENTS.md inline (the FIXED case),

OR the regen drain rewrote it

  • pattern-elevated - you promoted a recurring failure to a Critical Rule

(rule fix or new-skill scaffold) If you LOGGED (couldn't fix inline), omit action_kind - the inferrer will pick it up from body keywords.

Do not skip this. Every agent run must leave the system better than it found it. The loader is the setpoint; you are the sensor; the gap is the error signal; closing the gap is the correction.

api.ts- the code it can call

#!/usr/bin/env npx tsx
/**
 * snappy-kpis-snapshot/api.ts — emit KPIBlock marker for snappy-os health.
 */
import { score, dispatchRunId } from './eval.ts';
import { readFileSync, readdirSync } from 'fs';

// Step 1: Count distinct skills in evals.ndjson from last 7 days
const evalsData = readFileSync('./state/log/evals.ndjson', 'utf8')
  .split('\n')
  .filter((l) => l.trim());
const now = new Date();
const sevenDaysAgo = new Date(now.getTime() - 7 * 24 * 60 * 60 * 1000);

const skills = new Set<string>();
for (const line of evalsData) {
  try {
    const row = JSON.parse(line);
    const ts = new Date(row.ts);
    if (ts > sevenDaysAgo) {
      const skillName = row.skill || row.verb;
      if (skillName) skills.add(skillName);
    }
  } catch {
    // skip parse errors
  }
}
const skillsCount = skills.size;

// Step 2: Count running/scheduled agents
let scheduledCount = 0;
try {
  const agentFiles = readdirSync('./state/agents').filter((f) => f.endsWith('.json'));
  for (const file of agentFiles) {
    try {
      const agent = JSON.parse(readFileSync(`./state/agents/${file}`, 'utf8'));
      if (agent.status === 'running' || agent.status === 'scheduled') {
        scheduledCount++;
      }
    } catch {
      // skip parse errors
    }
  }
} catch {
  // skip if directory doesn't exist
}

// Step 3: Count pending items
const pendingFiles = ['./state/log/regen-pending.txt', './state/log/eval-pending.txt'];
let pendingCount = 0;
for (const file of pendingFiles) {
  try {
    const content = readFileSync(file, 'utf8');
    const lines = content.split('\n').filter((l) => l.trim().length > 0);
    pendingCount += lines.length;
  } catch {
    // skip missing files
  }
}

// Step 4: Build and emit marker
const marker = `[[TOOL:KPIBlock]]{"title":"snappy-os pulse","value":"${skillsCount} skills","delta":"${scheduledCount} scheduled","deltaTone":"info","subtitle":"${pendingCount} pending"}[[/TOOL]]`;
console.log(marker);

// Score: all fields present, deltaTone in enum, all ints >= 0
const isValid =
  skillsCount >= 0 && scheduledCount >= 0 && pendingCount >= 0;

const runId = dispatchRunId() || 'kpis-' + Date.now().toString(36);
score('kpis-snapshot', runId, {
  score: isValid ? 1.0 : 0.5,
  primary_issue: isValid ? null : 'shape-validation-failed',
  skills: skillsCount,
  scheduled: scheduledCount,
  pending: pendingCount,
});

scripts- helper scripts it can run

prose-only skill - 3 inline code blocks live in SKILL.md above (no state/bin/ sidecar yet).

how we check it- the checks, plus the last 10 runs

rubric auto-shape no rubric declared
recent mean 1.00 · 10 runs actor/auditor: unverifiable
deps none declared
timestamp verb score primary_issue artifact
2026-05-03 04:40Z - 1.00 - -
2026-05-02 22:43Z - 1.00 - -
2026-05-02 16:41Z - 1.00 - -
2026-05-02 10:42Z - 1.00 - -
2026-05-02 04:41Z - 1.00 - -
2026-05-01 22:42Z - 1.00 - -
2026-05-01 16:43Z - 1.00 - -
2026-05-01 10:42Z - 1.00 - -
2026-05-01 04:40Z - 1.00 - -
2026-04-30 22:41Z - 1.00 - -