OR Key
drop another .md file to compare - side-by-side diff against brain-insights

brain-insights

Surfaces fresh things your assistant noticed it can now do better.
description: "Triggers on prompt mention of 'brain-insights'."
personal 2 files 10 recent evals

What it does for you

Surfaces fresh things your assistant noticed it can now do better.

What it produces

A recent result, so you can see the kind of work it returns.

loading…

How to get it

These run inside the Snappy workspace. Want this working in your business? I set skills like this up with you, in one focused week.

Work with me
For developers how this skill is built, graded, and how it runs

at a glance- the short version

eval modeauto
categoryOps
stages2
dependslog

what's inside - the parts that make up a skill 2/4 present

A skill is just a few plain-text files. Only the main one is required. The rest are optional, added as the work needs them. This is what the skill is made of; how it runs is just below.

The skill
state/skills/brain-insights/SKILL.md present
the skill itself, in plain text
The main file. It says what the skill is and lays out the steps in plain English.
Code
state/lib/brain-insights.ts not present
code the skill can run
Optional. Many skills are just words and need no code at all.
Scripts
state/bin/brain-insights/ not present
helper scripts
Optional. Added when a skill has a few commands to run.
Loader
state/skills/brain-insights/AGENTS.md present
what the AI loads on the fly
Loaded automatically the moment this skill is needed. Kept short on purpose.

how it's graded - what counts as a good run 4 criteria · 4 deterministic

Each row is one thing a good run has to get right. deterministic means a quick check decides, pass or fail. judge means the AI reads the result and rates it. Grading each piece on its own (instead of one overall score) shows exactly where a run fell short, so the fix is obvious.

name
kind
check
generates_valid_json_output
deterministic
The command `/brain-insights --list` produces an array of JSON objects, each matching the specified 'Shape' in SKILL.md.
cursor_advances_on_read
deterministic
After running `/brain-insights` (default 'read' mode), the 'last_ts' field in `state/log/byline-insights-cursor.json` is updated to a timestamp greater than or equal to the 'ts' of the last displayed insight.
new_insights_detection
deterministic
If a skill's frontmatter changes to `graduation: graduated` within the last 24 hours, running `npx tsx state/bin/brain/insights.ts` results in a new entry in `state/log/insights.ndjson` with `kind: \"capability\"` related to that skill.
pitfall_detection_accuracy
deterministic
If a new bullet is added under `## Known Pitfalls` in a loader (`state/skills/<name>/AGENTS.md`), running `npx tsx state/bin/brain/insights.ts` generates a new entry in `state/log/insights.ndjson` with `kind: \"pitfall\"` referencing that loader.

how it runs - the shared frame every skill uses 3/5 present

Every skill runs the same way. One part does the work, a separate part checks it, and a short loader hands the AI exactly what it needs for the job. Anything this skill doesn't use shows a one-line note saying why, on purpose, not by accident.

makes the work The worker
inferred
npx tsx state/bin/brain/insights.ts` from the run command
No worker is named directly, so the command this skill runs is treated as the worker.
checks the work The reviewer
not present

No separate check found. Without one, the part that makes the work could end up approving its own work, worth a closer look.

frame
learns Self-correction
present
fixes itself learns from gaps
When a run hits a gap, the skill gets edited on the spot [FIXED] or queued for a bigger rewrite [LOGGED], so it keeps getting better.
tidies up Background fixes
present
queued for rewrite runs in the background
Bigger fixes that can't be made on the spot get queued and rewritten in the background later.
remembers Run history
present
state/log/evals.ndjson unknown runs
Every run is written down here, so the next time this skill is used it already knows how the last runs went.
Critical rules the things this skill must not get wrong
  1. NEVER edit state/log/insights.ndjson by hand. Append-only. Rows are deduped by key, so editing breaks the dedup contract.
  2. NEVER write to the cursor directly. Use the script's --ack or --read to advance it atomically.
  3. ALWAYS prefer --read for interactive operator use — it advances the cursor. --list is preview-only and keeps insights unread.
  4. The detector is deterministic — no LLM. If you find yourself dispatching a model to decide what's an insight, stop. The three kinds are precisely defined; add a new detector in code instead.

what it has learned - fixes written back in over time sample

When a run hits something this skill didn't handle, the fix gets written back into the skill so it doesn't happen again. FIXED means it was corrected on the spot. LOGGED means it's queued for a bigger rewrite. Either way, the skill gets a little better and never makes the same mistake twice.

  1. Loading feedback rows…

how the work flows- step by step

inputs log
1 generator
invoke
`npx tsx state/bin/brain/insights.ts` (scan)
2 data
eval log
`state/log/evals.ndjson` (skill: "brain-insights")

SKILL.md- the skill, written out in plain English

brain-insights

The brain's proactive channel. Everything else Robert's OS surfaces answers a question he asked or reports a run he scheduled. This skill answers the question he did NOT ask: "what about me got better while you weren't looking?"

Detects three kinds of change over a rolling 24h window, deterministic (no LLM):

  • capability - a skill's frontmatter flipped from any prior state to

graduation: graduated. The skill now has a sidecar script and auto eval that didn't exist yesterday.

  • pitfall - a loader (state/skills/<name>/AGENTS.md) gained a new

bullet under ## Known Pitfalls. That rule now rides with every prompt mention of <name>, but the operator was never told.

  • parity - a runtime's mean score in state/log/parity.ndjson rose

at least 0.10 when comparing the last 24h to the 24h before.

Each run appends to state/log/insights.ndjson; the byline shows one 💡 row with the unread count, cleared when the operator runs this skill.

Usage

# The byline shows "💡 N new insights"
# Operator runs:
/brain-insights                       # show unread, advance cursor (default "read")
npx tsx state/bin/brain/insights.ts   # scan for new insights (what the cron does)
npx tsx state/bin/brain/insights.ts --list   # preview without advancing cursor
npx tsx state/bin/brain/insights.ts --ack    # mark everything read without showing

Shape

Each row in state/log/insights.ndjson:

{
  "ts": "2026-04-18T22:04:23Z",
  "kind": "capability|pitfall|parity",
  "summary": "one-paragraph human description",
  "evidence_path": "state/skills/<name>.md",
  "one_line_for_byline": "<8-12 char pithy phrase>",
  "key": "capability-<sha1-10>"
}

key dedups - the same graduation, pitfall, or parity bucket won't emit twice. The cursor lives at state/log/byline-insights-cursor.json as {last_ts, written}.

Cron

Scheduled every 30 minutes, matching the breaker cadence:

15,45 * * * * /Users/robertboulos/projects/snappy-os/state/bin/brain/insights-cron.sh

Eval

auto (shape gate): the script must produce at least the output scanned. N new insight(s)... with N >= 0. Cursor must never regress (monotonic). Contract tested in the integration: new graduation event in git → next scan emits exactly one new row for that skill.

Known Pitfalls

  • The 24h baseline is git rev-list -n 1 --before="24 hours ago" HEAD.

If the branch has no commit in the last 24h the baseline is HEAD itself, which means no graduation diffs surface. That's correct behavior (nothing changed in the last 24h) but can feel surprising.

  • Parity insights bucket once per day per runtime: a sustained climb

won't re-surface at every 30-min tick.

  • The fixer adds pitfalls under ## Known Pitfalls; the detector

currently scans any loader diff in that section, not just fixer-auto-added ones. Manual edits to loader pitfalls will also surface - that's intentional but worth naming.

Rubric

criteria:
  - name: generates_valid_json_output
    kind: deterministic
    check: "The command `/brain-insights --list` produces an array of JSON objects, each matching the specified 'Shape' in SKILL.md."
  - name: cursor_advances_on_read
    kind: deterministic
    check: "After running `/brain-insights` (default 'read' mode), the 'last_ts' field in `state/log/byline-insights-cursor.json` is updated to a timestamp greater than or equal to the 'ts' of the last displayed insight."
  - name: new_insights_detection
    kind: deterministic
    check: "If a skill's frontmatter changes to `graduation: graduated` within the last 24 hours, running `npx tsx state/bin/brain/insights.ts` results in a new entry in `state/log/insights.ndjson` with `kind: \"capability\"` related to that skill."
  - name: pitfall_detection_accuracy
    kind: deterministic
    check: "If a new bullet is added under `## Known Pitfalls` in a loader (`state/skills/<name>/AGENTS.md`), running `npx tsx state/bin/brain/insights.ts` generates a new entry in `state/log/insights.ndjson` with `kind: \"pitfall\"` referencing that loader."

AGENTS.md- what the AI loads when this skill comes up

brain-insights - loader

Per-turn rules for the brain-insights skill. Full reference: state/skills/brain-insights/SKILL.md. Do not skip these.

Critical Rules

  • NEVER edit state/log/insights.ndjson by hand. Append-only. Rows are deduped by key, so editing breaks the dedup contract.
  • NEVER write to the cursor directly. Use the script's --ack or --read to advance it atomically.
  • ALWAYS prefer --read for interactive operator use - it advances the cursor. --list is preview-only and keeps insights unread.
  • The detector is deterministic - no LLM. If you find yourself dispatching a model to decide what's an insight, stop. The three kinds are precisely defined; add a new detector in code instead.

Commands

| ui dashboard | state/skills/brain-insights/resources/ui.openui | |invoke: npx tsx state/bin/brain/insights.ts (scan) |interactive: npx tsx state/bin/brain/insights.ts --read (show + ack) |preview only: npx tsx state/bin/brain/insights.ts --list |log: state/log/insights.ndjson |cursor: state/log/byline-insights-cursor.json |eval log: state/log/evals.ndjson (skill: "brain-insights")

OpenUI Resource

  • Skill-owned OpenUI Lang resource: state/skills/brain-insights/resources/ui.openui. Read it before rendering or editing this skill's generated component surface.
  • Treat this resource as a first-class artifact of the skill, not a generic chat response. Improve it when the skill's user-facing output needs to become richer.
  • System resources compose OpenUI primitives and inherit SnappyChat tokens. Use ui_contract: branded in SKILL.md only for deliberate platform or client visuals.

Known Pitfalls

  • git rev-list -n 1 --before="24 hours ago" HEAD can return HEAD itself when the branch has no commit in the last 24h. That's correct (nothing changed) but can feel like a bug.
  • Parity insights use a date-bucket key; they surface at most once per day per runtime even if the detector is scanned every 30 min.

Self-Test

An agent reading this should correctly:

  1. [ ] Use the script, not direct ndjson writes, to append insights?
  2. [ ] Use --read when an operator asks to see insights (so the cursor advances)?
  3. [ ] Understand that the detector must stay deterministic - no LLM?

Self-report

If this loader fell short, append a line:

echo "[$(date -u +%FT%TZ)] brain-insights: <what was missing>" >> state/log/loader-feedback.log

<!-- kernel-ok: historical attribution for the PID-loader pattern. -->

Self-correcting loader (PID feedback)

This is the rule that makes loaders learn. Ported from snappy-kernel, where it demonstrably worked: the snappy-dom-cartographer skill mapped Skool admin UI once, every later ship-agent inherited the full map for free.

Before you finish, do two things:

1. Fix gaps (P - proportional). MANDATORY. If this loader didn't cover your case - if you had to read another file, run an undocumented command, work around a wrong selector, or discover a quirk - you MUST attempt an Edit to this AGENTS.md before you log.

  • Default action: edit this file. Surgical. Add the missing line, table

row, or code example where it belongs. No restructuring.

  • Only LOGGED is allowed when: the fix needs >10 lines, spans multiple

files, or requires a structural rewrite. In that case the state/regen/drain.sh queue picks it up asynchronously.

  • "I didn't have time" / "it's minor" / "the next agent will figure it out"

are NOT valid reasons. Minor gaps compound - that's the whole point of this loop.

  • Concrete example of a valid P-fix: discover agent-browser screenshot

takes path positionally not as --output <path>. One line in a table. Edit it in. Do not just log it.

  • The goal: the next agent never has to leave the loader.

2. Log the result.

echo "[$(date -u +%FT%TZ)] brain-insights: <what was missing or fixed> [FIXED|LOGGED]" >> state/log/loader-feedback.log
  • FIXED = you patched this loader inline (P-fix).
  • LOGGED = too large for inline; the PostToolUse enqueue + Stop-hook drain

will rewrite the loader from scratch on next session-end.

Do not skip this. Every agent run must leave the system better than it found it. The loader is the setpoint; you are the sensor; the gap is the error signal; closing the gap is the correction.

api.ts- the code it can call

⚠ no api.ts - this skill has no typed action surface

scripts- helper scripts it can run

prose-only skill - 4 inline code blocks live in SKILL.md above (no state/bin/ sidecar yet).

how we check it- the checks, plus the last 10 runs

rubric auto shape gate — cursor monotonic, unread count >= 0
recent mean 0.90 · 10 runs actor/auditor: unverifiable
deps log
timestamp verb score primary_issue artifact
2026-04-27 00:38Z - 1.00 - -
2026-04-26 23:47Z - 0.50 - -
2026-04-25 04:11Z - 1.00 - -
2026-04-21 15:58Z - 1.00 - -
2026-04-21 15:56Z - 1.00 - -
2026-04-21 03:53Z - 1.00 - -
2026-04-27 00:38Z - 1.00 - -
2026-04-26 23:47Z - 0.50 - -
2026-04-25 04:11Z - 1.00 - -
2026-04-21 15:58Z - 1.00 - -