vault-sync: 2026-10-11 06:00 (jimmy)

memory-systems/agent-os/dream/2026-10-10.md

@@ -0,0 +1,98 @@
+# Dream Log — 2026-10-10
+
+> First Dream Mode run (job created today; target = the day that created it).
+> Sources: [[sessions/2026-10-10]], [[04_projects/trace-review-bot/2026-10-10-trace-analysis-and-fix]], cron outputs, session `@session:jimmy/20261010_154339_ceb19ec0`.
+
+## 🧩 Daily Summary
+
+Two distinct halves, both high-agency "build the machine" work rather than task execution.
+
+**Morning (≈08:16–09:05 PT)** — diagnosis + infrastructure setup:
+1. Traced the recurring headless builder/reviewer `BLOCKED` failures to root cause and wrote a fix plan.
+2. Built **Dream Mode** itself: the `memory-and-reflection` skill, `skill_review.py`, the `dream/` vault dir, and the 2 AM cron job — the very job producing this note.
+
+**Evening (≈15:43–23:09 PT)** — the strategic session:
+3. Turned "autopsy a corpus of dead strategies" into a real project (**killcorpus**): pre-registered paper-testing loop, locked schema, locked market scope, locked agent roles.
+4. Scaffolded + committed the spec and an instrumented harness; held every external action; dispatched the builder for the live path.
+5. Hit a hard external gate: system clock skew (−284 ms vs 250 ms gate) → deliberately **held the evaluation run**.
+
+Theme of the day: *discipline over throughput* — pre-registration before runs, critics independent from proposers, external writes held, and an explicit refusal to start a clock that would have voided every measurement.
+
+## 🔑 Key Interactions
+
+- **Trace-fix diagnosis** (`20261006_194024_3b8364e5`, 08:16 PT). User: "Analyze the traces and recommend a fix." Root cause: builder/reviewer run headless (`-q`) with `approvals.mode` unset → defaults to `manual` → no user → every dangerous-pattern match (bash -c, python -c, rm -r, kill -9) times out to `BLOCKED`; the `execute_code` fallback is gated too, producing the retry loop. Deliverable: [[04_projects/trace-review-bot/2026-10-10-trace-analysis-and-fix]] with Fix A `approvals.mode: smart`, Fix B tool-loop guardrails, Fix C timeout 300, Fix D optional allowlist. **Held for Tony's approval — not applied.**
+- **Dream Mode setup** (same thread, 08:28–09:05 PT). User pasted a Linux Dream-Mode template and said "Make this match my setup." Ported paths to Windows, `<user>`→Tony, `python3`→`python`, and *created the missing infrastructure* (skill + script + `dream/` + cron). Confirmed "Perfect."
+- **Autopsy-corpus seed** (`@session:jimmy/20261010_154339_ceb19ec0`, 15:47 PT). Tony pasted a Grok-generated idea: the durable asset is failures-with-autopsies, not strategies. Agreed with the spine; **added the load-bearing field**: pre-registration — kill criteria and cost assumptions timestamped *before* the run, else the corpus re-imports survivorship bias.
+- **Market-scope lock** (16:06 PT). Grok pushed a locked scope (thin Kalshi/Polymarket books, niche event contracts, illiquid micro-caps). Corrected with live-checked facts: **Kalshi taker fee** = `round_up(0.07·C·P·(1−P))`, **maker fee = 0 on ~12,500 of 12,699 series**. Verdict: split maker vs relative-value into two edges; relative-value (taker, closed-form cost) is primary/high-throughput, maker secondary (fill-probability is the research problem). Polymarket US is a separate, thinner, KYC-gated venue with contested CA status; Kalshi CA is clean.
+- **Grok-as-critic correction** (16:42 PT). Flagged the structural flaw: Grok generated the scope, so making it the adversarial critic yields correlated blind spots. Rule: *the critic must be a different engine than whoever proposed the claim.* Also caught Grok's fee line as the **taker** fee silently doing the work of killing the maker branch. Hardened the success metric: **cleanly-falsified claims per week at bounded cost**, PnL a rare lagging output.
+- **killcorpus build** (≈16:55–17:20 PT). Repo `C:\Users\fight\Projects\killcorpus` scaffolded; spec `KXBTCD-lag-vs-spot` v1.1.1 committed; `harness/paper_trader_instrumented.py` (29 KB, stdlib, taker-only, measured slippage, variance gate σ²=0.25, latency gates 1000/500/250 ms) selftest green. Independently verified by jimmy (not taken on the builder's word). Gitea push **held**; builder dispatched for the live feed→fill→settlement path with the clock explicitly locked (no `REG_TS`).
+- **Clock gate → hold the eval** (23:09 PT, session end). Allowlist applied to all four loop profiles (planner/reviewer/builder/jimmy); headless builder selftest proven end-to-end (exit 0). Then: `w32tm` reports `Leap Indicator: 3 (not synchronized)`, skew **−284 ms** across three NTP sources vs the 250 ms gate. Recommendation: **hold the deliberate eval** — any run now voids every candidate as `measurement_artifact`. Prereqs before eval: clock fix (needs Tony at the PC, UAC), one live settlement observed, a durable runner.
+
+## 📊 Quality Assessment
+
+**Did well**
+- **Refused the fabricated shortcut.** Multiple times the honest gap was named rather than papered over: the harness "has **not** run against live data"; the seeded claim "could not be found — treating KXBTCD as it"; the clock gate held the run instead of letting it proceed. This is exactly the discipline the project is about, applied to itself.
+- **Corrected the powerful narrator.** Grok's plan was corrected on three counts (taker-vs-maker, critic independence, success metric) with live-verified numbers, not vibes.
+- **Independent verification over trust.** Re-ran the harness `--selftest` and checked `polyterm/paper_trader.py` mtime (unchanged) rather than accept the builder's "green".
+- **Held every external write** (Gitea push) without being asked twice.
+
+**Did poorly / could be better**
+- The **same approval-gate errors were diagnosed in the morning but recurred all day** (trace miner 07:30 shows `w=21` terminal blocks, `w=17` execute_code blocks). The fix existed as a written plan but wasn't applied — so the afternoon session still fought blocks. When the root cause is known and the fix is cheap, the cost of *not* applying it compounds within the same day.
+- The trace-analysis doc is **thorough but unapplied** — a diagnosis with no owner is just a document. It ended "fix pending Tony's approval" and stayed there.
+- Some explicit verification positives (Kalshi fee schedule, series count) were leaned on heavily as "verified just now" without a citation path retained in the note.
+
+**Confusion / misinterpretation**
+- Session bookkeeping was muddy: two overlapping threads (the ongoing "Testing" Telegram thread and the `20261010_154339` sub-thread with parent `20261002_155743`) made "which session is the day" non-obvious. The session log attributes morning items to `3b8364e5` and evening items to the newer id — reconciliable, but costly to reconstruct.
+
+**Errors / hallucinations avoided**
+- Did **not** invent the missing competition records (F1–F3, the two books, the three kills) — flagged them missing instead. 
+- Did **not** claim the harness ran live when it hadn't. 
+- Did **not** start the evaluation clock. 
+- Did **not** apply config changes without approval.
+
+## 🧠 Lessons Learned
+
+1. **A known root cause with a cheap fix should not survive the day it was found.** Diagnose → propose → *ask in the same turn*, and if approved, apply immediately. The trace-analysis doc should have been closed, not filed.
+2. **Pre-registration is the load-bearing field of any falsification corpus.** Without kill criteria timestamped before the run, post-hoc autopsy smuggles survivorship bias back in. Applies beyond trading — to any "what worked/didn't" claim.
+3. **A critic must be a different engine from the proposer of the claim.** Correlated blind spots collapse adversarial review into sycophancy. Rotate roles; never hard-wire one model as permanent critic.
+4. **Maker vs taker are different edges with different kill criteria.** A taker fee that kills one branch (closed-form cost) says nothing about a maker branch whose real problem is fill probability + adverse selection. Name which cost you're invoking before concluding an edge is dead.
+5. **Optimize the loop for honest falsification, not PnL.** PnL is a rare lagging output; chasing it un-disciplines the only durable asset.
+6. **Measurement integrity gates the experiment.** Clock skew above the gate voids *every* candidate as `measurement_artifact`. Fix the instrument before running the test — not after.
+7. **Created-missing-infrastructure is a legitimate, high-value response.** When the user's template references things that don't exist (the skill, the script, the dir), build them and say so — don't just adapt the parts that exist.
+
+## 🎭 Behavioral Adjustments for Tomorrow
+
+- When a root-cause fix is scoped and cheap, end the turn with the **approval ask**, and apply on "yes" in the same session — do not leave it as a vault document.
+- In any strategy/test discussion, **ask which branch (maker vs taker / proposer vs critic) before evaluating** — the cost model and kill criteria differ.
+- Keep the **honest-gap ledger** visible in every build report: what's wired, what's offline-only, what remains (live path, N=967 accrual, durable runner).
+- Retain a **citation path** for externally-verified facts (fee schedules, endpoint shapes) so the next session can re-check without re-deriving.
+
+## 📂 Memory Candidates
+
+- **killcorpus** is a real, active project: `C:\Users\fight\Projects\killcorpus`, paper-only, spec `KXBTCD-lag-vs-spot` v1.1.1, instrumented harness (`harness/paper_trader_instrumented.py`), Gitea `Tony_tech/killcorpus` (push held). Sibling: `polyterm/paper_trader.py` (read-only reference, live-forward since Oct 9).
+- **Dream Mode is live** as of Oct 10: skill `memory-and-reflection`, script `scripts/skill_review.py`, cron `Dream Mode (nightly reflection)` @ 2 AM, vault `Obsidian Vault/dream/`. (Already implicit in this job; the durable fact is that it exists and where its pieces live.)
+- **Standing preference confirmed:** Tony runs a *multi-profile agent loop* — planner=Proposer, reviewer=Critic, builder=Executor, jimmy=Recorder — and keeps `approvals.mode` unset by default (headless-safe only after allowlist/fix). Config changes require his explicit approval.
+- **Durable principle Tony endorsed:** the durable asset is a corpus of honest *failures with autopsies*, and the success metric is cleanly-falsified claims per week at bounded cost — not PnL. (Belongs more in `insights.md` than in always-on memory.)
+
+## ❓ Open Questions
+
+- **Apply the trace-fix now?** The builder/reviewer approval-gate fix (Fix A `approvals.mode: smart` + Fix B guardrails + Fix C timeout 300) is written but unapplied. It blocked sessions all day. → "Apply the builder/reviewer config fixes?" (needs his approval; config edits).
+- **Clock fix:** the deliberate killcorpus eval is blocked on `w32tm` skew (−284 ms vs 250 ms gate). Needs Tony at the PC for the UAC elevation to run `w32tm-fix.bat`.
+- **Gitea push for killcorpus:** still held — push when he wants the remote copy.
+- **Merge skills?** `test-driven-development` ↔ `test-driven-development` (similarity 1.0 — a same-name duplicate across two directories); `writing-for-agents` ↔ `writing-fragments` (0.91).
+  - "Merge/remove the duplicate `test-driven-development`? — reply yes and I'll do it"
+  - "Merge `writing-fragments` into `writing-for-agents`? — reply yes and I'll do it"
+
+## 🚀 Opportunities for Future Improvement
+
+- **Dream Mode inaugural run** — validate the chunk-write discipline held (it did; this note was written in 3 small pieces). Next: confirm the 2 AM job reliably finds the day's sessions without manual reconciliation.
+- **Close the diagnosis loop:** add a step so that a written root-cause fix is either applied same-day or explicitly surfaced as the top open question — never silently filed.
+- **Durable runner** for killcorpus: the N=967 accrual over days–weeks needs a process that survives sessions (cron / `terminal(background=true, persist_on_release=true)`), not a foreground run.
+- **Live-settlement proof:** no smoke has yet produced a *settled* trade (all open/reset). Prove the settle path before trusting a multi-day clock.
+
+## 🧰 Skill Review
+
+- Script `skill_review.py --apply`: **200 skills scanned, 0 archived** (none idle ≥90d), stale-watchlist 0.
+- Merge candidates (5): `test-driven-development ↔ test-driven-development` (1.0), `writing-for-agents ↔ writing-fragments` (0.91), `source-driven-development ↔ spec-driven-development` (0.88), `omh-ralph-driver ↔ omh-ralplan-driver` (0.88), `test-driven-development ↔ spec-driven-development` (0.87).
+- Proposing 2 (see ❓ Open Questions): the TDD same-name duplicate, and `writing-fragments` → `writing-for-agents`.
+- Weekly curator: newest report `logs/curator/20261007-195403` predates the target-day window — nothing to fold in.

memory-systems/agent-os/dream/insights.md

@@ -0,0 +1,29 @@
+# Insights — Dream Mode Consolidated Learnings
+
+> Living, de-duplicated knowledge base. Themes, not an append log. Newest evidence strengthens or replaces existing entries.
+> Opened 2026-10-10 (first Dream Mode run).
+
+## 🏛️ Standing Principles (epistemics & discipline)
+
+- **Pre-registration is load-bearing.** For any falsification loop ("what died and why"), kill criteria + cost assumptions must be timestamped *before* the run. Post-hoc autopsies re-import survivorship bias through the writer. Schema must force the field.
+- **The critic must be a different engine than the proposer of the claim.** Hard-wiring one model (even a strong one) as permanent critic creates correlated blind spots → sycophancy collapse. Rotate roles (planner proposes, reviewer critiques — separate profiles count).
+- **Optimize for honest falsification, not PnL.** Success metric = cleanly-falsified claims per week at bounded cost. PnL is a rare lagging output; chasing it un-disciplines the only durable asset.
+- **Measurement integrity gates the experiment.** If the instrument is broken (clock skew, unmeasured latency), the run is void — fix the instrument *before* running. Refuse to start a clock that would void every result.
+- **The durable asset is failures-with-autopsies**, not strategies. Wins are published (survivorship bias + marketing); a fee-adjusted record of what died and why is scarce and never has to be re-learned.
+- **Honest-gap ledger.** Every build report names what's wired, what's offline-only, what remains. Never claim live behavior that hasn't run.
+- **Name which cost/branch you're invoking before concluding.** E.g. a *taker* fee says nothing about a *maker* edge's viability.
+- **A known root cause with a cheap fix should not survive the day it was found** — diagnose → propose → ask in the same turn; apply on approval.
+
+## 🛠️ Technical Notes
+
+- **Kalshi fees (verified 2026-10-10):** taker = `round_up(0.07·C·P·(1−P))`, charged only when you take. **Maker fee = 0 on ~12,500 of 12,699 series** (only ~129 series tax resting orders, quarter rate; cancelling free; 14 niche series fee-free). Polymarket **US** is a separate, thinner, full-KYC venue with contested CA status; Kalshi CA is clean (CFTC DCM).
+- **Headless (`-q`/`--oneshot`) approval gate:** profiles with `approvals.mode` unset default to `manual` → no user → dangerous-pattern commands (`python -c`, `execute_code`, `rm -r`, `kill -9`, heredocs) time out to `BLOCKED`. The `execute_code` fallback is gated too → retry loop that burns context. Fix: `approvals.mode: smart` (+ `command_allowlist` for scoped safe patterns) + tool-loop guardrails (`hard_stop_after: 5`). Cron-safe only after allowlist/config applied.
+- **Cron/unattended tool limits:** `python -c`, `execute_code`, and heredoc script execution are blocked in unattended (-q) runs unless allowlisted; `write_file` refuses overwrite without a prior read (pagination paradox); `terminal` foreground cap 600s (else promoted to tracked background).
+- **killcorpus** (`C:\Users\fight\Projects\killcorpus`): paper-only. Spec `KXBTCD-lag-vs-spot` v1.1.1 (taker primary; maker secondary pending fill model). Harness `harness/paper_trader_instrumented.py` — instrumented (book_read_ts, ntp_offset_ms, spot_age_ms, realized_slippage), variance gate σ²=0.25, latency gates 1000/500/250 ms, fixed N=967 post-registration. Offline selftest green; live feed→fill→settlement path **not yet wired**. Gitea `Tony_tech/killcorpus` push **held**. Reference (read-only, do not edit): `polyterm/paper_trader.py`.
+- **Agent-loop roles:** planner=Proposer, reviewer=Critic, builder=Executor, jimmy=Recorder.
+
+## 🧵 Open Threads
+
+- Trace-fix (builder/reviewer `approvals.mode: smart` + guardrails + timeout 300) written, unapplied — awaiting Tony's approval. See [[../04_projects/trace-review-bot/2026-10-10-trace-analysis-and-fix]].
+- killcorpus deliberate eval **on hold**: `w32tm` unsynchronized, skew −284 ms vs 250 ms gate. Prereqs: clock fix (UAC, at PC), one live settlement observed, durable runner.
+- Dream Mode live as of 2026-10-10 (skill + `skill_review.py` + 2 AM cron + `dream/`). First note = this run.