vault-sync: 2026-10-06 00:00 (jimmy)

2026-10-06 00:00:47 -07:00
parent fd3953cd3b
commit d7d743a8a1
9 changed files with 883 additions and 0 deletions
@@ -0,0 +1,170 @@
+---
+title: Agent Operations — Problems Registry
+tags: [agent-operations, problems, registry, hermes]
+scope: shared
+generated: 2026-10-06
+source: HermesHost/diagnostics/backfill/all-v1/registry.md
+---
+
+> Cross-profile (default, jimmy, leonard, verimail). Baseline backfill, day one → 2026-10-06.
+> Nightly deltas append to [[problems-log]]. Per-agent detail: [[02_agents/leonard/failure-ledger]].
+
+# Agent Operations — Problems Registry (backfill, since day one)
+
+> Generated 2026-10-06T05:51:36+00:00 · deterministic miner `problem_miner.py` + 10-agent swarm · evidence-cited.
+> Window: 2026-08-28 → 2026-10-06 (all 4 profiles: default, jimmy, leonard, verimail).
+> Sources: 3444 problem events → 192 clustered findings → 37 themes. Occurrence-weighted total: 2583.
+
+## Ranked themes
+
+| # | Theme | Occurrences | Findings | Severity | Profiles |
+|---|-------|------------:|---------:|----------|----------|
+| 1 | timeouts | 715 | 35 | high | default, jimmy, leonard, verimail |
+| 2 | generic exit codes | 444 | 8 | medium | default, jimmy, leonard |
+| 3 | path / file not found | 205 | 13 | high | default, jimmy, leonard, verimail |
+| 4 | python runtime tracebacks | 187 | 7 | high | default, jimmy, leonard |
+| 5 | config key churn / bad subcommands | 141 | 4 | medium | default, jimmy |
+| 6 | git remote / auth | 105 | 5 | high | default, jimmy, leonard |
+| 7 | terminal background/notify misuse | 105 | 7 | medium | default, jimmy, leonard |
+| 8 | patch old_string / escape drift | 85 | 6 | high | default, jimmy, leonard |
+| 9 | ripgrep / search_files | 71 | 11 | medium | default, jimmy, leonard, verimail |
+| 10 | memory at capacity | 68 | 7 | high | default, jimmy, leonard |
+| 11 | skill description budget | 61 | 7 | medium | default, jimmy, leonard |
+| 12 | approval / consent block | 51 | 10 | medium | default, jimmy, leonard |
+| 13 | user friction (corrections) | 32 | 7 | high | default, jimmy, leonard |
+| 14 | tool_call batching / bridge misuse | 27 | 6 | high | jimmy, leonard |
+| 15 | skill_manage malformed / skill not found | 27 | 6 | medium | jimmy |
+| 16 | command not found | 26 | 6 | medium | default, jimmy, leonard |
+| 17 | tailnet / SSH / VPS | 20 | 3 | high | default, jimmy, leonard |
+| 18 | uv trampoline | 20 | 1 | high | default |
+| 19 | PowerShell/cmd syntax in bash | 18 | 2 | medium | jimmy |
+| 20 | cron jobs / reminders | 17 | 2 | high | default, leonard |
+| 21 | missing python module | 15 | 3 | medium | jimmy |
+| 22 | local model load/serve | 14 | 4 | high | jimmy, leonard |
+| 23 | Hermes config write refused | 14 | 3 | medium | jimmy |
+| 24 | browser_exec / CDP hangs | 13 | 2 | medium | jimmy, leonard |
+| 25 | detector false positives | 12 | 1 | low | default |
+| 26 | memory tool misuse | 12 | 2 | medium | jimmy |
+| 27 | model/output identity errors | 10 | 5 | high | jimmy |
+| 28 | process_manage | 10 | 2 | medium | jimmy |
+| 29 | Telegram gateway down | 10 | 4 | high | jimmy, leonard |
+| 30 | memory_search zg binary missing | 10 | 1 | high | jimmy |
+| 31 | unwanted voice / TTS | 9 | 2 | medium | jimmy, leonard |
+| 32 | shell quoting / eval errors | 7 | 3 | medium | default, jimmy, leonard |
+| 33 | Docker | 6 | 2 | medium | jimmy, leonard |
+| 34 | vision_analyze | 6 | 2 | medium | jimmy, leonard |
+| 35 | write_file overwrite guard | 4 | 1 | high | jimmy |
+| 36 | secret/credential read refused | 4 | 1 | high | jimmy |
+| 37 | other | 2 | 1 | medium | leonard |
+
+## Detail (top 15)
+
+### 1. timeouts — 715 occurrences, severity high
+- **Profiles:** default, jimmy, leonard, verimail  ·  **Lanes:** default-first-week, default-rest, jimmy-recent, jimmy-w1, jimmy-w2, jimmy-w3, jimmy-w4, jimmy-w5, leonard-rest, leonard-w1
+- **Root cause:** Commands routinely exceed default timeouts and the agent neither raises timeout= nor backgrounds long jobs, so downloads, model startups and pings die mid-run.
+- **Suggested fix:** Default long commands to background=true with notify_on_complete=true and set an explicit timeout= where a foreground wait is required.
+- **Evidence:** `default:20260829_075244_4ffe68a7#3428`, `default:20260828_144747_49a94d46#1621`, `default:20260830_140032_70edf88c#21543`, `default:20260901_210256_6c1c52da#26838`, `default:20260901_210256_6c1c52da#26361`, `default:20260830_140032_70edf88c#19000`
+- **Example findings:** Tool command timeouts (foreground terminal + execute_code kernel); SSH access to VPS / tailnet hosts failing; BLOCKED: approval/consent timeouts on gated commands; Safety-approval gate blocks dangerous commands in unattended single-query mode
+
+### 2. generic exit codes — 444 occurrences, severity medium
+- **Profiles:** default, jimmy, leonard  ·  **Lanes:** default-first-week, jimmy-w1, jimmy-w2, jimmy-w3, jimmy-w4, jimmy-w5, leonard-rest, leonard-w1
+- **Root cause:** unclear from evidence
+- **Suggested fix:** Capture and log stderr alongside the exit code for diagnosability.
+- **Evidence:** `default:20260828_144747_49a94d46#1619`, `default:20260828_201637_807fd2ff#2548`, `default:20260828_201637_807fd2ff#2643`, `jimmy:20260903_131512_23f3ecc7#983`, `jimmy:20260903_131512_23f3ecc7#1256`, `jimmy:20260903_072353_f46f323c#383`
+- **Example findings:** Miscellaneous command failures (generic non-zero exit codes); Miscellaneous command failures (bare exit codes); Miscellaneous command failures (bare non-zero exit codes); Miscellaneous command failures (bare exit codes)
+
+### 3. path / file not found — 205 occurrences, severity high
+- **Profiles:** default, jimmy, leonard, verimail  ·  **Lanes:** default-first-week, default-rest, jimmy-recent, jimmy-w1, jimmy-w2, jimmy-w3, jimmy-w5, leonard-rest, leonard-w1
+- **Root cause:** The agent repeatedly issues MSYS/Linux-style or otherwise wrong paths on Windows (and wrong working directories), so file and cd operations fail.
+- **Suggested fix:** Resolve the real Windows path first (forward-slash native form) and confirm existence before reading/cd; prefer search_files to locate.
+- **Evidence:** `default:20260828_165853_0ff9f889#2009`, `default:20260901_210256_6c1c52da#26668`, `default:20260830_140032_70edf88c#15170`, `default:20260918_124517_372cda#36420`, `default:20260918_124517_372cda#36529`, `default:20260919_133653_cfea5b#37337`
+- **Example findings:** File/path not found on Windows (path translation failures); Referenced files, scripts, and paths do not exist; Generic command failures (bare exit_code=N); read_file 'File not found' on guessed paths
+
+### 4. python runtime tracebacks — 187 occurrences, severity high
+- **Profiles:** default, jimmy, leonard  ·  **Lanes:** default-first-week, default-rest, jimmy-w1, jimmy-w2, leonard-rest
+- **Root cause:** The agent writes Python (in execute_code and inline python) that throws syntax/name/shape errors, repeatedly burning turns on self-inflicted exceptions.
+- **Suggested fix:** Run smaller snippets, print intermediate values, and read the traceback before re-issuing; validate generated code before long batches.
+- **Evidence:** `default:20260830_100546_480c392f#9553`, `default:20260830_100546_480c392f#9762`, `default:20260830_100546_480c392f#10158`, `default:20260901_210256_6c1c52da#31880`, `default:20260901_210256_6c1c52da#31885`, `default:20260830_140032_70edf88c#15839`
+- **Example findings:** Agent-generated Python raises tracebacks in execute_code / terminal; Script data/schema errors (sqlite & JSON shape); IMAP fetches fail with traceback; execute_code cell raises runtime traceback
+
+### 5. config key churn / bad subcommands — 141 occurrences, severity medium
+- **Profiles:** default, jimmy  ·  **Lanes:** default-first-week, jimmy-recent, jimmy-w2
+- **Root cause:** The agent runs POSIX tools (python3, dig, sshpass, expect) absent from the Windows bash, and emits cmd.exe/PowerShell syntax (taskkill, Restart-Service, quotes) that bash misparses.
+- **Suggested fix:** Probe tool availability first (which/command -v) and pick Windows-native equivalents or full exe paths; avoid cmd/PowerShell-only syntax in bash.
+- **Evidence:** `default:20260901_210256_6c1c52da#27257`, `default:20260901_210256_6c1c52da#26102`, `default:20260830_140032_70edf88c#16099`, `default:20260829_135124_84d145aa#4310`, `default:20260831_154908_9c27060c#22115`, `default:20260830_140032_70edf88c#16391`
+- **Example findings:** Windows shell environment mismatch and missing CLI tools; Hermes CLI subcommand/flag misuse; agent-reach CLI given an invalid subcommand; Provider/model config churn and unsupported config keys
+
+### 6. git remote / auth — 105 occurrences, severity high
+- **Profiles:** default, jimmy, leonard  ·  **Lanes:** default-first-week, jimmy-w1, jimmy-w3, jimmy-w5, leonard-w1
+- **Root cause:** Git remotes are misconfigured (bad Gitea hostname, missing/expired HTTPS credentials, unsupported ssl-no-revoke flag) and pushes race with remote updates.
+- **Suggested fix:** Standardize the Gitea remote URL and token, drop unsupported flags, and pull/rebase before pushing.
+- **Evidence:** `default:20260901_210256_6c1c52da#26833`, `default:20260901_210256_6c1c52da#26844`, `default:20260901_210256_6c1c52da#33282`, `jimmy:20260903_072353_f46f323c#422`, `jimmy:20260903_072353_f46f323c#430`, `jimmy:20260902_110459_eb6003#1034`
+- **Example findings:** Git remote auth / push failures; PowerShell/cmd syntax executed in a bash shell; Python module/import path failures; Command not found (gh, mcporter, getent)
+
+### 7. terminal background/notify misuse — 105 occurrences, severity medium
+- **Profiles:** default, jimmy, leonard  ·  **Lanes:** default-first-week, default-rest, jimmy-recent, jimmy-w2, jimmy-w4, leonard-rest, leonard-w1
+- **Root cause:** The agent shells out with '&' or passes notify to foreground terminal calls instead of using the tool's background/notify parameters.
+- **Suggested fix:** For servers/watchers use terminal(background=true, notify_on_complete=true); never append '&' or notify to foreground calls.
+- **Evidence:** `default:20260828_132734_85f729e5#1434`, `default:20260830_140032_70edf88c#13074`, `default:20260829_095319_cc8f7496#3860`, `default:20260919_133653_cfea5b#37645`, `jimmy:20261002_082642_504214#23706`, `jimmy:20261002_082642_504214#24680`
+- **Example findings:** Terminal backgrounding and notify parameter misuse; Foreground command with '&' backgrounding rejected; Backgrounding wrappers rejected in foreground terminal calls; Misuse of backgrounding flags and shell background wrappers
+
+### 8. patch old_string / escape drift — 85 occurrences, severity high
+- **Profiles:** default, jimmy, leonard  ·  **Lanes:** default-first-week, default-rest, jimmy-recent, jimmy-w3, jimmy-w4, leonard-rest
+- **Root cause:** The agent calls patch without required args or with stale/whitespace-mismatched old_string, so edits silently fail to apply.
+- **Suggested fix:** Read the file immediately before patching and copy an exact unique existing snippet into old_string.
+- **Evidence:** `default:20260830_100546_480c392f#8180`, `default:20260830_100546_480c392f#10654`, `default:20260829_152634_04e12a4d#5620`, `default:20260909_075338_59a09d17#36333`, `jimmy:20261002_082642_504214#24133`, `jimmy:20261002_082642_504214#24135`
+- **Example findings:** patch tool argument and old_string-match failures; patch refuses to write file failing JSON syntax validation; patch escape-drift on backslash-quote sequences; patch old_string no match / escape drift
+
+### 9. ripgrep / search_files — 71 occurrences, severity medium
+- **Profiles:** default, jimmy, leonard, verimail  ·  **Lanes:** default-rest, jimmy-recent, jimmy-w3, jimmy-w4, jimmy-w5, leonard-rest, leonard-w1
+- **Root cause:** unclear from evidence
+- **Suggested fix:** Validate the search root exists and keep patterns simple before running search_files.
+- **Evidence:** `default:20260909_075338_59a09d17#36322`, `jimmy:20261002_225522_3a575121#25229`, `jimmy:20261004_213907_6161c54d#25757`, `jimmy:20261004_213907_6161c54d#25758`, `jimmy:20261002_082642_504214#24738`, `jimmy:20260913_162527_c83fd6#14268`
+- **Example findings:** search_files ripgrep backend fails; search_files / ripgrep failures and bad paths; Referenced paths do not exist (search_files / read_file); search_files invalid regex rejected by ripgrep
+
+### 10. memory at capacity — 68 occurrences, severity high
+- **Profiles:** default, jimmy, leonard  ·  **Lanes:** default-first-week, default-rest, jimmy-recent, jimmy-w1, jimmy-w2, jimmy-w3, leonard-w1
+- **Root cause:** User memory is at its character limit and the agent submits invalid memory actions (None/view, replace without old_text).
+- **Suggested fix:** Consolidate existing entries with valid add/replace/remove actions before adding new memory.
+- **Evidence:** `default:20260831_154908_9c27060c#22341`, `default:20260829_135124_84d145aa#5008`, `default:20260828_215950_6f0dd002#3185`, `default:20260919_150025_acc966#37911`, `jimmy:20261002_082642_504214#24727`, `jimmy:20261002_082642_504214#24729`
+- **Example findings:** memory tool action errors and size-limit overruns; Memory store at capacity blocks new entries; Memory store at capacity on batch writes; Memory tool edits fail validation
+
+### 11. skill description budget — 61 occurrences, severity medium
+- **Profiles:** default, jimmy, leonard  ·  **Lanes:** default-first-week, jimmy-recent, jimmy-w1, jimmy-w3, jimmy-w4, leonard-rest, leonard-w1
+- **Root cause:** The agent submits malformed skill_manage operations and references skill names that don't exist in the profile.
+- **Suggested fix:** Validate the operations schema (name/action) and keep descriptions within budget; list skills before referencing them.
+- **Evidence:** `default:20260901_111119_3fb7ce3f#25178`, `default:20260901_210256_6c1c52da#30612`, `default:20260829_152634_04e12a4d#5559`, `jimmy:20261002_082642_504214#24211`, `jimmy:20261004_175703_fcae4d19#25665`, `jimmy:20260903_082924_ee9d9f9b#582`
+- **Example findings:** Skill tooling errors (skill_manage ops and missing skills); skill_manage rejects oversized skill descriptions; New skill descriptions exceed system-prompt budget; skill_manage description exceeds budget
+
+### 12. approval / consent block — 51 occurrences, severity medium
+- **Profiles:** default, jimmy, leonard  ·  **Lanes:** default-first-week, jimmy-recent, jimmy-w4, jimmy-w5, leonard-w1
+- **Root cause:** The agent keeps attempting to read .env/credential stores and to hand-edit Hermes config, all of which are blocked by design.
+- **Suggested fix:** Use provider tools for credentials and `hermes config`/hermes CLI instead of reading secret files or editing config directly.
+- **Evidence:** `default:20260831_154908_9c27060c#22127`, `default:20260828_165853_0ff9f889#2225`, `default:20260829_135124_84d145aa#4288`, `jimmy:20261003_161554_b72b50c7#25376`, `jimmy:cron_9fb3bd266e71_20261004_080024#25486`, `jimmy:cron_9fb3bd266e71_20261002_132706#24418`
+- **Example findings:** Blocked reads/writes of secrets and Hermes config; Cron jobs blocked or misconfigured; read_file blocked for repeating an identical call; read_file blocked from Hermes credential store
+
+### 13. user friction (corrections) — 32 occurrences, severity high
+- **Profiles:** default, jimmy, leonard  ·  **Lanes:** default-first-week, jimmy-w4, jimmy-w5, leonard-rest
+- **Root cause:** The agent kept re-engaging/returning to the Thornhill project after the user repeatedly said to drop it, forcing ~20 identical corrections.
+- **Suggested fix:** Treat 'disregard X' as a persistent instruction: stop surfacing X in status, plans, or actions for the session.
+- **Evidence:** `default:20260901_210256_6c1c52da#25862`, `default:20260901_210256_6c1c52da#26149`, `default:20260901_210256_6c1c52da#27075`, `default:20260830_100546_480c392f#10281`, `default:20260830_100546_480c392f#10548`, `default:20260830_100546_480c392f#11253`
+- **Example findings:** Friction: repeated "Disregard Thornhill for now" corrections; Friction: repeated "fix all" corrections; Friction: wrong scope/directory for audits; User had to instruct 'fix all' after unresolved failures
+
+### 14. tool_call batching / bridge misuse — 27 occurrences, severity high
+- **Profiles:** jimmy, leonard  ·  **Lanes:** jimmy-recent, jimmy-w2, jimmy-w3, leonard-rest, leonard-w1
+- **Root cause:** Multiple or mixed local tool calls were submitted in a single tool_call batch.
+- **Suggested fix:** Send one local tool entry per tool_call and separate local from non-local calls.
+- **Evidence:** `jimmy:20261002_082642_504214#24650`, `jimmy:20260907_095044_75fc0e#6873`, `jimmy:20260907_102215_9626de50#7144`, `jimmy:20260907_210950_e5d3c500#8193`, `jimmy:20260909_091452_22e743#9314`, `jimmy:20260915_075048_45a487#15081`
+- **Example findings:** tool_call batch rule violated for local tools; tool_call argument / JSON validation errors; tool_call deferred-invocation schema errors; tool_call bridge rejects mixed/multi-local batches
+
+### 15. skill_manage malformed / skill not found — 27 occurrences, severity medium
+- **Profiles:** jimmy  ·  **Lanes:** jimmy-w1, jimmy-w2, jimmy-w3, jimmy-w4, jimmy-w5
+- **Root cause:** Agent references skill names and linked files that no longer exist.
+- **Suggested fix:** List available skills / linked files before calling skill_view with an unverified name.
+- **Evidence:** `jimmy:20260903_082924_ee9d9f9b#559`, `jimmy:20260903_082924_ee9d9f9b#698`, `jimmy:20260905_120132_7fcffe#4860`, `jimmy:20260905_120132_7fcffe#4864`, `jimmy:20260905_120132_7fcffe#4923`, `jimmy:20260907_213044_a4748a#8098`
+- **Example findings:** Stale skill and skill-file references; patch old_string mismatch aborts edits; skill_view targets skills/files that do not exist; skill_manage malformed frontmatter
+
+## Provenance
+- Miner: `C:/Users/fight/AppData/Local/HermesHost/diagnostics/problem_miner.py` (deterministic, no LLM)
+- Lanes: default-2026-08-28, default-2026-09-04, default-2026-09-18, default-2026-09-25, jimmy-2026-08-28, jimmy-2026-09-04, jimmy-2026-09-11, jimmy-2026-09-18, jimmy-2026-09-25, jimmy-2026-10-02, leonard-2026-09-11, leonard-2026-09-18, leonard-2026-09-25, leonard-2026-10-02, verimail-2026-09-18, verimail-2026-09-25
+- Phase-B cursors (epoch, per profile): `{"default": 1790980961.1927402, "jimmy": 1791265223.8813179, "leonard": 1791265215.5371597, "verimail": 1791049305.041406}`