18 KiB
18 KiB
title, tags, scope, generated, source
| title | tags | scope | generated | source | ||||
|---|---|---|---|---|---|---|---|---|
| Agent Operations — Problems Registry |
|
shared | 2026-10-06 | HermesHost/diagnostics/backfill/all-v1/registry.md |
Cross-profile (default, jimmy, leonard, verimail). Baseline backfill, day one → 2026-10-06. Nightly deltas append to problems-log. Per-agent detail: 02_agents/leonard/failure-ledger.
Agent Operations — Problems Registry (backfill, since day one)
Generated 2026-10-06T05:51:36+00:00 · deterministic miner
problem_miner.py+ 10-agent swarm · evidence-cited. Window: 2026-08-28 → 2026-10-06 (all 4 profiles: default, jimmy, leonard, verimail). Sources: 3444 problem events → 192 clustered findings → 37 themes. Occurrence-weighted total: 2583.
Ranked themes
| # | Theme | Occurrences | Findings | Severity | Profiles |
|---|---|---|---|---|---|
| 1 | timeouts | 715 | 35 | high | default, jimmy, leonard, verimail |
| 2 | generic exit codes | 444 | 8 | medium | default, jimmy, leonard |
| 3 | path / file not found | 205 | 13 | high | default, jimmy, leonard, verimail |
| 4 | python runtime tracebacks | 187 | 7 | high | default, jimmy, leonard |
| 5 | config key churn / bad subcommands | 141 | 4 | medium | default, jimmy |
| 6 | git remote / auth | 105 | 5 | high | default, jimmy, leonard |
| 7 | terminal background/notify misuse | 105 | 7 | medium | default, jimmy, leonard |
| 8 | patch old_string / escape drift | 85 | 6 | high | default, jimmy, leonard |
| 9 | ripgrep / search_files | 71 | 11 | medium | default, jimmy, leonard, verimail |
| 10 | memory at capacity | 68 | 7 | high | default, jimmy, leonard |
| 11 | skill description budget | 61 | 7 | medium | default, jimmy, leonard |
| 12 | approval / consent block | 51 | 10 | medium | default, jimmy, leonard |
| 13 | user friction (corrections) | 32 | 7 | high | default, jimmy, leonard |
| 14 | tool_call batching / bridge misuse | 27 | 6 | high | jimmy, leonard |
| 15 | skill_manage malformed / skill not found | 27 | 6 | medium | jimmy |
| 16 | command not found | 26 | 6 | medium | default, jimmy, leonard |
| 17 | tailnet / SSH / VPS | 20 | 3 | high | default, jimmy, leonard |
| 18 | uv trampoline | 20 | 1 | high | default |
| 19 | PowerShell/cmd syntax in bash | 18 | 2 | medium | jimmy |
| 20 | cron jobs / reminders | 17 | 2 | high | default, leonard |
| 21 | missing python module | 15 | 3 | medium | jimmy |
| 22 | local model load/serve | 14 | 4 | high | jimmy, leonard |
| 23 | Hermes config write refused | 14 | 3 | medium | jimmy |
| 24 | browser_exec / CDP hangs | 13 | 2 | medium | jimmy, leonard |
| 25 | detector false positives | 12 | 1 | low | default |
| 26 | memory tool misuse | 12 | 2 | medium | jimmy |
| 27 | model/output identity errors | 10 | 5 | high | jimmy |
| 28 | process_manage | 10 | 2 | medium | jimmy |
| 29 | Telegram gateway down | 10 | 4 | high | jimmy, leonard |
| 30 | memory_search zg binary missing | 10 | 1 | high | jimmy |
| 31 | unwanted voice / TTS | 9 | 2 | medium | jimmy, leonard |
| 32 | shell quoting / eval errors | 7 | 3 | medium | default, jimmy, leonard |
| 33 | Docker | 6 | 2 | medium | jimmy, leonard |
| 34 | vision_analyze | 6 | 2 | medium | jimmy, leonard |
| 35 | write_file overwrite guard | 4 | 1 | high | jimmy |
| 36 | secret/credential read refused | 4 | 1 | high | jimmy |
| 37 | other | 2 | 1 | medium | leonard |
Detail (top 15)
1. timeouts — 715 occurrences, severity high
- Profiles: default, jimmy, leonard, verimail · Lanes: default-first-week, default-rest, jimmy-recent, jimmy-w1, jimmy-w2, jimmy-w3, jimmy-w4, jimmy-w5, leonard-rest, leonard-w1
- Root cause: Commands routinely exceed default timeouts and the agent neither raises timeout= nor backgrounds long jobs, so downloads, model startups and pings die mid-run.
- Suggested fix: Default long commands to background=true with notify_on_complete=true and set an explicit timeout= where a foreground wait is required.
- Evidence:
default:20260829_075244_4ffe68a7#3428,default:20260828_144747_49a94d46#1621,default:20260830_140032_70edf88c#21543,default:20260901_210256_6c1c52da#26838,default:20260901_210256_6c1c52da#26361,default:20260830_140032_70edf88c#19000 - Example findings: Tool command timeouts (foreground terminal + execute_code kernel); SSH access to VPS / tailnet hosts failing; BLOCKED: approval/consent timeouts on gated commands; Safety-approval gate blocks dangerous commands in unattended single-query mode
2. generic exit codes — 444 occurrences, severity medium
- Profiles: default, jimmy, leonard · Lanes: default-first-week, jimmy-w1, jimmy-w2, jimmy-w3, jimmy-w4, jimmy-w5, leonard-rest, leonard-w1
- Root cause: unclear from evidence
- Suggested fix: Capture and log stderr alongside the exit code for diagnosability.
- Evidence:
default:20260828_144747_49a94d46#1619,default:20260828_201637_807fd2ff#2548,default:20260828_201637_807fd2ff#2643,jimmy:20260903_131512_23f3ecc7#983,jimmy:20260903_131512_23f3ecc7#1256,jimmy:20260903_072353_f46f323c#383 - Example findings: Miscellaneous command failures (generic non-zero exit codes); Miscellaneous command failures (bare exit codes); Miscellaneous command failures (bare non-zero exit codes); Miscellaneous command failures (bare exit codes)
3. path / file not found — 205 occurrences, severity high
- Profiles: default, jimmy, leonard, verimail · Lanes: default-first-week, default-rest, jimmy-recent, jimmy-w1, jimmy-w2, jimmy-w3, jimmy-w5, leonard-rest, leonard-w1
- Root cause: The agent repeatedly issues MSYS/Linux-style or otherwise wrong paths on Windows (and wrong working directories), so file and cd operations fail.
- Suggested fix: Resolve the real Windows path first (forward-slash native form) and confirm existence before reading/cd; prefer search_files to locate.
- Evidence:
default:20260828_165853_0ff9f889#2009,default:20260901_210256_6c1c52da#26668,default:20260830_140032_70edf88c#15170,default:20260918_124517_372cda#36420,default:20260918_124517_372cda#36529,default:20260919_133653_cfea5b#37337 - Example findings: File/path not found on Windows (path translation failures); Referenced files, scripts, and paths do not exist; Generic command failures (bare exit_code=N); read_file 'File not found' on guessed paths
4. python runtime tracebacks — 187 occurrences, severity high
- Profiles: default, jimmy, leonard · Lanes: default-first-week, default-rest, jimmy-w1, jimmy-w2, leonard-rest
- Root cause: The agent writes Python (in execute_code and inline python) that throws syntax/name/shape errors, repeatedly burning turns on self-inflicted exceptions.
- Suggested fix: Run smaller snippets, print intermediate values, and read the traceback before re-issuing; validate generated code before long batches.
- Evidence:
default:20260830_100546_480c392f#9553,default:20260830_100546_480c392f#9762,default:20260830_100546_480c392f#10158,default:20260901_210256_6c1c52da#31880,default:20260901_210256_6c1c52da#31885,default:20260830_140032_70edf88c#15839 - Example findings: Agent-generated Python raises tracebacks in execute_code / terminal; Script data/schema errors (sqlite & JSON shape); IMAP fetches fail with traceback; execute_code cell raises runtime traceback
5. config key churn / bad subcommands — 141 occurrences, severity medium
- Profiles: default, jimmy · Lanes: default-first-week, jimmy-recent, jimmy-w2
- Root cause: The agent runs POSIX tools (python3, dig, sshpass, expect) absent from the Windows bash, and emits cmd.exe/PowerShell syntax (taskkill, Restart-Service, quotes) that bash misparses.
- Suggested fix: Probe tool availability first (which/command -v) and pick Windows-native equivalents or full exe paths; avoid cmd/PowerShell-only syntax in bash.
- Evidence:
default:20260901_210256_6c1c52da#27257,default:20260901_210256_6c1c52da#26102,default:20260830_140032_70edf88c#16099,default:20260829_135124_84d145aa#4310,default:20260831_154908_9c27060c#22115,default:20260830_140032_70edf88c#16391 - Example findings: Windows shell environment mismatch and missing CLI tools; Hermes CLI subcommand/flag misuse; agent-reach CLI given an invalid subcommand; Provider/model config churn and unsupported config keys
6. git remote / auth — 105 occurrences, severity high
- Profiles: default, jimmy, leonard · Lanes: default-first-week, jimmy-w1, jimmy-w3, jimmy-w5, leonard-w1
- Root cause: Git remotes are misconfigured (bad Gitea hostname, missing/expired HTTPS credentials, unsupported ssl-no-revoke flag) and pushes race with remote updates.
- Suggested fix: Standardize the Gitea remote URL and token, drop unsupported flags, and pull/rebase before pushing.
- Evidence:
default:20260901_210256_6c1c52da#26833,default:20260901_210256_6c1c52da#26844,default:20260901_210256_6c1c52da#33282,jimmy:20260903_072353_f46f323c#422,jimmy:20260903_072353_f46f323c#430,jimmy:20260902_110459_eb6003#1034 - Example findings: Git remote auth / push failures; PowerShell/cmd syntax executed in a bash shell; Python module/import path failures; Command not found (gh, mcporter, getent)
7. terminal background/notify misuse — 105 occurrences, severity medium
- Profiles: default, jimmy, leonard · Lanes: default-first-week, default-rest, jimmy-recent, jimmy-w2, jimmy-w4, leonard-rest, leonard-w1
- Root cause: The agent shells out with '&' or passes notify to foreground terminal calls instead of using the tool's background/notify parameters.
- Suggested fix: For servers/watchers use terminal(background=true, notify_on_complete=true); never append '&' or notify to foreground calls.
- Evidence:
default:20260828_132734_85f729e5#1434,default:20260830_140032_70edf88c#13074,default:20260829_095319_cc8f7496#3860,default:20260919_133653_cfea5b#37645,jimmy:20261002_082642_504214#23706,jimmy:20261002_082642_504214#24680 - Example findings: Terminal backgrounding and notify parameter misuse; Foreground command with '&' backgrounding rejected; Backgrounding wrappers rejected in foreground terminal calls; Misuse of backgrounding flags and shell background wrappers
8. patch old_string / escape drift — 85 occurrences, severity high
- Profiles: default, jimmy, leonard · Lanes: default-first-week, default-rest, jimmy-recent, jimmy-w3, jimmy-w4, leonard-rest
- Root cause: The agent calls patch without required args or with stale/whitespace-mismatched old_string, so edits silently fail to apply.
- Suggested fix: Read the file immediately before patching and copy an exact unique existing snippet into old_string.
- Evidence:
default:20260830_100546_480c392f#8180,default:20260830_100546_480c392f#10654,default:20260829_152634_04e12a4d#5620,default:20260909_075338_59a09d17#36333,jimmy:20261002_082642_504214#24133,jimmy:20261002_082642_504214#24135 - Example findings: patch tool argument and old_string-match failures; patch refuses to write file failing JSON syntax validation; patch escape-drift on backslash-quote sequences; patch old_string no match / escape drift
9. ripgrep / search_files — 71 occurrences, severity medium
- Profiles: default, jimmy, leonard, verimail · Lanes: default-rest, jimmy-recent, jimmy-w3, jimmy-w4, jimmy-w5, leonard-rest, leonard-w1
- Root cause: unclear from evidence
- Suggested fix: Validate the search root exists and keep patterns simple before running search_files.
- Evidence:
default:20260909_075338_59a09d17#36322,jimmy:20261002_225522_3a575121#25229,jimmy:20261004_213907_6161c54d#25757,jimmy:20261004_213907_6161c54d#25758,jimmy:20261002_082642_504214#24738,jimmy:20260913_162527_c83fd6#14268 - Example findings: search_files ripgrep backend fails; search_files / ripgrep failures and bad paths; Referenced paths do not exist (search_files / read_file); search_files invalid regex rejected by ripgrep
10. memory at capacity — 68 occurrences, severity high
- Profiles: default, jimmy, leonard · Lanes: default-first-week, default-rest, jimmy-recent, jimmy-w1, jimmy-w2, jimmy-w3, leonard-w1
- Root cause: User memory is at its character limit and the agent submits invalid memory actions (None/view, replace without old_text).
- Suggested fix: Consolidate existing entries with valid add/replace/remove actions before adding new memory.
- Evidence:
default:20260831_154908_9c27060c#22341,default:20260829_135124_84d145aa#5008,default:20260828_215950_6f0dd002#3185,default:20260919_150025_acc966#37911,jimmy:20261002_082642_504214#24727,jimmy:20261002_082642_504214#24729 - Example findings: memory tool action errors and size-limit overruns; Memory store at capacity blocks new entries; Memory store at capacity on batch writes; Memory tool edits fail validation
11. skill description budget — 61 occurrences, severity medium
- Profiles: default, jimmy, leonard · Lanes: default-first-week, jimmy-recent, jimmy-w1, jimmy-w3, jimmy-w4, leonard-rest, leonard-w1
- Root cause: The agent submits malformed skill_manage operations and references skill names that don't exist in the profile.
- Suggested fix: Validate the operations schema (name/action) and keep descriptions within budget; list skills before referencing them.
- Evidence:
default:20260901_111119_3fb7ce3f#25178,default:20260901_210256_6c1c52da#30612,default:20260829_152634_04e12a4d#5559,jimmy:20261002_082642_504214#24211,jimmy:20261004_175703_fcae4d19#25665,jimmy:20260903_082924_ee9d9f9b#582 - Example findings: Skill tooling errors (skill_manage ops and missing skills); skill_manage rejects oversized skill descriptions; New skill descriptions exceed system-prompt budget; skill_manage description exceeds budget
12. approval / consent block — 51 occurrences, severity medium
- Profiles: default, jimmy, leonard · Lanes: default-first-week, jimmy-recent, jimmy-w4, jimmy-w5, leonard-w1
- Root cause: The agent keeps attempting to read .env/credential stores and to hand-edit Hermes config, all of which are blocked by design.
- Suggested fix: Use provider tools for credentials and
hermes config/hermes CLI instead of reading secret files or editing config directly. - Evidence:
default:20260831_154908_9c27060c#22127,default:20260828_165853_0ff9f889#2225,default:20260829_135124_84d145aa#4288,jimmy:20261003_161554_b72b50c7#25376,jimmy:cron_9fb3bd266e71_20261004_080024#25486,jimmy:cron_9fb3bd266e71_20261002_132706#24418 - Example findings: Blocked reads/writes of secrets and Hermes config; Cron jobs blocked or misconfigured; read_file blocked for repeating an identical call; read_file blocked from Hermes credential store
13. user friction (corrections) — 32 occurrences, severity high
- Profiles: default, jimmy, leonard · Lanes: default-first-week, jimmy-w4, jimmy-w5, leonard-rest
- Root cause: The agent kept re-engaging/returning to the Thornhill project after the user repeatedly said to drop it, forcing ~20 identical corrections.
- Suggested fix: Treat 'disregard X' as a persistent instruction: stop surfacing X in status, plans, or actions for the session.
- Evidence:
default:20260901_210256_6c1c52da#25862,default:20260901_210256_6c1c52da#26149,default:20260901_210256_6c1c52da#27075,default:20260830_100546_480c392f#10281,default:20260830_100546_480c392f#10548,default:20260830_100546_480c392f#11253 - Example findings: Friction: repeated "Disregard Thornhill for now" corrections; Friction: repeated "fix all" corrections; Friction: wrong scope/directory for audits; User had to instruct 'fix all' after unresolved failures
14. tool_call batching / bridge misuse — 27 occurrences, severity high
- Profiles: jimmy, leonard · Lanes: jimmy-recent, jimmy-w2, jimmy-w3, leonard-rest, leonard-w1
- Root cause: Multiple or mixed local tool calls were submitted in a single tool_call batch.
- Suggested fix: Send one local tool entry per tool_call and separate local from non-local calls.
- Evidence:
jimmy:20261002_082642_504214#24650,jimmy:20260907_095044_75fc0e#6873,jimmy:20260907_102215_9626de50#7144,jimmy:20260907_210950_e5d3c500#8193,jimmy:20260909_091452_22e743#9314,jimmy:20260915_075048_45a487#15081 - Example findings: tool_call batch rule violated for local tools; tool_call argument / JSON validation errors; tool_call deferred-invocation schema errors; tool_call bridge rejects mixed/multi-local batches
15. skill_manage malformed / skill not found — 27 occurrences, severity medium
- Profiles: jimmy · Lanes: jimmy-w1, jimmy-w2, jimmy-w3, jimmy-w4, jimmy-w5
- Root cause: Agent references skill names and linked files that no longer exist.
- Suggested fix: List available skills / linked files before calling skill_view with an unverified name.
- Evidence:
jimmy:20260903_082924_ee9d9f9b#559,jimmy:20260903_082924_ee9d9f9b#698,jimmy:20260905_120132_7fcffe#4860,jimmy:20260905_120132_7fcffe#4864,jimmy:20260905_120132_7fcffe#4923,jimmy:20260907_213044_a4748a#8098 - Example findings: Stale skill and skill-file references; patch old_string mismatch aborts edits; skill_view targets skills/files that do not exist; skill_manage malformed frontmatter
Provenance
- Miner:
C:/Users/fight/AppData/Local/HermesHost/diagnostics/problem_miner.py(deterministic, no LLM) - Lanes: default-2026-08-28, default-2026-09-04, default-2026-09-18, default-2026-09-25, jimmy-2026-08-28, jimmy-2026-09-04, jimmy-2026-09-11, jimmy-2026-09-18, jimmy-2026-09-25, jimmy-2026-10-02, leonard-2026-09-11, leonard-2026-09-18, leonard-2026-09-25, leonard-2026-10-02, verimail-2026-09-18, verimail-2026-09-25
- Phase-B cursors (epoch, per profile):
{"default": 1790980961.1927402, "jimmy": 1791265223.8813179, "leonard": 1791265215.5371597, "verimail": 1791049305.041406}