Commit Graph

8 Commits

Author SHA1 Message Date
grokbot_ty 302d69463b docs(test-spec): encode evidence-class and fail-closed gate process locks
Gate B reports treated synthetic TV passes as if they satisfied product-state
exit. Soft result words like "not run" also blurred fail-closed reporting.

Encode the seven evidence and process locks in docs/TEST-SPEC.md as closed
vocab tables, required columns, Gate B exit checklist, Build brief refusal
fields, and SoT mutation permit-before-write. Add Evidence class to every
case table. Reclassify gate-b RESULTS so TV-3/6/7/10 vitest passes stay
proxy-synthetic, Gate exit product-state rows are blocked, and "not run"
becomes blocked. Gate B remains not green.
2026-09-07 17:58:27 +00:00
grokbot_ty f02b53dfa2 docs(TEST-SPEC): add Fundamentals cross-cutting bar (FUND-1 through FUND-25) 2026-09-07 05:04:46 +00:00
grokbot_ty 44c40feec5 docs(TEST-SPEC): add Gitea-only issue reporting rule to Results section
Gitea issues are the only mechanism for reporting issues found during a test
pass. Chat, Slack, and PR comments are not the bug log. On fail, open or
update a Gitea issue with case id and evidence pointer; the report table
blocker column links that issue. Do not invent issues that lack runner
evidence.
2026-09-07 04:42:45 +00:00
grokbot_ty 7cb1a8e81c docs: add Results recording & report-out section to TEST-SPEC 2026-09-07 04:41:36 +00:00
grokbot_ty 8453c15c28 Fix TEST-SPEC exit evidence: restore Ty as gate/phase owner where IMPL-PLAN mandates it
- Gate B: Ty confirms TV-3/6/7/10 on real fixtures; unit/API automated
- Gate C: Ty opens SLAB-UAT-* draft in real store admin; mocked-store not exit
- Phase 3: Ty publishes test slab as Woo draft SLAB-UAT-*; automation UI cases
- Phase 5: Ty judgment on species acceptance; automation Call 1/2 cases
- Phase 6: deployment smoke automated; Ty walks UAT-PRACTICE.md for UAT signoff
- Rename 'Cadence summary' to 'When tests are written'
- Phase 1 remainder: agent automation drives calibrated → ready (keep, per #20)
2026-09-07 04:20:50 +00:00
grokbot_ty e287f5c1c3 Rewrite TEST-SPEC: satisfy issue #20
- Add Section 1: case ID naming convention (all prefixes and abbreviations defined)
- Add Section 2: how cases are executed (paths, tools, staging for unit/contract/integration/E2E/ops)
- Restructured every case table to three columns: what must happen, where the rule lives, how verified
- Replaced cadence column with when-written in pyramid overview; cadence summary preserved
- Fixed all exit-evidence lines: agent-written test automation replaces Ty-driven curl
- Expanded all acronyms on first use; no magic acronyms in case descriptions
- Removed Ty-driven manual testing; automation is the verification path
2026-09-07 04:17:14 +00:00
grokbot_ty aa43fa7628 docs: fix TEST-SPEC completeness and alignment gaps
Fixes:
- GC-2 SoT: add CONTENT-WOO §2.5 (duplicate SKU lookup lives there, not OPENAPI)
- GC-5: add http:// WOO_BASE_URL startup rejection case (AGENTS §4 + DEPLOYMENT §3)
- UIE-3 SoT: add UX §Publish for exact duplicate-SKU wording
- UIE-8: add brand voice/GEO to Settings UI expected behavior (IMPL-PLAN Phase 3)
- W-5: add failed publish → retained photos → retry → success path
- API-9: add DELETE /slabs/{id} contract case (OPENAPI §slabs DELETE)
- API-10: add test-woo fails-closed case (OPENAPI §settings test-woo)
- TAX-3: add client re-pull on anchor advance (ARCHITECTURE §7)
- INS-3: fix to reference request_payload/response_payload instead of non-existent columns
- Cross-reference table: update ranges for new cases, split INS row
2026-09-07 03:04:51 +00:00
grokbot_ty 72d1cfa920 docs: add TEST-SPEC engineer bar (pyramid through PROD) 2026-09-07 02:36:31 +00:00