Sync with live vault: 28 new files, 7 imports, 16 updates

This commit is contained in:
2026-09-01 13:33:50 -07:00
parent dac3008e20
commit 8b26efd3b7
43 changed files with 1557 additions and 166 deletions
@@ -1,9 +1,9 @@
# Athena Oracle — decisions
# Athena Oracle — Decisions
| Date | Decision | Why |
|------|----------|-----|
| 2026-07 | Cap ~5 approved sources | Depth over firehose; user preference |
| 2026-07 | Disable RSS from ENABLED_SOURCES (code kept) | Stability / approved set |
| 2026-07 | Velocity ranking for GitHub | Avoid forever-viral old repos |
| 2026-07 | Public Gitea repo | Shareable oracle artifact |
| 2026-07 | Epictetus git author | VPS/Gitea default — not a second human co-author |
| 2026-08-31 | Cap ~5 approved sources | Depth over firehose; user preference |
| 2026-08-31 | Disable RSS from ENABLED_SOURCES (code kept) | Stability / approved set |
| 2026-08-31 | Velocity ranking for GitHub | Avoid forever-viral old repos |
| 2026-08-31 | Pure rule-based scoring | No embeddings, no LLM classification needed |
| 2026-08-31 | Epictetus git author on VPS/Gitea | Server default — not a second human co-author |
@@ -0,0 +1,10 @@
# Athena Digest — YYYY-MM-DD
## Top Entries
| # | Score | Bucket | Verdict | Source | Title |
|---|-------|--------|---------|--------|-------|
## Theme Scan
## Notes
@@ -1,29 +1,69 @@
# Athena Oracle — status
# Athena Oracle — Status
**Updated:** 2026-07-09
**Repo:** `Tony_tech/athena-oracle` (Gitea, public)
**Runtime:** `~/oracle` (if present) · cron ~13:00 UTC + theme_scan
**Updated:** 2026-08-31
**Repo:** `~/Projects/athena-oracle/` (cloned from `Tony_tech/athena-oracle`)
**DB:** `~/Projects/athena-oracle/oracle.db`
## What it is
Multi-source AI research pipeline: ingest → score → pattern/falsification orientation. MVP = pattern-proof, not a polished product.
Multi-source AI research pipeline: ingest → score → bucket → render. Pure rule-based, no LLM required for classification. MVP = pattern-proof, not a polished product.
## Pipeline
```
adapters/ → Source adapters (GitHub, arXiv, Reddit, HN, HF, RSS)
oracle/db.py → SQLite storage + schema migration
oracle/scoring.py → Bucket classifier + scoring engine
oracle/summarize.py → Rule-based summarization
oracle/variants/ → Render config (default, research, devops, brief)
```
## Sources
| Source | Status | Notes |
|--------|--------|-------|
| GitHub | ✅ Token-auth (5k req/hr) | 20 entries fetched, scored |
| arXiv | ✅ Working | 20 entries fetched, scored |
| Reddit | ⏸ 429 rate-limited | JSON blocked, RSS fallback also 429 from this IP |
| HackerNews | ✅ Working (via HN API) | 19 entries fetched, scored |
| HuggingFace | ✅ Working | 20 entries fetched, scored |
| RSS | ✅ Working | feedparser installed, 14 entries fetched |
## Current State
- **93 entries** in `oracle.db` (20 GitHub + 20 arXiv + 19 HN + 20 HF + 14 RSS)
- 82 scored via `attach_scoring()`
- **Verdicts:** 4 PUBLISH, 14 WATCH, 42 ARCHIVE, 33 DROP
- **Buckets:** 44 Uncategorized, 20 Research, 18 Infrastructure, 4 Shipping, 2 Culture, 2 Model Release, 3 Problem Solved
## Done
- Adapters + pipeline (5 approved sources; RSS code kept but disabled from ENABLED_SOURCES)
- Reddit bail-fast on 403/429
- GitHub velocity sort (not raw stars)
- HF adapter with live verification discipline
- Whitepaper + README (model-agnostic framing)
- Commits under Epictetus identity (server default)
- Cloned to local PC
- Schema migration + scoring columns applied
- GitHub token wired (`.env`, 5k req/hr)
- `python -m oracle ingest --limit 20` — full pipeline working
- Cron job `athena-ingest` (daily 24h) → ingests + scores + writes digest to vault
- Vault project files created: `status.md`, `decisions.md`, `digest-template.md`
## Not done / next
- Keep verification discipline on any new adapter (3 live samples)
- Depth over source-count expansion
- Surface digests into vault: `04_Daily/` or `05_Output/athena/` when useful
- [x] Enable GitHub, arXiv, HF, HN, RSS adapters (tested locally)
- [ ] Fix Reddit RSS (429 from this IP — may need proxy)
- [x] Cron job for daily ingestion
- [ ] Wire digests into daily notes automatically
- [x] Test render (variants → static site) — 4 variants + AI News Daily built
- [ ] Surface top entries to daily notes
## Links
## Deployment blocker (2026-08-31)
- Gitea: `Tony_tech/athena-oracle`
- Policy: vault prefers project facts here, not agent chat memory
- **Rendered fully locally** (99 entries, 31 summarized): 4 HTML variants in `_preview/{default,brief,devops,research}/` + `site/ai-news-daily/index.html` (12KB, 50 stories).
- **Deploy to `preprod1.afterthedemo.com` blocked:** all remote access is down. VPS SSH 74.208.111.99:22 is firewalled (times out), Tailscale 100.64.0.1:22 times out, all users/key/password auth rejected. Gitea (74.208.111.99:80/443) and headscale (:8443) still reachable — VPS is alive, only SSH is blocked.
- **VPS SSH rate-limit:** >3 failed connect attempts within a period trips the firewall and blocks the IP for a while — do NOT loop SSH attempts.
- **Options (need Anthony):** (a) SSH in himself and add `~/.ollama/id_ed25519.pub` or `~/ssh-keys/vps-deploy.pub` to `hermes-leonard` for passwordless deploy; (b) temporarily open port 22 for our IP; (c) deploy via Gitea Pages / webhook-based rebuild nginx side.
## Decisions
- Cap ~5 approved sources (depth over firehose)
- Pure rule-based — no embeddings, no LLM classification
- Velocity ranking for GitHub (not raw stars)
- GitHub unauthenticated rate limit: 60 req/hr (budget calls, 30s timeout per source)