vault-sync: 2026-09-13 12:07 (jimmy)

2026-09-13 12:07:23 -07:00
parent e918f23707
commit aa52eecb5c
50 changed files with 4101 additions and 103 deletions
@@ -1,8 +1,8 @@
 # Athena Oracle — Status

-**Updated:** 2026-08-31  
-**Repo:** `~/Projects/athena-oracle/` (cloned from `Tony_tech/athena-oracle`)  
-**DB:** `~/Projects/athena-oracle/oracle.db`
+**Updated:** 2026-09-05  
+**Repo:** `~/athena-oracle-new/` (cloned from `Tony_tech/athena-oracle`)  
+**DB:** `~/athena-oracle-new/oracle.db`

 ## What it is

@@ -24,17 +24,18 @@ oracle/variants/ → Render config (default, research, devops, brief)
 |--------|--------|-------|
 | GitHub | ✅ Token-auth (5k req/hr) | 20 entries fetched, scored |
 | arXiv | ✅ Working | 20 entries fetched, scored |
-| Reddit | ⏸ 429 rate-limited | JSON blocked, RSS fallback also 429 from this IP |
+| Reddit | ✅ Working (RSS) | Subreddits: HuggingFace, llamacpp, artificial, DeepLearning. Rate-limit-aware (waits ~60s between subs) |
 | HackerNews | ✅ Working (via HN API) | 19 entries fetched, scored |
 | HuggingFace | ✅ Working | 20 entries fetched, scored |
 | RSS | ✅ Working | feedparser installed, 14 entries fetched |

 ## Current State

- **93 entries** in `oracle.db` (20 GitHub + 20 arXiv + 19 HN + 20 HF + 14 RSS)
- 82 scored via `attach_scoring()`
- **Verdicts:** 4 PUBLISH, 14 WATCH, 42 ARCHIVE, 33 DROP
- **Buckets:** 44 Uncategorized, 20 Research, 18 Infrastructure, 4 Shipping, 2 Culture, 2 Model Release, 3 Problem Solved
+- **144 entries** in `oracle.db`
+- 5 variants rendered: default, brief, devops, research, ai-news-daily
+- **Site deployed:** `https://preprod2.afterthedemo.com/` + `/ai-news-daily/index.html` + `/brief/` + `/devops/` + `/research/`
+- Deploy mechanism: pre-render locally → commit site/ → create Gitea release → webhook fires → listener syncs to VPS webroot
+- Build command set to `true` (no-op) since files are pre-rendered

 ## Done

@@ -44,6 +45,9 @@ oracle/variants/ → Render config (default, research, devops, brief)
 - `python -m oracle ingest --limit 20` — full pipeline working
 - Cron job `athena-ingest` (daily 24h) → ingests + scores + writes digest to vault
 - Vault project files created: `status.md`, `decisions.md`, `digest-template.md`
+- **2026-09-02:** Deployed to preprod2 — 5 variants live with fresh stories through 2026-09-02
+- **2026-09-02:** Fixed `cli.py` `_load_env` to tolerate missing `dotenv` module on VPS
+- **2026-09-05:** Reddit adapter working — AI subs (HuggingFace, llamacpp, artificial, DeepLearning), rate-limit-aware RSS. Two daily cron jobs (6am/6pm). Pushed `main` → live on preprod2. Workflow saved to `08_workflows/ai-news-daily-deploy.md`

 ## Not done / next

@@ -51,15 +55,17 @@ oracle/variants/ → Render config (default, research, devops, brief)
 - [ ] Fix Reddit RSS (429 from this IP — may need proxy)
 - [x] Cron job for daily ingestion
 - [ ] Wire digests into daily notes automatically
- [x] Test render (variants → static site) — 4 variants + AI News Daily built
+- [x] Test render (variants → static site) — 5 variants + AI News Daily built
 - [ ] Surface top entries to daily notes
+- [ ] Set up oracle pipeline on VPS (needs SSH access — currently blocked)

-## Deployment blocker (2026-08-31)
+## Deployment (2026-09-02)

- **Rendered fully locally** (99 entries, 31 summarized): 4 HTML variants in `_preview/{default,brief,devops,research}/` + `site/ai-news-daily/index.html` (12KB, 50 stories).
- **Deploy to `preprod1.afterthedemo.com` blocked:** all remote access is down. VPS SSH local-vps-reference:22 is firewalled (times out), Tailscale 100.64.0.1:22 times out, all users/key/password auth rejected. Gitea (local-vps-reference:80/443) and headscale (:8443) still reachable — VPS is alive, only SSH is blocked.
- **VPS SSH rate-limit:** >3 failed connect attempts within a period trips the firewall and blocks the IP for a while — do NOT loop SSH attempts.
- **Options (need Anthony):** (a) SSH in himself and add `~/.ollama/id_ed25519.pub` or `~/ssh-keys/vps-deploy.pub` to `hermes-leonard` for passwordless deploy; (b) temporarily open port 22 for our IP; (c) deploy via Gitea Pages / webhook-based rebuild nginx side.
+- **Deployed to `https://preprod2.afterthedemo.com/`** ✅
+- 5 variants live: default, brief, devops, research, ai-news-daily
+- Fresh stories through 2026-09-02
+- VPS SSH still blocked; pipeline lives locally for now
+- Oracle needs to be migrated to VPS (can't ingest from local PC without SSH)

 ## Decisions

@@ -67,3 +73,4 @@ oracle/variants/ → Render config (default, research, devops, brief)
 - Pure rule-based — no embeddings, no LLM classification
 - Velocity ranking for GitHub (not raw stars)
 - GitHub unauthenticated rate limit: 60 req/hr (budget calls, 30s timeout per source)
+- **VPS SSH is firewalled:** >3 failed connects blocks IP. Do NOT loop SSH attempts.