# Athena Oracle — Status

**Updated:** 2026-09-05  
**Repo:** `~/athena-oracle-new/` (cloned from `Tony_tech/athena-oracle`)  
**DB:** `~/athena-oracle-new/oracle.db`

## What it is

Multi-source AI research pipeline: ingest → score → bucket → render. Pure rule-based, no LLM required for classification. MVP = pattern-proof, not a polished product.

## Pipeline

```
adapters/     → Source adapters (GitHub, arXiv, Reddit, HN, HF, RSS)
oracle/db.py  → SQLite storage + schema migration
oracle/scoring.py → Bucket classifier + scoring engine
oracle/summarize.py → Rule-based summarization
oracle/variants/ → Render config (default, research, devops, brief)
```

## Sources

| Source | Status | Notes |
|--------|--------|-------|
| GitHub | ✅ Token-auth (5k req/hr) | 20 entries fetched, scored |
| arXiv | ✅ Working | 20 entries fetched, scored |
| Reddit | ✅ Working (RSS) | Subreddits: HuggingFace, llamacpp, artificial, DeepLearning. Rate-limit-aware (waits ~60s between subs) |
| HackerNews | ✅ Working (via HN API) | 19 entries fetched, scored |
| HuggingFace | ✅ Working | 20 entries fetched, scored |
| RSS | ✅ Working | feedparser installed, 14 entries fetched |

## Current State

- **144 entries** in `oracle.db`
- 5 variants rendered: default, brief, devops, research, ai-news-daily
- **Site deployed:** `https://preprod2.afterthedemo.com/` + `/ai-news-daily/index.html` + `/brief/` + `/devops/` + `/research/`
- Deploy mechanism: pre-render locally → commit site/ → create Gitea release → webhook fires → listener syncs to VPS webroot
- Build command set to `true` (no-op) since files are pre-rendered

## Done

- Cloned to local PC
- Schema migration + scoring columns applied
- GitHub token wired (`.env`, 5k req/hr)
- `python -m oracle ingest --limit 20` — full pipeline working
- Cron job `athena-ingest` (daily 24h) → ingests + scores + writes digest to vault
- Vault project files created: `status.md`, `decisions.md`, `digest-template.md`
- **2026-09-02:** Deployed to preprod2 — 5 variants live with fresh stories through 2026-09-02
- **2026-09-02:** Fixed `cli.py` `_load_env` to tolerate missing `dotenv` module on VPS
- **2026-09-05:** Reddit adapter working — AI subs (HuggingFace, llamacpp, artificial, DeepLearning), rate-limit-aware RSS. Two daily cron jobs (6am/6pm). Pushed `main` → live on preprod2. Workflow saved to `08_workflows/ai-news-daily-deploy.md`

## Not done / next

- [x] Enable GitHub, arXiv, HF, HN, RSS adapters (tested locally)
- [ ] Fix Reddit RSS (429 from this IP — may need proxy)
- [x] Cron job for daily ingestion
- [ ] Wire digests into daily notes automatically
- [x] Test render (variants → static site) — 5 variants + AI News Daily built
- [ ] Surface top entries to daily notes
- [ ] Set up oracle pipeline on VPS (needs SSH access — currently blocked)

## Deployment (2026-09-02)

- **Deployed to `https://preprod2.afterthedemo.com/`** ✅
- 5 variants live: default, brief, devops, research, ai-news-daily
- Fresh stories through 2026-09-02
- VPS SSH still blocked; pipeline lives locally for now
- Oracle needs to be migrated to VPS (can't ingest from local PC without SSH)

## Decisions

- Cap ~5 approved sources (depth over firehose)
- Pure rule-based — no embeddings, no LLM classification
- Velocity ranking for GitHub (not raw stars)
- GitHub unauthenticated rate limit: 60 req/hr (budget calls, 30s timeout per source)
- **VPS SSH is firewalled:** >3 failed connects blocks IP. Do NOT loop SSH attempts.