3.4 KiB
3.4 KiB
Athena Oracle — Status
Updated: 2026-09-05
Repo: ~/athena-oracle-new/ (cloned from Tony_tech/athena-oracle)
DB: ~/athena-oracle-new/oracle.db
What it is
Multi-source AI research pipeline: ingest → score → bucket → render. Pure rule-based, no LLM required for classification. MVP = pattern-proof, not a polished product.
Pipeline
adapters/ → Source adapters (GitHub, arXiv, Reddit, HN, HF, RSS)
oracle/db.py → SQLite storage + schema migration
oracle/scoring.py → Bucket classifier + scoring engine
oracle/summarize.py → Rule-based summarization
oracle/variants/ → Render config (default, research, devops, brief)
Sources
| Source | Status | Notes |
|---|---|---|
| GitHub | ✅ Token-auth (5k req/hr) | 20 entries fetched, scored |
| arXiv | ✅ Working | 20 entries fetched, scored |
| ✅ Working (RSS) | Subreddits: HuggingFace, llamacpp, artificial, DeepLearning. Rate-limit-aware (waits ~60s between subs) | |
| HackerNews | ✅ Working (via HN API) | 19 entries fetched, scored |
| HuggingFace | ✅ Working | 20 entries fetched, scored |
| RSS | ✅ Working | feedparser installed, 14 entries fetched |
Current State
- 144 entries in
oracle.db - 5 variants rendered: default, brief, devops, research, ai-news-daily
- Site deployed:
https://preprod2.afterthedemo.com/+/ai-news-daily/index.html+/brief/+/devops/+/research/ - Deploy mechanism: pre-render locally → commit site/ → create Gitea release → webhook fires → listener syncs to VPS webroot
- Build command set to
true(no-op) since files are pre-rendered
Done
- Cloned to local PC
- Schema migration + scoring columns applied
- GitHub token wired (
.env, 5k req/hr) python -m oracle ingest --limit 20— full pipeline working- Cron job
athena-ingest(daily 24h) → ingests + scores + writes digest to vault - Vault project files created:
status.md,decisions.md,digest-template.md - 2026-09-02: Deployed to preprod2 — 5 variants live with fresh stories through 2026-09-02
- 2026-09-02: Fixed
cli.py_load_envto tolerate missingdotenvmodule on VPS - 2026-09-05: Reddit adapter working — AI subs (HuggingFace, llamacpp, artificial, DeepLearning), rate-limit-aware RSS. Two daily cron jobs (6am/6pm). Pushed
main→ live on preprod2. Workflow saved to08_workflows/ai-news-daily-deploy.md
Not done / next
- Enable GitHub, arXiv, HF, HN, RSS adapters (tested locally)
- Fix Reddit RSS (429 from this IP — may need proxy)
- Cron job for daily ingestion
- Wire digests into daily notes automatically
- Test render (variants → static site) — 5 variants + AI News Daily built
- Surface top entries to daily notes
- Set up oracle pipeline on VPS (needs SSH access — currently blocked)
Deployment (2026-09-02)
- Deployed to
https://preprod2.afterthedemo.com/✅ - 5 variants live: default, brief, devops, research, ai-news-daily
- Fresh stories through 2026-09-02
- VPS SSH still blocked; pipeline lives locally for now
- Oracle needs to be migrated to VPS (can't ingest from local PC without SSH)
Decisions
- Cap ~5 approved sources (depth over firehose)
- Pure rule-based — no embeddings, no LLM classification
- Velocity ranking for GitHub (not raw stars)
- GitHub unauthenticated rate limit: 60 req/hr (budget calls, 30s timeout per source)
- VPS SSH is firewalled: >3 failed connects blocks IP. Do NOT loop SSH attempts.