Files
personal-agent-os/memory-systems/agent-os/04_projects/athena-oracle/status.md
T
2026-09-13 12:07:23 -07:00

3.4 KiB

Athena Oracle — Status

Updated: 2026-09-05
Repo: ~/athena-oracle-new/ (cloned from Tony_tech/athena-oracle)
DB: ~/athena-oracle-new/oracle.db

What it is

Multi-source AI research pipeline: ingest → score → bucket → render. Pure rule-based, no LLM required for classification. MVP = pattern-proof, not a polished product.

Pipeline

adapters/     → Source adapters (GitHub, arXiv, Reddit, HN, HF, RSS)
oracle/db.py  → SQLite storage + schema migration
oracle/scoring.py → Bucket classifier + scoring engine
oracle/summarize.py → Rule-based summarization
oracle/variants/ → Render config (default, research, devops, brief)

Sources

Source Status Notes
GitHub ✅ Token-auth (5k req/hr) 20 entries fetched, scored
arXiv ✅ Working 20 entries fetched, scored
Reddit ✅ Working (RSS) Subreddits: HuggingFace, llamacpp, artificial, DeepLearning. Rate-limit-aware (waits ~60s between subs)
HackerNews ✅ Working (via HN API) 19 entries fetched, scored
HuggingFace ✅ Working 20 entries fetched, scored
RSS ✅ Working feedparser installed, 14 entries fetched

Current State

  • 144 entries in oracle.db
  • 5 variants rendered: default, brief, devops, research, ai-news-daily
  • Site deployed: https://preprod2.afterthedemo.com/ + /ai-news-daily/index.html + /brief/ + /devops/ + /research/
  • Deploy mechanism: pre-render locally → commit site/ → create Gitea release → webhook fires → listener syncs to VPS webroot
  • Build command set to true (no-op) since files are pre-rendered

Done

  • Cloned to local PC
  • Schema migration + scoring columns applied
  • GitHub token wired (.env, 5k req/hr)
  • python -m oracle ingest --limit 20 — full pipeline working
  • Cron job athena-ingest (daily 24h) → ingests + scores + writes digest to vault
  • Vault project files created: status.md, decisions.md, digest-template.md
  • 2026-09-02: Deployed to preprod2 — 5 variants live with fresh stories through 2026-09-02
  • 2026-09-02: Fixed cli.py _load_env to tolerate missing dotenv module on VPS
  • 2026-09-05: Reddit adapter working — AI subs (HuggingFace, llamacpp, artificial, DeepLearning), rate-limit-aware RSS. Two daily cron jobs (6am/6pm). Pushed main → live on preprod2. Workflow saved to 08_workflows/ai-news-daily-deploy.md

Not done / next

  • Enable GitHub, arXiv, HF, HN, RSS adapters (tested locally)
  • Fix Reddit RSS (429 from this IP — may need proxy)
  • Cron job for daily ingestion
  • Wire digests into daily notes automatically
  • Test render (variants → static site) — 5 variants + AI News Daily built
  • Surface top entries to daily notes
  • Set up oracle pipeline on VPS (needs SSH access — currently blocked)

Deployment (2026-09-02)

  • Deployed to https://preprod2.afterthedemo.com/ ✅
  • 5 variants live: default, brief, devops, research, ai-news-daily
  • Fresh stories through 2026-09-02
  • VPS SSH still blocked; pipeline lives locally for now
  • Oracle needs to be migrated to VPS (can't ingest from local PC without SSH)

Decisions

  • Cap ~5 approved sources (depth over firehose)
  • Pure rule-based — no embeddings, no LLM classification
  • Velocity ranking for GitHub (not raw stars)
  • GitHub unauthenticated rate limit: 60 req/hr (budget calls, 30s timeout per source)
  • VPS SSH is firewalled: >3 failed connects blocks IP. Do NOT loop SSH attempts.