Sync with live vault: 28 new files, 7 imports, 16 updates
This commit is contained in:
@@ -1,9 +1,9 @@
|
||||
# Athena Oracle — decisions
|
||||
# Athena Oracle — Decisions
|
||||
|
||||
| Date | Decision | Why |
|
||||
|------|----------|-----|
|
||||
| 2026-07 | Cap ~5 approved sources | Depth over firehose; user preference |
|
||||
| 2026-07 | Disable RSS from ENABLED_SOURCES (code kept) | Stability / approved set |
|
||||
| 2026-07 | Velocity ranking for GitHub | Avoid forever-viral old repos |
|
||||
| 2026-07 | Public Gitea repo | Shareable oracle artifact |
|
||||
| 2026-07 | Epictetus git author | VPS/Gitea default — not a second human co-author |
|
||||
| 2026-08-31 | Cap ~5 approved sources | Depth over firehose; user preference |
|
||||
| 2026-08-31 | Disable RSS from ENABLED_SOURCES (code kept) | Stability / approved set |
|
||||
| 2026-08-31 | Velocity ranking for GitHub | Avoid forever-viral old repos |
|
||||
| 2026-08-31 | Pure rule-based scoring | No embeddings, no LLM classification needed |
|
||||
| 2026-08-31 | Epictetus git author on VPS/Gitea | Server default — not a second human co-author |
|
||||
|
||||
@@ -0,0 +1,10 @@
|
||||
# Athena Digest — YYYY-MM-DD
|
||||
|
||||
## Top Entries
|
||||
|
||||
| # | Score | Bucket | Verdict | Source | Title |
|
||||
|---|-------|--------|---------|--------|-------|
|
||||
|
||||
## Theme Scan
|
||||
|
||||
## Notes
|
||||
@@ -1,29 +1,69 @@
|
||||
# Athena Oracle — status
|
||||
# Athena Oracle — Status
|
||||
|
||||
**Updated:** 2026-07-09
|
||||
**Repo:** `Tony_tech/athena-oracle` (Gitea, public)
|
||||
**Runtime:** `~/oracle` (if present) · cron ~13:00 UTC + theme_scan
|
||||
**Updated:** 2026-08-31
|
||||
**Repo:** `~/Projects/athena-oracle/` (cloned from `Tony_tech/athena-oracle`)
|
||||
**DB:** `~/Projects/athena-oracle/oracle.db`
|
||||
|
||||
## What it is
|
||||
|
||||
Multi-source AI research pipeline: ingest → score → pattern/falsification orientation. MVP = pattern-proof, not a polished product.
|
||||
Multi-source AI research pipeline: ingest → score → bucket → render. Pure rule-based, no LLM required for classification. MVP = pattern-proof, not a polished product.
|
||||
|
||||
## Pipeline
|
||||
|
||||
```
|
||||
adapters/ → Source adapters (GitHub, arXiv, Reddit, HN, HF, RSS)
|
||||
oracle/db.py → SQLite storage + schema migration
|
||||
oracle/scoring.py → Bucket classifier + scoring engine
|
||||
oracle/summarize.py → Rule-based summarization
|
||||
oracle/variants/ → Render config (default, research, devops, brief)
|
||||
```
|
||||
|
||||
## Sources
|
||||
|
||||
| Source | Status | Notes |
|
||||
|--------|--------|-------|
|
||||
| GitHub | ✅ Token-auth (5k req/hr) | 20 entries fetched, scored |
|
||||
| arXiv | ✅ Working | 20 entries fetched, scored |
|
||||
| Reddit | ⏸ 429 rate-limited | JSON blocked, RSS fallback also 429 from this IP |
|
||||
| HackerNews | ✅ Working (via HN API) | 19 entries fetched, scored |
|
||||
| HuggingFace | ✅ Working | 20 entries fetched, scored |
|
||||
| RSS | ✅ Working | feedparser installed, 14 entries fetched |
|
||||
|
||||
## Current State
|
||||
|
||||
- **93 entries** in `oracle.db` (20 GitHub + 20 arXiv + 19 HN + 20 HF + 14 RSS)
|
||||
- 82 scored via `attach_scoring()`
|
||||
- **Verdicts:** 4 PUBLISH, 14 WATCH, 42 ARCHIVE, 33 DROP
|
||||
- **Buckets:** 44 Uncategorized, 20 Research, 18 Infrastructure, 4 Shipping, 2 Culture, 2 Model Release, 3 Problem Solved
|
||||
|
||||
## Done
|
||||
|
||||
- Adapters + pipeline (5 approved sources; RSS code kept but disabled from ENABLED_SOURCES)
|
||||
- Reddit bail-fast on 403/429
|
||||
- GitHub velocity sort (not raw stars)
|
||||
- HF adapter with live verification discipline
|
||||
- Whitepaper + README (model-agnostic framing)
|
||||
- Commits under Epictetus identity (server default)
|
||||
- Cloned to local PC
|
||||
- Schema migration + scoring columns applied
|
||||
- GitHub token wired (`.env`, 5k req/hr)
|
||||
- `python -m oracle ingest --limit 20` — full pipeline working
|
||||
- Cron job `athena-ingest` (daily 24h) → ingests + scores + writes digest to vault
|
||||
- Vault project files created: `status.md`, `decisions.md`, `digest-template.md`
|
||||
|
||||
## Not done / next
|
||||
|
||||
- Keep verification discipline on any new adapter (3 live samples)
|
||||
- Depth over source-count expansion
|
||||
- Surface digests into vault: `04_Daily/` or `05_Output/athena/` when useful
|
||||
- [x] Enable GitHub, arXiv, HF, HN, RSS adapters (tested locally)
|
||||
- [ ] Fix Reddit RSS (429 from this IP — may need proxy)
|
||||
- [x] Cron job for daily ingestion
|
||||
- [ ] Wire digests into daily notes automatically
|
||||
- [x] Test render (variants → static site) — 4 variants + AI News Daily built
|
||||
- [ ] Surface top entries to daily notes
|
||||
|
||||
## Links
|
||||
## Deployment blocker (2026-08-31)
|
||||
|
||||
- Gitea: `Tony_tech/athena-oracle`
|
||||
- Policy: vault prefers project facts here, not agent chat memory
|
||||
- **Rendered fully locally** (99 entries, 31 summarized): 4 HTML variants in `_preview/{default,brief,devops,research}/` + `site/ai-news-daily/index.html` (12KB, 50 stories).
|
||||
- **Deploy to `preprod1.afterthedemo.com` blocked:** all remote access is down. VPS SSH 74.208.111.99:22 is firewalled (times out), Tailscale 100.64.0.1:22 times out, all users/key/password auth rejected. Gitea (74.208.111.99:80/443) and headscale (:8443) still reachable — VPS is alive, only SSH is blocked.
|
||||
- **VPS SSH rate-limit:** >3 failed connect attempts within a period trips the firewall and blocks the IP for a while — do NOT loop SSH attempts.
|
||||
- **Options (need Anthony):** (a) SSH in himself and add `~/.ollama/id_ed25519.pub` or `~/ssh-keys/vps-deploy.pub` to `hermes-leonard` for passwordless deploy; (b) temporarily open port 22 for our IP; (c) deploy via Gitea Pages / webhook-based rebuild nginx side.
|
||||
|
||||
## Decisions
|
||||
|
||||
- Cap ~5 approved sources (depth over firehose)
|
||||
- Pure rule-based — no embeddings, no LLM classification
|
||||
- Velocity ranking for GitHub (not raw stars)
|
||||
- GitHub unauthenticated rate limit: 60 req/hr (budget calls, 30s timeout per source)
|
||||
|
||||
Reference in New Issue
Block a user