383 B
383 B
AI & LLM MOC
Models & Inference
Research & Learning
- Prompt Engineering
- Model Evaluation
- AI Bottleneck Thesis — Tony Simons — inference > training, memory bandwidth, system scaffolding
- Inference Benchmarks — Local — 50+ tok/s on RTX 3060, why it works