The pace of frontier AI research is unsustainable for any individual to track exhaustively. The right question is not "how do I follow everything?" but "how do I follow what matters to me, well enough?"
Primary sources
- arXiv. All major papers appear here first. Useful categories: cs.CL (NLP), cs.LG (ML), cs.AI. Subscribe to a daily digest filtered for your interests.
- Lab blogs. OpenAI, Google DeepMind, Meta AI, Anthropic, Mistral, DeepSeek publish technical announcements that distill what their papers say in operational language.
- Hugging Face. Model cards, papers-with-code links, leaderboards. The hub tracks open-source releases as they happen.
Community filters
- Papers With Code. Links papers to implementations and benchmark numbers.
- Twitter/X. Many researchers share early threads with commentary. Curate carefully.
- Reddit (r/MachineLearning, r/LocalLLaMA). Discussion, analysis, hands-on benchmarks of new releases.
- Substacks / newsletters. Import AI, AlphaSignal, The Algorithmic Bridge — weekly digests that filter the firehose.
Trends to watch in 2026
MoE efficiency improvements, longer context windows that actually work at depth, multimodal unification (text+vision+audio in a single residual stream), test-time compute scaling and reasoning specialization, smaller models matching larger ones at fixed quality, and non-Transformer architectures (Mamba, hybrids) on focused workloads.
The constants you've internalized in this course — attention math, positional encodings, scaling laws, training recipes — will outlast any specific model. New papers will rephrase rather than overturn them.