C.W.K.
Stream
Lesson 02 of 10 · published

How to Track Progress

~15 min · evaluation, staying-current, l2

Level 0Spark
0 XP0/100 lessons0/14 achievements
0/200 XP to next level200 XP to go0% complete

Staying current in generative media is like weather forecasting. You don't need to understand every atmospheric variable — you need reliable sources that summarize conditions and trends. Build a small, trusted information diet rather than drowning in every tweet and press release.

Primary Sources (Official)

These come directly from model creators and carry the most reliable technical information:

  • Official blogs — OpenAI Blog, Stability AI Blog, Google DeepMind Blog, Runway Research, Black Forest Labs Blog. These announce new models with technical details, capabilities, and limitations.
  • Model cards — Technical specification sheets published with model releases. They document architecture, training data, intended uses, known limitations, and evaluation results. Always read the model card before adopting a new model.
  • Release notes / changelogs — API and platform changelogs reveal incremental improvements, new parameters, pricing changes, and deprecations. These often matter more than big launch announcements.
  • Research papers — arxiv.org hosts preprints for major model papers. You don't need to read the math — the abstract, introduction, and results/limitations sections give you 80% of the value.

Curated Sources (Community)

These filter and contextualize information for practitioners:

  • Benchmark leaderboards — Artificial Analysis Video Arena, Chatbot Arena Image Generation. These provide standardized comparisons across models using consistent evaluation criteria.
  • Example galleries — Official galleries from Midjourney, Runway, and community galleries on CivitAI show real-world output quality, not cherry-picked demos.
  • Newsletter/blog summaries — Well-curated AI newsletters that summarize weekly developments save hours of individual source tracking.
  • YouTube creators — Channels that test new models with consistent, practical prompts provide better evaluation than official marketing materials.

Building Your Information Pipeline

Key Takeaways
  • Build a small, trusted information pipeline — 5-10 sources maximum — rather than trying to read everything.
  • Primary sources (official blogs, model cards) are more reliable than social media hype.
  • Structure your tracking as daily (5 min), weekly (30 min), monthly (2 hr), and quarterly (half day) rhythms.
  • The goal is awareness that something changed and what it means for your work, not technical exhaustiveness.

Code

How to Track Progress — example·json
{
  "information_diet": {
    "daily_5min": [
      "Scan 1-2 AI newsletters (filtered summaries)",
      "Check bookmark folder of official blogs for new posts"
    ],
    "weekly_30min": [
      "Watch 1-2 model comparison videos",
      "Browse community galleries for quality trends",
      "Check benchmark leaderboards for ranking changes"
    ],
    "monthly_2hr": [
      "Read model cards for any models you use in production",
      "Test one new model hands-on with your own prompts",
      "Update your personal model evaluation notes"
    ],
    "quarterly_half_day": [
      "Review and revise your model selection framework",
      "Update pricing/capability comparison spreadsheet",
      "Reassess whether your current tools still fit your needs"
    ]
  }
}

External links

Exercise

Pick 5 sources (official blog + 1 independent reviewer + 1 community forum + 1 newsletter + 1 benchmark site). Bookmark them. Set a 20-minute weekly window to check all 5. Anything not in those 5 is noise.

Progress

Progress is local-only — sign in to sync across devices.
Spotted a bug or have feedback on this page?Report an Issue

Comments 0

🔔 Reply notifications (sign in)
Sign inPlease sign in to comment.

No comments yet — be the first.