Podcast episode
2000–2026: from phrase tables and n-grams to transformers, GPT-3, InstructGPT, open weights, and what’s inside a September 2026 checkpoint. Rony and Meghna walk the primary papers — no demos, no skipped boring years.
The PromptsBuddy Podcast
Year 2000 — counting
The Lineage, episode one of three. Text and multimodal understanding from 2000 to September 2026.
Rony asks what changed. Meghna reads the primary papers — including the ones that sit in a 2026 checkpoint and never got a conference talk. No employer affiliations. Paper facts only.
Next week: image and video generation. Then audio.
Papineni 2002 · Koehn 2003 · Bengio 2003 · Vaswani 2017 · Brown 2020 · Ouyang 2022 · DeepSeek-R1 2025 · Su 2021 RoPE · Ainslie 2023 GQA · Leviathan 2023 · Reimers 2019 · Park 2023 · AutoGen · Kimi K2 report
Extracts what a study actually established, at what sample size, under what conditions — and separates the authors' claims from what the press release said.
Produces the orientation doc a new engineer actually needs: the three things that will confuse them, the load-bearing files, and the conventions nobody wrote down.
Four lines that stop a model guessing at what you meant. It interviews you until it can actually do the task, which turns a mediocre first answer into a usable one.