AIAny

An Opinionated Guide to ML Research

Career advice for ML researchers from the creator of TRPO and PPO: how to pick problems worth solving, why goal-driven beats idea-driven research, and the daily notebook-and-review habit that compounds small experiments into breakthroughs.

Introduction

Most ML advice obsesses over technique, but Schulman argues the harder and higher-leverage skill is taste — knowing which problems are worth your next six months. Written in 2017 for the first cohort of OpenAI Fellows and still passed around as required reading, the essay distills how a creator of PPO actually decides what to work on, and how to keep momentum when results refuse to cooperate.

What Sets It Apart
  • Idea-driven vs goal-driven research. Chasing the literature invites getting scooped; a concrete goal hands you a perspective no one else has, so a solo researcher without a famous lab can still outrun the pack.
  • Aim high, climb incrementally. A 10% gain only matters inside a 10X goal — and a method's allowed complexity scales with its payoff: a 10% improvement had better be two lines of code, or no one (not even you) will use it.
  • Restrict yourself to general solutions. Hitting your target with a domain-specific hack advances nothing; constrain the search to methods that transfer to other problems.
  • The notebook-and-review loop. Daily entries plus a condensed weekly review (findings, insights, code progress, next steps) turns scattered work into compounding progress and honest accounting of where your time went.
Great Fit / Look Elsewhere

Great fit if you are a grad student, fellow, or early-career researcher choosing a direction and you want a battle-tested operating system for multi-month research projects. Look elsewhere if you want hands-on tutorials, math derivations, or code — this is about judgment and process, not implementation.

Information

  • Websitejoschu.net
  • AuthorsJohn Schulman
  • Published date2020/01/24

More Items

GitHub

A 12-week, 24-lesson beginner-friendly AI curriculum with executable Jupyter notebooks, quizzes and labs that teach neural networks, computer vision, NLP, generative models and ethics using PyTorch and TensorFlow examples.

Frames AI research as a trainable practice of reading, building, debugging, and fast feedback. The essay is most useful for researchers learning how to avoid hype-chasing, benchmark tunnel vision, and agent-induced blind spots.

GitHub

Hands-on, phase-based curriculum for building end-to-end AI systems from first principles — implement algorithms, run tests, and ship reusable artifacts (prompts, skills, agents, MCP servers) across Python, TypeScript, Rust, and Julia under an MIT license.