Writing

Lessons learned from building multiplayer world models. Built a video tokenizer with spatial attention and a dynamics model with action spaces.

My experience using Tinker, why you should use it, and how it will make RL research faster.

As a constrained optimization problem, LLMs can use RL to invent their own compression schemes to increase its context window.

Language models, when trained on hidden-information games, naturally learn deceptive techniques to win the game by any means.