Most language model fine-tuning research solves a clean problem: take some text, predict the next token, collect a scalar loss, backpropagate, update weights. This works beautifully for single-turn tasks. But real AI agents don’t work this way. They make decisions across multiple timesteps. Environments branch into unexpected futures. Feedback arrives o…
Substack is the home for great culture


