Letting language models edit their own context, rather than relying on fixed summarization or retrieval rules, pushed accuracy up 11.4% while cutting compute 21.5% on one benchmark. Reinforcement learning drove even bigger gains, but researchers warn the models can still delete information they later need.

— via InfoQ, Sergio De Simone