Notes from the build

Bounded-Memory Long-Horizon Conversations: MGPT on BABILong

A 4B-parameter MGPT reaches 99% token accuracy on BABILong QA1 with constant memory usage, by letting the model govern its own KV cache through masking. The demo, the result, and the original 2025 paper.