Double-Take: Improving Capacity, Binding, and Selectivity In Long-Context Within Bidirectional Memory
Read the original on arXiv Machine Learning →The paper introduces Double-Take (DT), a memory architecture designed to improve capacity, binding, and selectivity in long-context processing. DT addresses two key failures in large-chunk test-time training: interference from single-step writes and the inability of self-associative writes to form cross-position bindings, by employing multi-step unpinned updates, cross-position mixing, and bidirectional change-sensitive writes. Evaluations on genomic data show DT achieving high recall and AUROC across increasing context sizes, and zero-shot transfer from human to mouse, demonstrating the importance of these three memory requirements.
Machine-generated by The Flow from the publisher's headline and feed description — not written or checked by a human. The full article lives at arXiv Machine Learning.