Alternative to QKV Architecture — STO (Semantics, Time, Operator)
Author: Boris D. Yarovoy Status: Conceptual framework with comprehensive empirical validation — including negative results that corrected earlier claims. Abstract The Transformer architecture has dominated sequence modeling through its Query-Key-Value (QKV) attention mechanism. I propose an alternative attention architecture called Attentime , based on three orthogonal components: a symmetric Query-Key matrix capturing pure semantic affinity, an asymmetric Time matrix implementing causal physics through learnable decay, and a dynamically activated Dynamic Value matrix computed as a function of interacting keys. Through targeted micro-experiments, I demonstrate: (1) numerical stability, (2) 100% accuracy on syntactic role resolution across active, passive, and relative clause structures, (3) architectural prevention of catastrophic forgetting for new tokens — a capability standard Transformers lack without external methods, and (4) separable caching that preserves 100% accu...
.jfif)
