SumGPT
https://github.com/unnamed-idea/sumgpt/tree/mainA character-level decoder-only transformer ("SumGPT") that learns to perform decimal summation from string expressions and is designed to study attention stability, hallucinations, and generalization behavior for safety critical applications of attention based systems.