Transformer Attention Analysis This repository contains code and models for analyzing and comparing dense and sparse transformer architectures at the byte/character level, with a focus on attention ...