Non-Conforming Transformers