Memory and History

Transformer is stateless.