In Depth

T5 and BART use encoder-decoder architecture. The encoder builds a rich understanding of the input, then the decoder produces output conditioned on that understanding. This architecture is good for translation, summarization, and question-answering.