Type of deep learning architecture designed to process and understand sequences of data, especially human language.

They use a mechanism called attention to identify which words or pieces of information are the most important in a sentence or context.