Bookmarks for tag attention

Oct 23, 2020
Back to Tags
  1. Attention in NLP - Kate Loginova - Medium

    attention

  2. Attention and Augmented Recurrent Neural Networks

    attention deep learning

  3. Google AI Blog: Transformer: A Novel Neural Network Architecture for Language Understanding

    attention transformers

  4. Understand Self-Attention in BERT Intuitively - Towards Data Science
    Good explanation about Q, K and V vectors/matrices

    attention

  5. Paper Dissected: "Attention is All You Need" Explained | Machine Learning Explained
    Fantastic dissection of the Transformer model inner aspects (Q/K/V matrices, rationale, math, and code)

    attention transformers

  6. Dissecting BERT Part 1: The Encoder
    Nice explanation/dissection of the attention rationale and math

    attention bert

Antônio Theóphilo
Antônio Theóphilo
Ph.D. Student

I am a Ph.D. student at the Institute of Computing/University of Campinas (UNICAMP) in the fields of Artificial Intelligence and Natural Language Processing. My research interests include Artificial Intelligence, Natural Language Processing, and Information Security.