Seq2Seq and Attention

TimestampDescription
00:00:00Seq2Seq and Attention
00:00:37Seq2Seq as a general problem-solving approach
00:02:17Translating language with a seq2seq model
00:05:53Machine translation challenges
00:09:07Effective decoding with Beam Search
00:13:04Evaluating translation models with BLEU
00:16:23The information bottleneck
00:17:56Overcoming the bottleneck with Attention
00:22:39Additive vs Multiplicative Attention
00:26:47[DEMO] Neural Machine Translation WITHOUT Attention
00:50:59[DEMO] Neural Machine Translation WITH Attention
01:04:53Attention as information retrieval

References and Links