Research Papers Referenced in this Course

Course Q&A Deep Learning Specialization Sequence Models
, , , ,
1

Hi,

I felt it might be good to make a list of all research papers that were referenced in this Sequence Models course by Prof. Ng. Please let me know if I have left out something.
Week 1

  1. Cho et al., 2014. On the properties of neural machine translation Encoder-decoder approaches
  2. Chung et al., 2014. Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelling
  3. Hochreiter and Schmidhuber, 1997. Long short-term memory (I was unable to get link for free access)

Week 2

  1. van der Maaten and Hinton, 2008. Visualizing data using t-SNE
  2. Taigman et al., 2014. DeepFace: Closing the gap to human level performance
  3. Bengio et al., 2003. A neural probabilistic language model
  4. Mikolov et al., 2013. Efficient estimation of word representations in vector space
  5. Mikolov et al., 2013. Distributed representation of words and phrases and their compositionality
  6. Pennington et al., 2014. GloVe: Global vectors for word representation
  7. Bolukbasi et al., 2016. Man is to computer programmer as woman is to homemaker? Debiasing word embeddings

Week 3

  1. Sutskever et al., 2014. Sequence to sequence learning with neural networks
  2. Mao et al., 2014. Deep captioning with multimodal recurrent neural networks
  3. Vinyals et al., 2014. Show and tell: Neural image caption generator
  4. Karpathy and Fei-Fei, 2015. Deep visual-semantic alignment for generating image descriptions
  5. Papineni et al., 2002. Bleu: a method for automatic evaluation of machine translation
  6. Bandanau et al., 2014. Neural machine translation by jointly learning to align and translate
  7. Xu et al., 2015. Show, attend and tell: neural image caption generation with visual attention
  8. Graves et al., 2006. Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks

Week 4

  1. Vaswani et al., 2017. Attention Is All You Need

The reason I created this was because I was working on an NLP project and thought it would be nice if there was a single place where I could find all of the most important research papers.

Hope this helps,
Sushant Nair.

3 Likes
2

Thanks for sharing this!

3

You’re welcome :smile:
Soon if possible I will collate all research paper references used in the specialization in a single post, and post it in the “Deep Learning Specialization” category.
As I am working on an NLP-based research project, I needed a quick way to access all important NLP related papers. So I did that first.

Thanks

1 Like
4

Thanks for taking the time to share that.

5

You’re welcome :smiley: