Sources and further reading

Numbered in order of first appearance in this article.

  1. McCulloch, W. S. and Pitts, W. (1943). A logical calculus of the ideas immanent in nervous activity. Bulletin of Mathematical Biophysics, 5, 115-133. https://doi.org/10.1007/BF02478259
  2. Rumelhart, D. E., Hinton, G. E. and Williams, R. J. (1986). Learning representations by back-propagating errors. Nature, 323, 533-536. https://doi.org/10.1038/323533a0
  3. Hochreiter, S. and Schmidhuber, J. (1997). Long short-term memory. Neural Computation, 9(8), 1735-1780. https://doi.org/10.1162/neco.1997.9.8.1735
  4. Bahdanau, D., Cho, K. and Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. https://arxiv.org/abs/1409.0473
  5. Vaswani, A. et al. (2017). Attention is all you need. https://arxiv.org/abs/1706.03762
  6. Rosenblatt, F. (1958). The perceptron: a probabilistic model for information storage and organisation in the brain. Psychological Review, 65(6), 386-408. https://doi.org/10.1037/h0042519
  7. Nair, V. and Hinton, G. E. (2010). Rectified linear units improve restricted Boltzmann machines. Proceedings of ICML 2010.
  8. Zeiler, M. D. and Fergus, R. (2014). Visualizing and understanding convolutional networks. https://arxiv.org/abs/1311.2901
  9. Krizhevsky, A., Sutskever, I. and Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. NeurIPS 2012. https://papers.nips.cc/paper/2012/hash/c399862d3b9d6b76c8436e924a68c45b-Abstract.html