Languages, a powerful way to weave imaginations out of sheer words and phrases. But the question is, "How can machines understand and map meanings?" We will be covering lots of topics relevant to Neural Machine Translation.
Minor Correction: For the Bottom-right equation mentioned at 5th minute of the video (LSTM), the equation is as follow :
tanh(c_t) *sigmoid[ ( )x_t + ( )h_t-1+ ( ) ] = h_t
The gates here are the sigmoids, and not the equations by themselves.
References
Olah, C. (2015). Understanding lstm networks, 2015. URL https://colah.github.io/posts/2015-08....
Bahdanau, D., Cho, K., & Bengio, Y. (2014). Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473.
Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014). Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078.
Sutskever, I., Vinyals, O., & Le, Q. V. (2014). Sequence to sequence learning with neural networks. In Advances in neural information processing systems (pp. 3104-3112).
Cruse, H. (1996). Neural networks as cybernetic systems. Stuttgart: Thieme.
Hochreiter, S., & Schmidhuber, J. (1997). Long short-term memory. Neural computation, 9(8), 1735-1780.
De Mulder, Wim, Steven Bethard, and Marie-Francine Moens. "A survey on the application of recurrent neural networks to statistical language modeling." Computer Speech & Language 30.1 (2015): 61-98.
Marino, J. B., Banchs, R. E., Crego, J. M., de Gispert, A., Lambert, P., Fonollosa, J. A., & Costa-Jussà, M. R. (2006). N-gram-based machine translation. Computational linguistics, 32(4), 527-549.
Cho, K., Van Merriënboer, B., Gulcehre, C., Bahdanau, D., Bougares, F., Schwenk, H., & Bengio, Y. (2014). Learning phrase representations using RNN encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078.
Schwenk, H. (2012). Continuous space translation models for phrase-based statistical machine translation. Proceedings of COLING 2012: Posters, 1071-1080.
Hochreiter, S. (1991). Untersuchungen zu dynamischen neuronalen Netzen. Diploma, Technische Universität München, 91, 1.
I have taken a few vector art from https://www.freepik.com/
Music: http://www.purple-planet.com
Please consider supporting the channel on Patreon page :
/ crazymuse
Thanks to my current patrons for supporting the work :
1. Parth Parikh
2. Laher .D
3. Himmat .D