Generating discrete sequences: language and music
Offered By: Ural Federal University via edX
Course Description
Overview
This course covers modern approaches to the generation of sequential data. It includes the generation of natural language as a sequence of subword tokens and music as a sequence of notes. We mostly focus on modern deep learning methods and pay a lot of attention to challenges and open questions in the field. The main goal of the course is to expose students to novel techniques in sequence generation and help them develop skills to use these techniques in practice. The course aims to bring students to the point where they have a general understanding of sequence generation and are ready to do a deeper dive into any particular area they are interested in: language, music or bioinformatic sequences.
Syllabus
Word2Vec, BPE, Markov chain-nased Language Models, RNN, LSTM, autoencoder, self-attention, transformer, BERT
Taught by
Ivan P. Yamshchikov
Tags
Related Courses
Neural Networks for Machine LearningUniversity of Toronto via Coursera 機器學習技法 (Machine Learning Techniques)
National Taiwan University via Coursera Machine Learning Capstone: An Intelligent Application with Deep Learning
University of Washington via Coursera Прикладные задачи анализа данных
Moscow Institute of Physics and Technology via Coursera Leading Ambitious Teaching and Learning
Microsoft via edX