YoVDO

Generating discrete sequences: language and music

Offered By: Ural Federal University via edX

Tags

Deep Learning Courses Bioinformatics Courses BERT Courses Recurrent Neural Networks (RNN) Courses Long short-term memory (LSTM) Courses Transformers Courses Word2Vec Courses Music Generation Courses

Course Description

Overview

This course covers modern approaches to the generation of sequential data. It includes the generation of natural language as a sequence of subword tokens and music as a sequence of notes. We mostly focus on modern deep learning methods and pay a lot of attention to challenges and open questions in the field. The main goal of the course is to expose students to novel techniques in sequence generation and help them develop skills to use these techniques in practice. The course aims to bring students to the point where they have a general understanding of sequence generation and are ready to do a deeper dive into any particular area they are interested in: language, music or bioinformatic sequences.


Syllabus

Word2Vec, BPE, Markov chain-nased Language Models, RNN, LSTM, autoencoder, self-attention, transformer, BERT


Taught by

Ivan P. Yamshchikov

Tags

Related Courses

Reinforcement Learning for Trading Strategies
New York Institute of Finance via Coursera
Natural Language Processing with Sequence Models
DeepLearning.AI via Coursera
Fake News Detection with Machine Learning
Coursera Project Network via Coursera
English/French Translator: Long Short Term Memory Networks
Coursera Project Network via Coursera
Text Classification Using Word2Vec and LSTM on Keras
Coursera Project Network via Coursera