Natural Language Processing
Higher School of Economics via Coursera
-
1.4k
-
- Write review
Overview
Class Central Tips
Throughout the lectures, we will aim at finding a balance between traditional and deep learning techniques in NLP and cover them in parallel. For example, we will discuss word alignment models in machine translation and see how similar it is to attention mechanism in encoder-decoder neural networks. Core techniques are not treated as black boxes. On the contrary, you will get in-depth understanding of what’s happening inside. To succeed in that, we expect your familiarity with the basics of linear algebra and probability theory, machine learning setup, and deep neural networks. Some materials are based on one-month-old papers and introduce you to the very state-of-the-art in NLP research.
Do you have technical problems? Write to us: coursera@hse.ru
Syllabus
- Intro and text classification
- In this module we will have two parts: first, a broad overview of NLP area and our course goals, and second, a text classification task. It is probably the most popular task that you would deal with in real life. It could be news flows classification, sentiment analysis, spam filtering, etc. You will learn how to go from raw texts to predicted classes both with traditional methods (e.g. linear classifiers) and deep learning techniques (e.g. Convolutional Neural Nets).
- Language modeling and sequence tagging
- In this module we will treat texts as sequences of words. You will learn how to predict next words given some previous words. This task is called language modeling and it is used for suggests in search, machine translation, chat-bots, etc. Also you will learn how to predict a sequence of tags for a sequence of words. It could be used to determine part-of-speech tags, named entities or any other tags, e.g. ORIG and DEST in "flights from Moscow to Zurich" query. We will cover methods based on probabilistic graphical models and deep learning.
- Vector Space Models of Semantics
- This module is devoted to a higher abstraction for texts: we will learn vectors that represent meanings. First, we will discuss traditional models of distributional semantics. They are based on a very intuitive idea: "you shall know the word by the company it keeps". Second, we will cover modern tools for word and sentence embeddings, such as word2vec, FastText, StarSpace, etc. Finally, we will discuss how to embed the whole documents with topic models and how these models can be used for search and data exploration.
- Sequence to sequence tasks
- Nearly any task in NLP can be formulates as a sequence to sequence task: machine translation, summarization, question answering, and many more. In this module we will learn a general encoder-decoder-attention architecture that can be used to solve them. We will cover machine translation in more details and you will see how attention technique resembles word alignment task in traditional pipeline.
- Dialog systems
- This week we will overview so-called task-oriented dialog systems like Apple Siri or Amazon Alexa. We will look in details at main building blocks of such systems namely Natural Language Understanding (NLU) and Dialog Manager (DM). We hope this week will encourage you to build your own dialog system as a final project!
Taught by
Alexey Zobnin, Andrei Zimovnov, Sergey Yudin, Anna Potapenko and Anna Kozlova
Charts
Related Courses
-
Natural Language Processing in TensorFlow
deeplearning.ai
4.0 -
Natural Language Processing with Probabilistic Models
deeplearning.ai
-
Sequence Models for Time Series and Natural Language Processing
Google Cloud, Google
1.0 -
Natural Language Processing (NLP)
Microsoft
1.0 -
Natural Language Processing with Classification and Vector Spaces
deeplearning.ai
5.0 -
Natural Language Processing
deeplearning.ai
Reviews
5.0 rating, based on 2 reviews
-
Anonymous is taking this course right now.
Wonderful course ,which is helpful for sentiment Analysis,speech recognition.
As I am data science student this course is very helpful for me. Thanks to Coursera for conducting this amazing course -
Anonymous is taking this course right now.
Excellent and advance course to start with NLP. I am currently working research on NLP in URDU language during my masters and it helped me a lot.
Wish to have it for free.