About this Course
249,630 recent views

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Intermediate Level

You should take the first 2 courses of the TensorFlow Specialization and be comfortable coding in Python and understanding high school-level math.

Approx. 8 hours to complete

Suggested: 4 weeks of study, 4-5 hours/week...

English

Subtitles: English

What you will learn

  • Check

    Build natural language processing systems using TensorFlow

  • Check

    Process text, including tokenization and representing sentences as vectors

  • Check

    Apply RNNs, GRUs, and LSTMs in TensorFlow

  • Check

    Train LSTMs on existing text to create original poetry and more

Skills you will gain

Natural Language ProcessingTokenizationMachine LearningTensorflowRNNs

100% online

Start instantly and learn at your own schedule.

Flexible deadlines

Reset deadlines in accordance to your schedule.

Intermediate Level

You should take the first 2 courses of the TensorFlow Specialization and be comfortable coding in Python and understanding high school-level math.

Approx. 8 hours to complete

Suggested: 4 weeks of study, 4-5 hours/week...

English

Subtitles: English

Syllabus - What you will learn from this course

Week
1
3 hours to complete

Sentiment in text

The first step in understanding sentiment in text, and in particular when training a neural network to do so is the tokenization of that text. This is the process of converting the text into numeric values, with a number representing a word or a character. This week you'll learn about the Tokenizer and pad_sequences APIs in TensorFlow and how they can be used to prepare and encode text and sentences to get them ready for training neural networks!

...
13 videos (Total 30 min), 1 reading, 3 quizzes
13 videos
Using APIs2m
Notebook for lesson 12m
Text to sequence3m
Looking more at the Tokenizer1m
Padding2m
Notebook for lesson 24m
Sarcasm, really?2m
Working with the Tokenizer1m
Notebook for lesson 33m
Week 1 Outro21s
1 reading
News headlines dataset for sarcasm detection10m
1 practice exercise
Week 1 Quiz
Week
2
3 hours to complete

Word Embeddings

Last week you saw how to use the Tokenizer to prepare your text to be used by a neural network by converting words into numeric tokens, and sequencing sentences from these tokens. This week you'll learn about Embeddings, where these tokens are mapped as vectors in a high dimension space. With Embeddings and labelled examples, these vectors can then be tuned so that words with similar meaning will have a similar direction in the vector space. This will begin the process of training a neural network to udnerstand sentiment in text -- and you'll begin by looking at movie reviews, training a neural network on texts that are labelled 'positive' or 'negative' and determining which words in a sentence drive those meanings.

...
14 videos (Total 39 min), 5 readings, 3 quizzes
14 videos
Looking into the details4m
How can we use vectors?2m
More into the details2m
Notebook for lesson 110m
Remember the sarcasm dataset?1m
Building a classifier for the sarcasm dataset1m
Let’s talk about the loss function1m
Pre-tokenized datasets43s
Diving into the code (part 1)1m
Diving into the code (part 2)2m
Notebook for lesson 35m
5 readings
IMDB reviews dataset10m
Try it yourself10m
TensoFlow datasets10m
Subwords text encoder10m
Week 2 Outro10m
1 practice exercise
Week 2 Quiz
Week
3
3 hours to complete

Sequence models

In the last couple of weeks you looked first at Tokenizing words to get numeric values from them, and then using Embeddings to group words of similar meaning depending on how they were labelled. This gave you a good, but rough, sentiment analysis -- words such as 'fun' and 'entertaining' might show up in a positive movie review, and 'boring' and 'dull' might show up in a negative one. But sentiment can also be determined by the sequence in which words appear. For example, you could have 'not fun', which of course is the opposite of 'fun'. This week you'll start digging into a variety of model formats that are used in training models to understand context in sequence!

...
10 videos (Total 16 min), 4 readings, 3 quizzes
10 videos
Implementing LSTMs in code1m
Accuracy and loss1m
A word from Laurence35s
Looking into the code1m
Using a convolutional network1m
Going back to the IMDB dataset1m
Tips from Laurence37s
4 readings
Link to Andrew's sequence modeling course10m
More info on LSTMs10m
Exploring different sequence models10m
Week 3 Outro10m
1 practice exercise
Week 3 Quiz
Week
4
3 hours to complete

Sequence models and literature

Taking everything that you've learned in training a neural network based on NLP, we thought it might be a bit of fun to turn the tables away from classification and use your knowledge for prediction. Given a body of words, you could conceivably predict the word most likely to follow a given word or phrase, and once you've done that, to do it again, and again. With that in mind, this week you'll build a poetry generator. It's trained with the lyrics from traditional Irish songs, and can be used to produce beautiful-sounding verse of it's own!

...
14 videos (Total 27 min), 3 readings, 3 quizzes
14 videos
NLP W4 L1 ( part 3) - Training the data2m
NLP W4 L1 ( part 3) - More on training the data1m
SC L1 - Notebook for lesson 18m
NLP W4 L2 (part 1) - Finding what the next word should be2m
NLP W4 L2 (part 2) - Example1m
NLP W4 L2 (part 3) - Predicting a word1m
NLP W4 L3 (part 1) - Poetry!40s
NLP W4 L3 ( part 2) Looking into the code1m
NLP W4 L3 ( part 3) - Laurence the poet!1m
NLP W4 L3 ( part 4) - Your next task1m
Outro, A conversation with Andrew Ng1m
3 readings
link to Laurence's poetry10m
Link to generating text using a character-based RNN10m
Week 4 Outro10m
1 practice exercise
Week 4 Quiz
4.7
19 ReviewsChevron Right

Top reviews from Natural Language Processing in TensorFlow

By GIJun 22nd 2019

Amazing course by Laurence Moroney. But only after finishing Sequence Models by Andrew NG, I was able to understand the concepts taught here.

By ASJun 29th 2019

Helped me in understanding how to use Tensorflow for NLP with Keras API

Instructor

Avatar

Laurence Moroney

AI Advocate
Google Brain

About deeplearning.ai

deeplearning.ai is Andrew Ng's new venture which amongst others, strives for providing comprehensive AI education beyond borders....

About the TensorFlow in Practice Specialization

Discover the tools software developers use to build scalable AI-powered algorithms in TensorFlow, a popular open-source machine learning framework. In this four-course Specialization, you’ll explore exciting opportunities for AI applications. Begin by developing an understanding of how to build and train neural networks. Improve a network’s performance using convolutions as you train it to identify real-world images. You’ll teach machines to understand, analyze, and respond to human speech with natural language processing systems. Learn to process text, represent sentences as vectors, and input data to a neural network. You’ll even train an AI to create original poetry! AI is already transforming industries across the world. After finishing this Specialization, you’ll be able to apply your new TensorFlow skills to a wide range of problems and projects. Courses 1-3 are available now, with Course 4 launching in July....
TensorFlow in Practice

Frequently Asked Questions

  • Once you enroll for a Certificate, you’ll have access to all videos, quizzes, and programming assignments (if applicable). Peer review assignments can only be submitted and reviewed once your session has begun. If you choose to explore the course without purchasing, you may not be able to access certain assignments.

  • When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile. If you only want to read and view the course content, you can audit the course for free.

More questions? Visit the Learner Help Center.