Try Skill Builder

Try Skill Builder

Have a friendly voice chat about how you're using AI, get feedback on your skills, and find out what to learn or build next.
Take Me There

Quick Guide & Tips

๐Ÿ’ป ย  Accessing Utils File and Helper Functions

In each notebook on the top menu:

1: ย  Click on "File"

2: ย  Then, click on "Open"

You will be able to see all the notebook files for the lesson, including any helper functions used in the notebook on the left sidebar. See the following image for the steps above.


๐Ÿ”„ ย  Reset User Workspace

If you need to reset your workspace to its original state, follow these quick steps:

1: ย  Access the Menu: Look for the three-dot menu (โ‹ฎ) in the top-right corner of the notebook toolbar.

2: ย  Restore Original Version: Click on "Restore Original Version" from the dropdown menu.

For more detailed instructions, please visit our Reset Workspace Guide.


๐Ÿ’ป ย  Downloading Notebooks

In each notebook on the top menu:

1: ย  Click on "File"

2: ย  Then, click on "Download as"

3: ย  Then, click on "Notebook (.ipynb)"


๐Ÿ’ป ย  Uploading Your Files

After following the steps shown in the previous section ("File" => "Open"), then click on "Upload" button to upload your files.


๐Ÿ“— ย  See Your Progress

Once you enroll in this courseโ€”or any other short course on the DeepLearning.AI platformโ€”and open it, you can click on 'My Learning' at the top right corner of the desktop view. There, you will be able to see all the short courses you have enrolled in and your progress in each one.

Additionally, your progress in each short course is displayed at the bottom-left corner of the learning page for each course (desktop view).


๐Ÿ“ฑ ย  Features to Use

๐ŸŽž ย  Adjust Video Speed: Click on the gear icon (โš™) on the video and then from the Speed option, choose your desired video speed.

๐Ÿ—ฃ ย  Captions (English and Spanish): Click on the gear icon (โš™) on the video and then from the Captions option, choose to see the captions either in English or Spanish.

๐Ÿ”… ย  Video Quality: If you do not have access to high-speed internet, click on the gear icon (โš™) on the video and then from Quality, choose the quality that works the best for your Internet speed.

๐Ÿ–ฅ ย  Picture in Picture (PiP): This feature allows you to continue watching the video when you switch to another browser tab or window. Click on the small rectangle shape on the video to go to PiP mode.

โˆš ย  Hide and Unhide Lesson Navigation Menu: If you do not have a large screen, you may click on the small hamburger icon beside the title of the course to hide the left-side navigation menu. You can then unhide it by clicking on the same icon again.


๐Ÿง‘ ย  Efficient Learning Tips

The following tips can help you have an efficient learning experience with this short course and other courses.

๐Ÿง‘ ย  Create a Dedicated Study Space: Establish a quiet, organized workspace free from distractions. A dedicated learning environment can significantly improve concentration and overall learning efficiency.

๐Ÿ“… ย  Develop a Consistent Learning Schedule: Consistency is key to learning. Set out specific times in your day for study and make it a routine. Consistent study times help build a habit and improve information retention.

Tip: Set a recurring event and reminder in your calendar, with clear action items, to get regular notifications about your study plans and goals.

โ˜• ย  Take Regular Breaks: Include short breaks in your study sessions. The Pomodoro Technique, which involves studying for 25 minutes followed by a 5-minute break, can be particularly effective.

๐Ÿ’ฌ ย  Engage with the Community: Participate in forums, discussions, and group activities. Engaging with peers can provide additional insights, create a sense of community, and make learning more enjoyable.

โœ ย  Practice Active Learning: Don't just read or run notebooks or watch the material. Engage actively by taking notes, summarizing what you learn, teaching the concept to someone else, or applying the knowledge in your practical projects.


๐Ÿ“š ย  Enroll in Other Short Courses

Keep learning by enrolling in other short courses. We add new short courses regularly. Visit DeepLearning.AI Short Courses page to see our latest courses and begin learning new topics. ๐Ÿ‘‡

๐Ÿ‘‰๐Ÿ‘‰ ๐Ÿ”— DeepLearning.AI โ€“ All Short Courses [+]


๐Ÿ™‚ ย  Let Us Know What You Think

Your feedback helps us know what you liked and didn't like about the course. We read all your feedback and use them to improve this course and future courses. Please submit your feedback by clicking on "Course Feedback" option at the bottom of the lessons list menu (desktop view).

Also, you are more than welcome to join our community ๐Ÿ‘‰๐Ÿ‘‰ ๐Ÿ”— DeepLearning.AI Forum


Sign in

Or, sign in with your email
Email
Password
Forgot password?
Don't have an account? Create account
By signing up, you agree to our Terms Of Use and Privacy Policy

Create Your Account

Or, sign up with your email
Email Address

Already have an account? Sign in here!

By signing up, you agree to our Terms Of Use and Privacy Policy

Choose Your Plan

MonthlyYearly

Change Your Plan

Your subscription plan will change at the end of your current billing period. You'll continue to have access to your current plan until then.

Learn More

Welcome back!

Hi ,

We'd like to know you better so we can create more relevant courses. What do you do for work?

Join Team Success

You have successfully joined undefined

You now have access to all Pro features. Click below to start learning!

Session Expired

Session expired โ€” please return to Cornerstone to restart the session and complete the course.

Course Syllabus

DeepLearning.AI
  • Explore Courses
  • Membership
  • Community
    • Forum
    • Events
    • Ambassadors
    • Ambassador Spotlight
  • My Learning
  • Elevate Your Career with Full Learning Experience

    Unlock Plus AI learning and gain exclusive insights from industry leaders

    Access exclusive features like graded notebooks and quizzes
    Earn unlimited certificates to enhance your resume
    Starting at $1 USD/mo after a free trial โ€“ cancel anytime
Welcome to the fourth and final course of this specialization. This course is called Natural Language Processing with Attention Models. When you finish this course, you have pretty much reached the cutting edge of today's practical NLP methods. You use a powerful technique called attention to build several different models. Some of the things you build using the attention mechanism. You build a powerful language translation model. You also build an algorithm capable of summarizing text. You build a model that can actually answer questions about a piece of text. With the skills you develop in this course, you'll be able to build state-of-the-art NLP applications just like the ones used in many large companies in industry today. I'm pleased to again welcome Lucas and Eunice as your instructors for this course. I know both of them are really excited to get into the materials with you. Lucas told me the other day he finds this course's topics very exciting. Lucas, maybe you could say a bit more about that. Many of these applications are built with attention models, which you are going to learn in this specialization. A few years ago, these models would take weeks or even months to train, but with attention, you can train these models in just a few hours. Thanks, Lucas. I still have very fond memories of when I was leading Google Brain, and it's nice to see the great work that the team continues to put out. Eunice, what do you think? What are the most exciting aspects of this course from your perspective? Well, Andrew, there's a lot to be excited about. For starters, the models that you'll build in this course represent the active areas of research at the cutting edge of the field. But beyond that, when it comes to modern deep learning, there's a sort of new normal, which is to say, most people aren't actually building and training models from scratch. Instead, it's more common to download a pre-trained model and then tweak it and fine-tune it for your specific use case. In this course, we show you how to build the models from scratch, but we also provide you custom pre-trained models that we created just for you. You will practice the workflow that's used in the industry, which is to fine-tune state-of-the-art pre-trained models. The tools you take away from this course, you'll literally be able to build NLP systems at the industry standard. Thanks very much, Eunice and Lucas, for that introduction to this course. This is a set of important materials that the course will go over, so let's get into it. All right, let's get started. Good luck!
specialization detail
  • Natural Language Processing Specialization
  • Natural Language Processing with Attention Models
    • Natural Language Processing with Classification and Vector SpacesCourse 1
    • Natural Language Processing with Probabilistic ModelsCourse 2
    • Natural Language Processing with Sequence ModelsCourse 3
    • Natural Language Processing with Attention ModelsCourse 4

    • View All Courses
  • Week 1
    • Week 1: Neural Machine Translation
    • Week 2: Text Summarization
    • Week 3: Question Answering
Next Lesson
Week 1: Neural Machine Translation
    Neural Machine Translation
  • Course 4 Introduction
    Video
    ใƒป
    2 mins
  • Week Introduction
    Video
    ใƒป
    1 min
  • Seq2seq
    Video
    ใƒป
    5 mins
  • Seq2seq Model with Attention
    Video
    ใƒป
    5 mins
  • Ungraded Lab: Basic Attention
    Code Example
    ใƒป
    30 mins
  • Background on seq2seq
    Reading
    ใƒป
    10 mins
  • Queries, Keys, Values, and Attention
    Video
    ใƒป
    5 mins
  • Ungraded Lab: Scaled Dot-Product Attention
    Code Example
    ใƒป
    30 mins
  • Setup for Machine Translation
    Video
    ใƒป
    1 min
  • Teacher Forcing
    Video
    ใƒป
    2 mins
  • NMT Model with Attention
    Video
    ใƒป
    3 mins
  • BLEU Score
    Video
    ใƒป
    4 mins
  • Ungraded Lab: BLEU Score
    Code Example
    ใƒป
    30 mins
  • ROUGE-N Score
    Video
    ใƒป
    5 mins
  • Sampling and Decoding
    Video
    ใƒป
    3 mins
  • Beam Search
    Video
    ใƒป
    6 mins
  • Minimum Bayes Risk
    Video
    ใƒป
    3 mins
  • Week Conclusion
    Video
    ใƒป
    1 min
  • Content Resource
    Reading
    ใƒป
    10 mins
  • [IMPORTANT] Have questions, issues or ideas? Join our Community!
    Reading
    ใƒป
    10 mins
  • Lecture Notes (Notes)
  • Lecture Notes W1
    Reading
    ใƒป
    1 min
  • Practice Quiz
  • Neural Machine Translation
    Code Example
    ใƒป
    30 mins
  • Neural Machine Translation
    Practice Quiz
    ใƒป
    30 mins
  • Assignment
  • (Optional) Downloading your Notebook, Downloading your Workspace and Refreshing your Workspace
    Reading
    ใƒป
    5 mins
  • NMT with Attention (Tensorflow)

    GradedใƒปCode Assignment

    ใƒป
    3 hours
  • Heroes of NLP: Oren Etzioni
  • Andrew Ng with Oren Etzioni
    Video
    ใƒป
    34 mins
  • Next
    Week 2: Text Summarization
  • Certificate
    Course Info