Quick Guide & Tips

💻   Accessing Utils File and Helper Functions

In each notebook on the top menu:

1:   Click on "File"

2:   Then, click on "Open"

You will be able to see all the notebook files for the lesson, including any helper functions used in the notebook on the left sidebar. See the following image for the steps above.


💻   Downloading Notebooks

In each notebook on the top menu:

1:   Click on "File"

2:   Then, click on "Download as"

3:   Then, click on "Notebook (.ipynb)"


💻   Uploading Your Files

After following the steps shown in the previous section ("File" => "Open"), then click on "Upload" button to upload your files.


📗   See Your Progress

Once you enroll in this course—or any other short course on the DeepLearning.AI platform—and open it, you can click on 'My Learning' at the top right corner of the desktop view. There, you will be able to see all the short courses you have enrolled in and your progress in each one.

Additionally, your progress in each short course is displayed at the bottom-left corner of the learning page for each course (desktop view).


📱   Features to Use

🎞   Adjust Video Speed: Click on the gear icon (⚙) on the video and then from the Speed option, choose your desired video speed.

🗣   Captions (English and Spanish): Click on the gear icon (⚙) on the video and then from the Captions option, choose to see the captions either in English or Spanish.

🔅   Video Quality: If you do not have access to high-speed internet, click on the gear icon (⚙) on the video and then from Quality, choose the quality that works the best for your Internet speed.

🖥   Picture in Picture (PiP): This feature allows you to continue watching the video when you switch to another browser tab or window. Click on the small rectangle shape on the video to go to PiP mode.

√   Hide and Unhide Lesson Navigation Menu: If you do not have a large screen, you may click on the small hamburger icon beside the title of the course to hide the left-side navigation menu. You can then unhide it by clicking on the same icon again.


🧑   Efficient Learning Tips

The following tips can help you have an efficient learning experience with this short course and other courses.

🧑   Create a Dedicated Study Space: Establish a quiet, organized workspace free from distractions. A dedicated learning environment can significantly improve concentration and overall learning efficiency.

📅   Develop a Consistent Learning Schedule: Consistency is key to learning. Set out specific times in your day for study and make it a routine. Consistent study times help build a habit and improve information retention.

Tip: Set a recurring event and reminder in your calendar, with clear action items, to get regular notifications about your study plans and goals.

☕   Take Regular Breaks: Include short breaks in your study sessions. The Pomodoro Technique, which involves studying for 25 minutes followed by a 5-minute break, can be particularly effective.

💬   Engage with the Community: Participate in forums, discussions, and group activities. Engaging with peers can provide additional insights, create a sense of community, and make learning more enjoyable.

✍   Practice Active Learning: Don't just read or run notebooks or watch the material. Engage actively by taking notes, summarizing what you learn, teaching the concept to someone else, or applying the knowledge in your practical projects.


📚   Enroll in Other Short Courses

Keep learning by enrolling in other short courses. We add new short courses regularly. Visit DeepLearning.AI Short Courses page to see our latest courses and begin learning new topics. 👇

👉👉 🔗 DeepLearning.AI – All Short Courses [+]


🙂   Let Us Know What You Think

Your feedback helps us know what you liked and didn't like about the course. We read all your feedback and use them to improve this course and future courses. Please submit your feedback by clicking on "Course Feedback" option at the bottom of the lessons list menu (desktop view).

Also, you are more than welcome to join our community 👉👉 🔗 DeepLearning.AI Forum


Sign in

Or, sign in with your email
Email
Password
Forgot password?
Don't have an account? Create account
By signing up, you agree to our Terms Of Use and Privacy Policy

Create Your Account

Or, sign up with your email
Email Address

Already have an account? Sign in here!

By signing up, you agree to our Terms Of Use and Privacy Policy

Choose Your Plan

MonthlyYearly

Change Your Plan

Your subscription plan will change at the end of your current billing period. You’ll continue to have access to your current plan until then.

Learn More

Welcome back!

Hi ,

We'd like to know you better so we can create more relevant courses. What do you do for work?

Course Syllabus

DeepLearning.AI
  • Explore Courses
  • Membership
  • Community
    • Forum
    • Events
    • Ambassadors
    • Ambassador Spotlight
  • My Learning
Welcome to PyTorch: Techniques and Ecosystem Tools, the second course in the PyTorch Professional Certificate. I'm joined once again by Laurence Moroney. In this course, you focus on optimizing model performance and building more advanced architectures. So you see how to take basic building blocks and quickly combine them into much more complex, much more advanced neural network architectures. In the first part of the course, we're actually going to tackle one of the biggest challenges in model optimization with hyperparameter tuning. There's so many ways that you can do it, including writing your own code for rough searches or using tools like Optuna from the Python ecosystem. Once I've designed an architecture that works, it's rarely optimal. There's all these choices that I have to make. Do I build deeper? Do I build wider? What kind of optimizer will I use? We'll actually start with giving you the tools for hyperparameter searching and neural architecture search. And then we'll teach you how to build these models from scratch, computer vision models and natural language models, before overlaying these with transfer learning from existing models and then doing fine tuning on them. You will learn a lot of those key building blocks, things like tokenization, pre-training, fine tuning that have been key to really everything happening in AI around us and that maybe even more importantly, will give you key skills to be able to navigate all of these very large and important portfolios of technologies. And then to bring it full circle, we'll go back to optimization to take a look at, are we efficiently loading data from the drive to the CPU, to the GPU? Are we having things hanging around waiting when they could be working? And like to just look at the various tools and techniques that we have to be able to squeeze the most optimization that we have out of that, because the faster we can train accurately, the quicker we can actually iterate on this. I think you'll enjoy this course, where you go from the basics to understanding a lot more sophisticated concepts in how to build deep learning models. Let's go on to the next video, where we'll start with hyperparameter search.
specialization detail
  • PyTorch for Deep Learning
  • PyTorch: Techniques and Ecosystem Tools
  • Module 1
Next Lesson
Module 1: Hyperparameter Optimization
    Hyperparameter Optimization
  • A Conversation between Laurence Moroney and Andrew Ng
    Video
    ・
    1 min
  • Welcome to Course 2
    Video
    ・
    3 mins
  • Evaluation Metrics
    Video
    ・
    5 mins
  • Introduction to Optimization
    Video
    ・
    4 mins
  • Hyperparameter tuning: Learning Rate and Metrics
    Code Example
    ・
    1 hour
  • Learning Rate Schedulers
    Video
    ・
    5 mins
  • Schedulers in PyTorch
    Code Example
    ・
    1 hour
  • Tuning Hyperparameters
    Video
    ・
    7 mins
  • Quiz 1
    Practice Quiz
    ・
    10 mins
  • Flexible Architecture Design
    Video
    ・
    7 mins
  • Hyperparameter Optimization with Optuna
    Video
    ・
    10 mins
  • Hyperparameter Optimization with Optuna
    Code Example
    ・
    1 hour
  • Optimizing Model Efficiency
    Video
    ・
    10 mins
  • Efficiency vs Performance Metrics
    Code Example
    ・
    1 hour
  • Join the DeepLearning.AI Forum to ask questions, get support, or share amazing ideas!
    Reading
    ・
    2 mins
  • Graded Quiz
  • Quiz 2

    Graded・Quiz

    ・
    20 mins
  • Programming Assignment
  • Refreshing your Workspace
    Reading
    ・
    2 mins
  • FakeFinder : Building an AI to Detect AI-Generated Images

    Graded・Code Assignment

    ・
    3 hours
  • Resources
  • Module 1 Resources
    Reading
    ・
    10 mins
  • Next
    Module 2: Working with Images using TorchVision
  • Quick Guide & Tips