DLAI Logo
AI is the new electricity and will transform and improve nearly all areas of human lives.

Welcome back!

We'd like to know you better so we can create more relevant courses. What do you do for work?

DLAI Logo
  • Explore Courses
  • Community
    • Forum
    • Events
    • Ambassadors
    • Ambassador Spotlight
  • My Learnings
  • daily streak fire

    You've achieved today's streak!

    Complete one lesson every day to keep the streak going.

    Su

    Mo

    Tu

    We

    Th

    Fr

    Sa

    free pass got

    You earned a Free Pass!

    Free Passes help protect your daily streak. Complete more lessons to earn up to 3 Free Passes.

    Free PassFree PassFree Pass
Congratulations on making it to the end of this short course. You learned about some common data types of representation in machine learning, such as integer and floating point, and how to load AI models using different data types. You also learned about the underlying concepts behind model quantization and how linear quantization works. You used the Quanto library to quantize any PyTorch model in 8-bit precision. Then, you learned about some applications of quantization on LLMs, such as the recent state-of-the-art methods for quantizing LLMs. With this knowledge in hand, you will be able to better understand the challenges of a model compression and select the best quantization techniques for your use case.💡 If you find this course helpful, maybe you can even share it with your friends 🤗.
course detail
Next Lesson
Quantization Fundamentals with Hugging Face
  • Introduction
    Video
    ・
    3 mins
  • Handling Big Models
    Video
    ・
    5 mins
  • Data Types and Sizes
    Video with Code Example
    ・
    17 mins
  • Loading Models by data type
    Video with Code Example
    ・
    15 mins
  • Quantization Theory
    Video with Code Example
    ・
    15 mins
  • Quantization of LLMs
    Video
    ・
    6 mins
  • Conclusion
    Video
    ・
    1 min
  • Course Feedback
  • Community
  • 0%