Sign in to continue learning
Advanced Learning Algorithms
33 hours 27 mins
Hi and welcome back. By now, you've seen a lot of different learning algorithms, including linear regression, logistic regression, even deep learning or neural networks. And next week you'll see decision trees as well. So you now have a lot of powerful tools of machine learning, but how do you use these tools effectively? I've seen teams sometimes take six months to build a machine learning system that I think a more skilled team could have taken or done in just a couple of weeks. And the efficiency of how quickly you can get a machine learning system to work well will depend a large part on how well you can repeatedly make good decisions about what to do next in the course of a machine learning project. So in this week, I hope to share with you a number of tips on how to make decisions about what to do next in a machine learning project that I hope will end up saving you a lot of time. So let's take a look at some advice on how to build machine learning systems. Let's start with an example. Say you've implemented regularized linear regression to predict housing prices. So you have the usual cost function for your learning algorithm, squared error plus regularization term. But if you've trained the model and find that it makes unacceptably large errors in its predictions, what do you try next? When you're building a machine learning algorithm, there are usually a lot of different things you could try. For example, you could decide to get more training examples since it seems like having more data should help. Or maybe you think maybe you have too many features. You could try a smaller set of features. Or maybe you want to get additional features, such as find additional properties of the houses to toss into your data. And maybe that will help you to do better. Or you might take the existing features, x1, x2, and so on, and try adding polynomial features like x1 squared, x2 squared, x1, x2, and so on. Or you might wonder if the value of lambda is chosen well, and you might say, hmm, maybe it's too big. I want to decrease it. Or you may say, oh, maybe it's too small. I want to try increasing it. So on any given machine learning application, it will often turn out that some of these things could be fruitful, and some of these things not fruitful. And a key to being effective at how you build a machine learning algorithm will be if you can find a way to make good choices about where to invest your time. For example, I have seen teams spend literally many, many months collecting more training examples, thinking that more training data has got to help. But it turns out sometimes it helps a lot, and sometimes it doesn't. So in this week, you learn about how to carry out a set of diagnostics. And by diagnostic, I mean a test that you can run to gain insight into what is or isn't working with a learning algorithm, to gain guidance into improving its performance. And some of these diagnostics will tell you things like, is it worth weeks or even months collecting more training data? Because if it is, then you can then go ahead and make the investment to get more data, which will hopefully lead to improved performance. Or if it isn't, then running that diagnostic could have saved you months of time. And one thing you see this week as well is that diagnostics can take time to implement, but running them can be a very good use of your time. So this week, we'll spend a lot of time talking about different diagnostics you can use to give you guidance on how to improve your learning algorithm's performance. But first, let's take a look at how to evaluate the performance of your learning algorithm. Let's go do that in the next video.