Figuring out that a system isn’t working
Figuring out whether a system isn’t working as well as it should be is important, both during initial development as well as during ongoing deployment. We’ll start by looking at poor performance during initial development.
Initial development
The primary techniques we will use to determine that our system isn’t working as well as we'd like are the evaluation techniques we learned about in Chapter 13. We will apply those in this chapter. We will also use confusion matrices to detect specific classes that don’t work as well as the other classes.
It is always a good idea to look at the dataset at the outset and check the balance of categories because unbalanced data is a common source of problems. Unbalanced data does not necessarily mean that there will be accuracy problems, but it’s valuable to understand our class balance at the beginning. That way, we will be prepared to address accuracy...