Book Image

Building Data Science Solutions with Anaconda

By : Dan Meador
5 (1)
Book Image

Building Data Science Solutions with Anaconda

5 (1)
By: Dan Meador

Overview of this book

You might already know that there's a wealth of data science and machine learning resources available on the market, but what you might not know is how much is left out by most of these AI resources. This book not only covers everything you need to know about algorithm families but also ensures that you become an expert in everything, from the critical aspects of avoiding bias in data to model interpretability, which have now become must-have skills. In this book, you'll learn how using Anaconda as the easy button, can give you a complete view of the capabilities of tools such as conda, which includes how to specify new channels to pull in any package you want as well as discovering new open source tools at your disposal. You’ll also get a clear picture of how to evaluate which model to train and identify when they have become unusable due to drift. Finally, you’ll learn about the powerful yet simple techniques that you can use to explain how your model works. By the end of this book, you’ll feel confident using conda and Anaconda Navigator to manage dependencies and gain a thorough understanding of the end-to-end data science workflow.
Table of Contents (16 chapters)
1
Part 1: The Data Science Landscape – Open Source to the Rescue
6
Part 2: Data Is the New Oil, Models Are the New Refineries
11
Part 3: Practical Examples and Applications

Creating a scikit-learn pipeline

If there is one thing that you may have noticed by now in this book, it's that there are many common steps for every problem we have looked at. We're now going to ensure that we can more easily iterate on the data and model creation steps by leveraging the scikit-learn pipeline to put together an easy, repeatable process. In this section, we are going to take a previous workflow that would ordinarily need to be repeated many times and turn it into a single unit, which will allow you much greater flexibility and save time compared to the previous process. If you are starting with this chapter or jumping to it before going through the others, you need to know that the underlying concepts covered previously are still incredibly important to understand.

To visualize what the process is going to look like, you can refer to the following diagram. On the left, you will see normal data input being passed into the pipeline object. In that pipeline...