In the code of the Scheduling with cron section, we used local targets, writing to the filesystem of our computer. In a real-world scenario, that will rarely suffice—you'll be probably writing either to a database or file stored in the cloud. In fact, we highly encourage you to write tasks to the cloud (for example, S3 buckets) from the get-go, if there is no reason not to. Luigi supports FTP, S3, Azure Blobs, Google Cloud, Spark, MongoDB, SQL databases, and many more. The only question is to create those resources and set up credentials to access them. The best part for many of them is that the interface is very similar, so it is easy to swap targets for existing tasks, by changing only a few lines of code.
Learn Python by Building Data Science Applications
By :
Learn Python by Building Data Science Applications
By:
Overview of this book
Python is the most widely used programming language for building data science applications. Complete with step-by-step instructions, this book contains easy-to-follow tutorials to help you learn Python and develop real-world data science projects. The “secret sauce” of the book is its curated list of topics and solutions, put together using a range of real-world projects, covering initial data collection, data analysis, and production.
This Python book starts by taking you through the basics of programming, right from variables and data types to classes and functions. You’ll learn how to write idiomatic code and test and debug it, and discover how you can create packages or use the range of built-in ones. You’ll also be introduced to the extensive ecosystem of Python data science packages, including NumPy, Pandas, scikit-learn, Altair, and Datashader. Furthermore, you’ll be able to perform data analysis, train models, and interpret and communicate the results. Finally, you’ll get to grips with structuring and scheduling scripts using Luigi and sharing your machine learning models with the world as a microservice.
By the end of the book, you’ll have learned not only how to implement Python in data science projects, but also how to maintain and design them to meet high programming standards.
Related Content you might be interested in
Current Title:
Learn Python by Building Data Science Applications
No titles found
Table of Contents (26 chapters)
Preface
Preparing the Workspace
First Steps in Coding - Variables and Data Types
Functions
Data Structures
Loops and Other Compound Statements
First Script – Geocoding with Web APIs
Scraping Data from the Web with Beautiful Soup 4
Simulation with Classes and Inheritance
Shell, Git, Conda, and More – at Your Command
Section 2: Hands-On with Data
Python for Data Applications
Data Cleaning and Manipulation
Data Exploration and Visualization
Training a Machine Learning Model
Improving Your Model – Pipelines and Experiments
Section 3: Moving to Production
Packaging and Testing with Poetry and PyTest
Data Pipelines with Luigi
Let's Build a Dashboard
Serving Models with a RESTful API
Serverless API Using Chalice
Best Practices and Python Performance
Assessments
Other Books You May Enjoy
Customer Reviews