Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Python Data Analysis
  • Table Of Contents Toc
Python Data Analysis

Python Data Analysis - Fourth Edition

By : Avinash Navlani, Cornellius Yudha Wijaya
close
close
Python Data Analysis

Python Data Analysis

By: Avinash Navlani, Cornellius Yudha Wijaya

Overview of this book

Modern data analysis goes beyond cleaning and visualizing data. Today's practitioners need to build scalable data pipelines, apply machine learning, work with text and image data, and understand emerging AI techniques such as Generative AI and Large Language Models (LLMs). This guide shows you how to tackle these challenges using Python's modern data ecosystem. Unlike books focused on a single library or technique, this book provides an end-to-end approach to Python data analysis. You'll learn how to move from data preparation and exploratory analysis to machine learning, NLP, image analytics, scalable processing, and AI-powered workflows. Starting with statistical foundations, you'll learn how to clean, transform, wrangle, and visualize data. You'll then explore time series analysis, signal processing, forecasting, and predictive analytics before applying machine learning techniques such as regression, classification, clustering, PCA, probabilistic methods, and Bayesian approaches. The book also covers graph analytics, sentiment analysis, NLP, image analytics, Generative AI, and LLMs. Finally, you'll learn to scale analytics workflows using Dask, Modin, Ray, and PySpark. By the end of the book, you'll be able to build end-to-end data analysis pipelines and apply modern data science and AI techniques to solve real-world challenges.
Table of Contents (25 chapters)
close
close
Lock Free Chapter
1
Part 1: Foundations for Data Analysis
6
Part 2: Exploratory Data Analysis and Data Cleaning
11
Part 3: Deep Dive into Machine Learning
16
Part 4: NLP, Image Analytics, and Parallel Computing
23
Other Books You May Enjoy
24
Index

Summary

This chapter introduces the core concepts and practical components of Apache Spark and PySpark for large-scale data processing and analytics. It begins with Spark architecture and the fundamentals of Resilient Distributed Datasets (RDDs), including their basic functions, transformations, and actions. The chapter then explains the MapReduce algorithm and demonstrates its working through the word count example. It also covers PySpark DataFrames, their data types, data reading methods, filtering operations, union operations, and techniques for handling missing values. In addition, the chapter discusses important DataFrame operations such as groupBy(), joins, withColumn(), and user-defined functions, along with shared variables like broadcast variables and accumulators. Finally, it introduces machine learning in Spark using PySpark MLlib and PySpark ML, providing readers with a foundation for scalable machine learning workflows.

This brings us to the end of this chapter and...

CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Python Data Analysis
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon