Sign In Start Free Trial
Account

Add to playlist

Create a Playlist

Modal Close icon
You need to login to use this feature.
  • Book Overview & Buying Apache Spark for Machine Learning
  • Table Of Contents Toc
Apache Spark for Machine Learning

Apache Spark for Machine Learning

By : Deepak Gowda
4.5 (2)
close
close
Apache Spark for Machine Learning

Apache Spark for Machine Learning

4.5 (2)
By: Deepak Gowda

Overview of this book

In the world of big data, efficiently processing and analyzing massive datasets for machine learning can be a daunting task. Written by Deepak Gowda, a data scientist with over a decade of experience and 30+ patents, this book provides a hands-on guide to mastering Spark’s capabilities for efficient data processing, model building, and optimization. With Deepak’s expertise across industries such as supply chain, cybersecurity, and data center infrastructure, he makes complex concepts easy to follow through detailed recipes. This book takes you through core machine learning concepts, highlighting the advantages of Spark for big data analytics. It covers practical data preprocessing techniques, including feature extraction and transformation, supervised learning methods with detailed chapters on regression and classification, and unsupervised learning through clustering and recommendation systems. You’ll also learn to identify frequent patterns in data and discover effective strategies to deploy and optimize your machine learning models. Each chapter features practical coding examples and real-world applications to equip you with the knowledge and skills needed to tackle complex machine learning tasks. By the end of this book, you’ll be ready to handle big data and create advanced machine learning models with Apache Spark.
Table of Contents (16 chapters)
close
close
Lock Free Chapter
1
Part 1: Introduction and Fundamentals
5
Part 2: Supervised Learning
8
Part 3: Unsupervised Learning
12
Part 4: Model Deployment

Aggregating data

Data aggregation, in the context of artificial intelligence and machine learning, refers to the process of transforming raw data into a summary or a simplified representation that is more suitable for analysis or model training.

Aggregation is a critical step in data preprocessing and analysis for several reasons:

  • Reduction of complexity: Aggregation helps to transform several rows of data into fewer rows of data by summarizing detailed data. For example, individual sales transactions could be aggregated to show total sales per day, month, or year. This reduction in complexity can make it easier for algorithms to identify patterns and trends.
  • Improving signal-to-noise ratio: By summarizing or averaging data, aggregation can enhance the underlying signal (relevant information) while reducing noise (irrelevant information). This can lead to better model performance, especially in noisy datasets.
  • Dimensionality reduction: Aggregation can reduce the...
CONTINUE READING
83
Tech Concepts
36
Programming languages
73
Tech Tools
Icon Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.
Icon Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.
Icon 50+ new titles added per month and exclusive early access to books as they are being written.
Apache Spark for Machine Learning
notes
bookmark Notes and Bookmarks search Search in title playlist Add to playlist download Download options font-size Font size

Change the font size

margin-width Margin width

Change margin width

day-mode Day/Sepia/Night Modes

Change background colour

Close icon Search
Country selected

Close icon Your notes and bookmarks

Confirmation

Modal Close icon
claim successful

Buy this book with your credits?

Modal Close icon
Are you sure you want to buy this book with one of your credits?
Close
YES, BUY

Submit Your Feedback

Modal Close icon
Modal Close icon
Modal Close icon