In this chapter, we will show you how to learn interesting structures from graphs in Spark. In principle, one learns and finds relationships from data by first selecting the problem of interest. The most common learning problems are regression, classification, ranking, and clustering. In this book, we will focus on clustering. In particular, we will focus on graph data, and apply clustering to detect communities within the graphs. Here is our roadmap for this chapter. First, we will introduce the concepts of spectral clustering. Then, we will study a specific method, which allows us to cluster graphs in Spark. Finally, we will apply these techniques to music and song playlist datasets. This application will also serve as an opportunity to review the tools and techniques that we covered in the previous chapters. We will bring them together in this chapter.
Apache Spark Graph Processing
Apache Spark Graph Processing
Overview of this book
Table of Contents (16 chapters)
Apache Spark Graph Processing
Credits
Foreword
About the Author
About the Reviewer
www.PacktPub.com
Preface
Free Chapter
Getting Started with Spark and GraphX
Building and Exploring Graphs
Graph Analysis and Visualization
Transforming and Shaping Up Graphs to Your Needs
Creating Custom Graph Aggregation Operators
Iterative Graph-Parallel Processing with Pregel
Learning Graph Structures
References
Index
Customer Reviews