Book Image

Mastering Ceph - Second Edition

By : Nick Fisk
Book Image

Mastering Ceph - Second Edition

By: Nick Fisk

Overview of this book

Ceph is an open source distributed storage system that is scalable to Exabyte deployments. This second edition of Mastering Ceph takes you a step closer to becoming an expert on Ceph. You’ll get started by understanding the design goals and planning steps that should be undertaken to ensure successful deployments. In the next sections, you’ll be guided through setting up and deploying the Ceph cluster with the help of orchestration tools. This will allow you to witness Ceph’s scalability, erasure coding (data protective) mechanism, and automated data backup features on multiple servers. You’ll then discover more about the key areas of Ceph including BlueStore, erasure coding and cache tiering with the help of examples. Next, you’ll also learn some of the ways to export Ceph into non-native environments and understand some of the pitfalls that you may encounter. The book features a section on tuning that will take you through the process of optimizing both Ceph and its supporting infrastructure. You’ll also learn to develop applications, which use Librados and distributed computations with shared object classes. Toward the concluding chapters, you’ll learn to troubleshoot issues and handle various scenarios where Ceph is not likely to recover on its own. By the end of this book, you’ll be able to master storage management with Ceph and generate solutions for managing your infrastructure.

Related Content you might be interested in

Current Title:

Small book image
Mastering Ceph - Second Edition
Nick Fisk
Mar, 2019 | 356 pages
Small book image
Ceph Cookbook
Michael Hackett | Karan Singh | Vikhyat Umrao
Nov, 2017 | 466 pages
Small book image
Learning Ceph
Anthony DAtri | Vaibhav Bhembre | Karan Singh
Oct, 2017 | 340 pages
Small book image
Mastering Proxmox
Wasim Ahmed
Nov, 2017 | 494 pages
Table of Contents (18 chapters)
Preface
Preface
Who this book is for
What this book covers
To get the most out of this book
Get in touch
Free Chapter
1
Section 1: Planning And Deployment
Section 1: Planning And Deployment
2
Planning for Ceph
Planning for Ceph
What is Ceph?
How Ceph works
Ceph use cases
Infrastructure design
How to plan a successful Ceph implementation
Summary
Questions
3
Deploying Ceph with Containers
Deploying Ceph with Containers
Technical requirements
Preparing your environment with Vagrant and VirtualBox
Orchestration
Ansible
A very simple playbook
Adding the Ceph Ansible modules
Change and configuration management
Ceph in containers
Summary
Questions
4
BlueStore
BlueStore
What is BlueStore?
Why was it needed?
How BlueStore works
How to use BlueStore
Summary
Questions
5
Ceph and Non-Native Protocols
Ceph and Non-Native Protocols
Block
File
Examples
ESXi hypervisor
Clustering
Summary
Questions
6
Section 2: Operating and Tuning
Section 2: Operating and Tuning
7
RADOS Pools and Client Access
RADOS Pools and Client Access
Pools
Ceph storage types
Summary
Questions
8
Developing with Librados
Developing with Librados
What is librados?
How to use librados
Example librados application
Summary
Questions
9
Distributed Computation with Ceph RADOS Classes
Distributed Computation with Ceph RADOS Classes
Example applications and the benefits of using RADOS classes
Writing a simple RADOS class in Lua
Writing a RADOS class that simulates distributed computing
RADOS class caveats
Summary
Questions
10
Monitoring Ceph
Monitoring Ceph
Why it is important to monitor Ceph
What should be monitored
The Ceph dashboard
PG states – the good, the bad, and the ugly
Monitoring Ceph with collectd
Summary
Questions
11
Tuning Ceph
Tuning Ceph
Latency
Benchmarking
Recommended tunings
Summary
Questions
12
Tiering with Ceph
Tiering with Ceph
Tiering versus caching
What is a bloom filter?
Tiering modes
Uses cases
Creating tiers in Ceph
Tuning tiering
Promotion throttling
Summary
Questions
13
Section 3: Troubleshooting and Recovery
Section 3: Troubleshooting and Recovery
14
Troubleshooting
Troubleshooting
Repairing inconsistent objects
Full OSDs
Ceph logging
Slow performance
Extremely slow performance or no IO
Investigating PGs in a down state
Large monitor databases
Summary
Questions
15
Disaster Recovery
Disaster Recovery
What is a disaster?
Avoiding data loss
What can cause an outage or data loss?
RBD mirroring
RBD recovery
RGW Multisite
CephFS recovery
Lost objects and inactive PGs
Recovering from a complete monitor failure
Using the Ceph object-store tool
Investigating asserts
Summary
Questions
16
Assessments
Assessments
Chapter 1, Planning for Ceph
Chapter 2, Deploying Ceph with Containers
Chapter 3, BlueStore
Chapter 4, Ceph and Non-Native Protocols
Chapter 5, RADOS Pools and Client Access
Chapter 6, Developing with Librados
Chapter 7, Distributed Computation with Ceph RADOS Classes
Chapter 8, Monitoring Ceph
Chapter 9, Tuning Ceph
Chapter 10, Tiering with Ceph
Chapter 11, Troubleshooting
Chapter 12, Disaster Recovery
17
Other Books You May Enjoy
Other Books You May Enjoy
Leave a review - let other readers know what you think

BlueStore

In this chapter, you'll learn about BlueStore, the new object store in Ceph designed to replace the existing filestore. Its increased performance and enhanced feature set are designed to allow Ceph to continue to grow and provide a resilient high-performance distributed storage system for the future. Since the Luminous release, BlueStore is now the recommended and default object store that's used when creating new OSDs. This chapter will cover how BlueStore works and why it is much better suited than Filestore for Ceph's requirements. Then by following a step by step tutorial you will be guided through how to upgrade a Ceph cluster to BlueStore.

In this chapter, you'll learn the following topics:

  • What is BlueStore?
  • The limitations of filestore
  • What problems BlueStore overcome
  • The components of BlueStore and how it works
  • Introduction to ceph-volume...
Previous Section
End of Section 1
Next Section