Book Image

Ceph Cookbook

Book Image

Ceph Cookbook

Overview of this book

Ceph is a unified, distributed storage system designed for excellent performance, reliability, and scalability. This cutting-edge technology has been transforming the storage industry, and is evolving rapidly as a leader in software-defined storage space, extending full support to cloud platforms such as Openstack and Cloudstack, including virtualization platforms. It is the most popular storage backend for Openstack, public, and private clouds, so is the first choice for a storage solution. Ceph is backed by RedHat and is developed by a thriving open source community of individual developers as well as several companies across the globe. This book takes you from a basic knowledge of Ceph to an expert understanding of the most advanced features, walking you through building up a production-grade Ceph storage cluster and helping you develop all the skills you need to plan, deploy, and effectively manage your Ceph cluster. Beginning with the basics, you’ll create a Ceph cluster, followed by block, object, and file storage provisioning. Next, you’ll get a step-by-step tutorial on integrating it with OpenStack and building a Dropbox-like object storage solution. We’ll also take a look at federated architecture and CephFS, and you’ll dive into Calamari and VSM for monitoring the Ceph environment. You’ll develop expert knowledge on troubleshooting and benchmarking your Ceph storage cluster. Finally, you’ll get to grips with the best practices to operate Ceph in a production environment.

Related Content you might be interested in

Current Title:

Small book image
Ceph Cookbook
Feb, 2016 | 326 pages
No titles found
Table of Contents (18 chapters)
Ceph Cookbook
Ceph Cookbook
Credits
Credits
Foreword
Foreword
About the Author
About the Author
About the Reviewers
About the Reviewers
www.PacktPub.com
www.PacktPub.com
Preface
Preface
Free Chapter
1
Ceph – Introduction and Beyond
Ceph – Introduction and Beyond
Introduction
Ceph – the beginning of a new era
RAID – the end of an era
Ceph – the architectural overview
Planning the Ceph deployment
Setting up a virtual infrastructure
Installing and configuring Ceph
Scaling up your Ceph cluster
Using Ceph cluster with a hands-on approach
2
Working with Ceph Block Device
Working with Ceph Block Device
Introduction
Working with Ceph Block Device
Configuring Ceph client
Creating Ceph Block Device
Mapping Ceph Block Device
Ceph RBD resizing
Working with RBD snapshots
Working with RBD Clones
A quick look at OpenStack
Ceph – the best match for OpenStack
Setting up OpenStack
Configuring OpenStack as Ceph clients
Configuring Glance for Ceph backend
Configuring Cinder for Ceph backend
Configuring Nova to attach Ceph RBD
Configuring Nova to boot instances from Ceph RBD
3
Working with Ceph Object Storage
Working with Ceph Object Storage
Introduction
Understanding Ceph object storage
RADOS Gateway standard setup, installation, and configuration
Creating the radosgw user
Accessing Ceph object storage using S3 API
Accessing Ceph object storage using the Swift API
Integrating RADOS Gateway with OpenStack Keystone
Configuring Ceph federated gateways
Testing the radosgw federated configuration
Building file sync and share service using RGW
4
Working with the Ceph Filesystem
Working with the Ceph Filesystem
Introduction
Understanding Ceph Filesystem and MDS
Deploying Ceph MDS
Accessing CephFS via kernel driver
Accessing CephFS via FUSE client
Exporting Ceph Filesystem as NFS
ceph-dokan – CephFS for Windows clients
CephFS a drop-in replacement for HDFS
5
Monitoring Ceph Clusters using Calamari
Monitoring Ceph Clusters using Calamari
Introduction
Ceph cluster monitoring – the classic way
Monitoring Ceph clusters
Introducing Ceph Calamari
Building Calamari server packages
Building Calamari client packages
Setting up Calamari master server
Adding Ceph nodes to Calamari
Monitoring Ceph clusters from the Calamari dashboard
Troubleshooting Calamari
6
Operating and Managing a Ceph Cluster
Operating and Managing a Ceph Cluster
Introduction
Understanding Ceph service management
Managing the cluster configuration file
Running Ceph with SYSVINIT
Running Ceph as a service
Scale-up versus scale-out
Scaling out your Ceph cluster
Scaling down your Ceph cluster
Replacing a failed disk in the Ceph cluster
Upgrading your Ceph cluster
Maintaining a Ceph cluster
7
Ceph under the Hood
Ceph under the Hood
Introduction
Ceph scalability and high availability
Understanding the CRUSH mechanism
CRUSH map internals
Ceph cluster map
High availability monitors
Ceph authentication and authorization
Ceph dynamic cluster management
Ceph placement group
Placement group states
Creating Ceph pools on specific OSDs
8
Production Planning and Performance Tuning for Ceph
Production Planning and Performance Tuning for Ceph
Introduction
The dynamics of capacity, performance, and cost
Choosing the hardware and software components for Ceph
Ceph recommendation and performance tuning
Ceph erasure coding
Creating an erasure coded pool
Ceph cache tiering
Creating a pool for cache tiering
Creating a cache tier
Configuring a cache tier
Testing a cache tier
9
The Virtual Storage Manager for Ceph
The Virtual Storage Manager for Ceph
Introduction
Understanding the VSM architecture
Setting up the VSM environment
Getting ready for VSM
Installing VSM
Creating a Ceph cluster using VSM
Exploring the VSM dashboard
Upgrading the Ceph cluster using VSM
VSM roadmap
VSM resources
10
More on Ceph
More on Ceph
Introduction
Benchmarking the Ceph cluster
Disk performance baseline
Baseline network performance
Ceph RADOS bench
RADOS load-gen
Benchmarking the Ceph block device
Benchmarking Ceph RBD using FIO
Ceph admin socket
Using the ceph tell command
Ceph REST API
Profiling Ceph memory
Deploying Ceph using Ansible
The ceph-objectstore tool
Index
Index

Testing a cache tier

Since our cache tier is ready, during the write operation, clients will see what is being written to their regular pools, but actually, it's being written on cache-pools first and then based on the cache tier policy data, it will be flushed to the storage tier. This data migration is transparent to the client.

How to do it…

  1. In the previous recipe, we created a 500 MB test file named /tmp/file1; we will now put this file in an EC-pool:

    # rados -p EC-pool put object1 /tmp/file1

  2. Since an EC-pool is tiered with a cache-pool named file1 should not get written to the EC-pool in the first step, however, it will get written to the cache-pool. To verify this, list each pool to get the object names. Use the date command to track the time and changes:

    # rados -p EC-pool ls
# rados -p cache-pool ls
# date

  3. After 300 seconds (as we have configured cache_min_evict_age to 300 seconds), the cache-tiering agent will migrate object1 from the cache-pool to the EC-pool, and object1 will be...

Previous Section
End of Chapter 8
Next Chapter