To get the best out of the cache tiering feature of Ceph, you should use faster disks such as SSDs and make a fast cache pool on top of slower/regular pools made up of HDDs. In Chapter 8, Production Planning and Performance Tuning for Ceph, we covered the process of creating Ceph pools on specific OSDs by modifying the CRUSH map. To set up the cache tier in your environment, you need to first modify your crush map and create a ruleset for the SSD disk. Since we have already covered this in Chapter 8, Production Planning and Performance Tuning for Ceph we will use the same ruleset for SSD, which is based on osd.0, osd.3, and osd.6. As this is a test setup, and we do not have real SSDs, we will assume the OSDs 0, 3, and 6 are SSDs and will create a cache pool on top of it, as illustrated in this diagram:
Let's check the CRUSH layout using the command, ceph osd crush rule ls, as shown in the following screenshot. We already have the ssd-pool CRUSH rule that...