To get the best out of the cache tiering feature of Ceph, you should use faster disks such as SSDs and make a fast cache pool on top of slower/regular pools made up of HDDs. In Chapter 9, Ceph Under the Hood, we covered the process of creating Ceph pools on specific OSDs by modifying the CRUSH map. To set up the cache tier in your environment, you need to first modify your crush map and create a ruleset for the SSD disk. Since we have already covered this in Chapter 9, Ceph Under the Hood, Creating Ceph Pools on Specific OSDs recipe we will use the same ruleset for SSD, which is based on osd.0, osd.3, and osd.6. As this is a test setup, and we do not have real SSDs, we will assume that OSDs zero, three, and six are SSDs and will create a cache pool on top of them, as illustrated in this diagram:
Let's check the CRUSH layout using the command...