9. Scaling Puppet Infrastructures | Extending Puppet

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents

Extending Puppet

By : Alessandro Franceschi

4.9 (16)

Extending Puppet

4.9 (16)

By: Alessandro Franceschi

Overview of this book

This book is a clear, detailed and practical guide to learn about designing and deploying you puppet architecture, with informative examples to highlight and explain concepts in a focused manner. This book is designed for users who already have good experience with Puppet, and will surprise experienced users with innovative topics that explore how to design, implement, adapt, and deploy a Puppet architecture. The key to extending Puppet is the development of types and providers, for which you must be familiar with Ruby.

Preface

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Free Chapter

1. Puppet Essentials

1. Puppet Essentials

The Puppet ecosystem

Puppet components

Installation and configuration

Puppet in action

Summary

2. Hiera

2. Hiera

Installing and configuring Hiera

Working with the command line on a YAML backend

Using Hiera in Puppet

Additional Hiera backends

Using Hiera as an ENC

Summary

3. PuppetDB

3. PuppetDB

Installation and configuration

Dashboards

The PuppetDB API

Querying PuppetDB for fun and profit

The puppetdbquery module

How Puppet code may change in the future

Summary

4. Designing Puppet Architectures

4. Designing Puppet Architectures

The components of Puppet architecture

The Foreman

Roles and profiles

The data and the code

Sample architectures

Summary

5. Using and Writing Reusable Modules

5. Using and Writing Reusable Modules

The evolution of modules' layouts

The parameters dilemma

Reusability patterns

Summary

6. Higher Abstraction Modules

6. Higher Abstraction Modules

Understanding the need for higher abstractions

The OpenStack example

An approach to reusable stack modules

Summary

7. Deploying and Migrating Puppet

7. Deploying and Migrating Puppet

Examining the potential scenarios and approaches

Patterns for extending Puppet coverage

Things change

Summary

8. Code Workflow Management

8. Code Workflow Management

Writing the Puppet code

Git workflows

Code review

Testing the Puppet code

Deploying the Puppet code

Propagating Puppet changes

Puppet Continuous Integration tools

Summary

9. Scaling Puppet Infrastructures

9. Scaling Puppet Infrastructures

Scaling Puppet

Scaling stored configs

Measuring performance

Summary

10. Writing Puppet Plugins

10. Writing Puppet Plugins

Anatomy of a Puppet run, under the hood

Custom report handlers

Custom faces

Summary

11. Beyond the System

11. Beyond the System

Puppet on a network equipment

Puppet for cloud and virtualization

Puppet on storage devices

Summary

12. Future Puppet

12. Future Puppet

Introducing the future parser

Other new features

Improved error system

Data in modules

Facter 2

Trapperkeeper

Summary

Index

Index

Scaling stored configs

We have seen that the usage of exported resources allows resources declared on a node to be applied on another node. In order to achieve this, Puppet needs the storeconfigs option enabled and this involves the usage of an external database where all the information about the exported resources is stored.

The usage of store configs has been historically a big performance killer for Puppet. The amount of database transactions involved for each run makes it quite a resource-intensive activity.

There are various options in puppet.conf that permit us to tune our configurations. The default settings are as follows:

storeconfigs = false
storeconfigs_backend = active_record
dbadapter = sqlite3
thin_storeconfigs = false

If we enable them with storeconfigs = true, the default configuration involves the usage of the active_record backend and a SQLite database.

This is a solution that performs quite badly and, therefore, should be used only in test or small environments. It has the...

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

Extending Puppet

Search

Your notes and bookmarks