2. Server Architecture | PostgreSQL for Data Architects

Sign In Start Free Trial

Book Overview & Buying
Table Of Contents

PostgreSQL for Data Architects

By : Jayadevan M

5 (2)

PostgreSQL for Data Architects

5 (2)

By: Jayadevan M

Overview of this book

This book is for developers and data architects who have some exposure to databases. It is assumed that you understand the basic concepts of tables and common database objects, including privileges and security.

Preface

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Free Chapter

1. Installing PostgreSQL

1. Installing PostgreSQL

Installation options

Dependencies to compile the source

Configuring and creating the makefile

Building and creating the executables

Installing and moving the files to where they belong

Initializing a cluster

Working with extensions

Summary

2. Server Architecture

2. Server Architecture

Starting with the daemon process

Understanding the shared buffer

Checkpoint

WAL and the WAL writer process

The background writer

The autovacuum launcher process

The logging process

The stats collector process

The WAL sender and WAL receiver

Sorting in memory with work_mem

Maintenance with maintenance_work_mem

Summary

3. PostgreSQL – Object Hierarchy and Roles

3. PostgreSQL – Object Hierarchy and Roles

The PostgreSQL cluster

Understanding tablespaces

Databases, schemas, and search_path

Roles and privileges

Summary

4. Working with Transactions

4. Working with Transactions

Understanding transactions

PostgreSQL and MVCC

Summary

5. Data Modeling with SQL Power Architect

5. Data Modeling with SQL Power Architect

Tools for databases and their uses

Database design tools

Generating SQL

Summary

6. Client Tools

6. Client Tools

GUI tools and command-line tools

pgAdmin – downloading and installation

psql – working from the command line

Summary

7. SQL Tuning

7. SQL Tuning

Understanding basic facts about databases

Query execution components

Finding the execution plan

Optimization guidelines and catches

Summary

8. Server Tuning

8. Server Tuning

Server-wide memory settings

Managing writes, connections, and maintenance

Seek/scan cost and statistics parameters

Materialized views

Partitioned tables

Summary

9. Tools to Move Data in and out of PostgreSQL

9. Tools to Move Data in and out of PostgreSQL

Setting up the production database – considerations

COPY

Fast loading with pg_bulkload

pg_dump

Filtering options

Summary

10. Scaling, Replication, and Backup and Recovery

10. Scaling, Replication, and Backup and Recovery

Scalability

Point-in-time recovery

Summary

11. PostgreSQL – Troubleshooting

11. PostgreSQL – Troubleshooting

Connection issues

Authentication and permission issues

Parameter changes not effective

Query not responding

Summary

12. PostgreSQL – Extras

12. PostgreSQL – Extras

Interesting data types

Features over time

Summary

Index

Index

The background writer

The background writer is responsible for writing to disk specific dirty buffers based on an algorithm, whereas checkpointer writes all dirty buffers. The process takes into consideration shared memory usage data as well as information about which blocks have been used/accessed recently (least recently used). The primary objective of this process is to ensure that free buffers are available for use. The relevant parameters are as follows:

#bgwriter_delay = 200ms                 # 10-10000ms between rounds
#bgwriter_lru_maxpages = 100            # 0-1000 max buffers written/round
#bgwriter_lru_multiplier = 2.0          # 0-10.0 multiplier on buffers scanned/round

As we can see, the default value for delay is 200 milliseconds. This parameter specifies how long the process should wait between successive executions. The bgwriter_lru_maxpages parameter specifies the maximum number of buffers that will be written by the process in each iteration. The third parameter is also...

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

PostgreSQL for Data Architects

Search

Your notes and bookmarks