Sign In Start Free Trial

Book Overview & Buying
Table Of Contents

PostgreSQL for Data Architects

By : Jayadevan M

5 (2)

PostgreSQL for Data Architects

5 (2)

By: Jayadevan M

Overview of this book

This book is for developers and data architects who have some exposure to databases. It is assumed that you understand the basic concepts of tables and common database objects, including privileges and security.

Preface

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Free Chapter

1. Installing PostgreSQL

1. Installing PostgreSQL

Installation options

Dependencies to compile the source

Configuring and creating the makefile

Building and creating the executables

Installing and moving the files to where they belong

Initializing a cluster

Working with extensions

Summary

2. Server Architecture

2. Server Architecture

Starting with the daemon process

Understanding the shared buffer

Checkpoint

WAL and the WAL writer process

The background writer

The autovacuum launcher process

The logging process

The stats collector process

The WAL sender and WAL receiver

Sorting in memory with work_mem

Maintenance with maintenance_work_mem

Summary

3. PostgreSQL – Object Hierarchy and Roles

3. PostgreSQL – Object Hierarchy and Roles

The PostgreSQL cluster

Understanding tablespaces

Databases, schemas, and search_path

Roles and privileges

Summary

4. Working with Transactions

4. Working with Transactions

Understanding transactions

PostgreSQL and MVCC

Summary

5. Data Modeling with SQL Power Architect

5. Data Modeling with SQL Power Architect

Tools for databases and their uses

Database design tools

Generating SQL

Summary

6. Client Tools

6. Client Tools

GUI tools and command-line tools

pgAdmin – downloading and installation

psql – working from the command line

Summary

7. SQL Tuning

7. SQL Tuning

Understanding basic facts about databases

Query execution components

Finding the execution plan

Optimization guidelines and catches

Summary

8. Server Tuning

8. Server Tuning

Server-wide memory settings

Managing writes, connections, and maintenance

Seek/scan cost and statistics parameters

Materialized views

Partitioned tables

Summary

9. Tools to Move Data in and out of PostgreSQL

9. Tools to Move Data in and out of PostgreSQL

Setting up the production database – considerations

COPY

Fast loading with pg_bulkload

pg_dump

Filtering options

Summary

10. Scaling, Replication, and Backup and Recovery

10. Scaling, Replication, and Backup and Recovery

Scalability

Point-in-time recovery

Summary

11. PostgreSQL – Troubleshooting

11. PostgreSQL – Troubleshooting

Connection issues

Authentication and permission issues

Parameter changes not effective

Query not responding

Summary

12. PostgreSQL – Extras

12. PostgreSQL – Extras

Interesting data types

Features over time

Summary

Index

Index

WAL and the WAL writer process

When we make changes to the data, the changes are not written to the data files immediately, as mentioned before (probably many times). Changes are made to the blocks in the buffer and records of these changes are written to the WAL buffer (as soon as changes to data are made). The changes are flushed to the WAL segments when the changes are committed.

In the pg_xlog directory, the WAL segments are each 16 MB in size:

[postgres@MyCentOS pg_xlog]$ pwd
/pgdata/9.3/pg_xlog
[postgres@MyCentOS pg_xlog]$ ls -alrt
total 16396
drwx------.  2 postgres postgres     4096 Oct 13 13:23 archive_status
drwx------.  3 postgres postgres     4096 Oct 13 13:23 .
drwx------. 15 postgres postgres     4096 Nov 15 20:17 ..
-rw-------.  1 postgres postgres 16777216 Nov 15 20:17 000000010000000000000001

We can find out the segment PostgreSQL is writing to now using the pg_current_xlog_location function:

[postgres@MyCentOS pg_xlog]$ psql
psql (9.3.0)
Type "help" for help.

postgres...

CONTINUE READING

83

Tech Concepts

36

Programming languages

73

Tech Tools

Unlimited access to the largest independent learning library in tech of over 8,000 expert-authored tech books and videos.

Innovative learning tools, including AI book assistants, code context explainers, and text-to-speech.

50+ new titles added per month and exclusive early access to books as they are being written.

PostgreSQL for Data Architects

Search

Your notes and bookmarks