Advanced pgBackRest

pgBackRest implements many advanced features but most of them are disabled by default to maintain backward compatibility, conserve system resources, or to provide a fail-safe default. In this talk we will explore advanced options such as multi-processing, asynchronous archiving, alternate compression types, file bundling, block incremental backup, and delta restore. We will examine the benefits of each feature, when you should enable them, and how they work together to enhance the performance and efficiency of pgBackRest.

Bio:

David Steele is Principal Architect at Crunchy Data, the Trusted Open Source Enterprise PostgreSQL Leader. He has been actively developing with PostgreSQL since 1999.

David loves taking on big data challenges. Before Crunchy Data he was Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. Before that, he helped drive global mobile text messaging at Sybase365.

David's current project is pgBackRest, which will be the subject of this talk.

Backup Best Practices with pgBackRest (PGConf.Online 2021)

Backups are a critical part of any enterprise database solution but they are often done poorly or skipped altogether, which can lead to data loss in the event of hardware failure or some other disaster.

In this talk we'll cover database backup best practices and how to implement them with pgBackRest, including:

• WAL archiving and retention
• Backup frequency and retention
• How to meet recovery time/point objectives
• Configuration options
• Performance considerations

Bio:

David Steele is Principal Architect at Crunchy Data, the Trusted Open Source Enterprise PostgreSQL Leader. He has been actively developing with PostgreSQL since 1999.

David loves taking on big data challenges. Before Crunchy Data he was Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. Before that, he helped drive global mobile text messaging at Sybase365.

David's current project is pgBackRest, which will be the subject of this talk.

Backup Best Practices with pgBackRest (PostgresConf.Asia & PostgresConf.CN 2020)

Backups are a critical part of any enterprise database solution but they are often done poorly or skipped altogether, which can lead to data loss in the event of hardware failure or some other disaster.

In this talk we'll cover database backup best practices and how to implement them with pgBackRest, including:

• WAL archiving and retention
• Backup frequency and retention
• How to meet recovery time/point objectives
• Configuration options
• Performance considerations

Bio:

David Steele is Principal Architect at Crunchy Data, the Trusted Open Source Enterprise PostgreSQL Leader. He has been actively developing with PostgreSQL since 1999.

David loves taking on big data challenges. Before Crunchy Data he was Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. Before that, he helped drive global mobile text messaging at Sybase365.

David's current project is pgBackRest, which will be the subject of this talk.

High Performance pgBackRest (Charm City PostgreSQL Meetup 2020)

pgBackRest is open source software developed to perform efficient backup on PostgreSQL databases that measure in tens or hundreds of terabytes and/or generate high WAL volume. pgBackRest supports a robust set of performance features, including: parallel backup/restore, delta restore, parallel asynchronous archiving, partial/failed backup resume, backup from standby, and more.

This talk by the primary maintainer will focus on:

• Performance features of pgBackRest.
• Practical configuration examples.
• Parallel backup/restore and archiving implementations.

The attendee should gain a good understanding of which performance features are useful in a variety of circumstances.

Bio:

David Steele is Principal Architect at Crunchy Data, the Trusted Open Source Enterprise PostgreSQL Leader. He has been actively developing with PostgreSQL since 1999.

David loves taking on big data challenges. Until recently he was Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. Before that, he helped drive global mobile text messaging at Sybase365.

David's current project is pgBackRest, which will be the subject of this talk.

Evolving towards PostgreSQL (PostgresOpen 2019)

pgBackRest is one of many tools in the PostgreSQL ecosystem. These mutualistic projects provide numerous benefits but integrating with PostgreSQL and interfacing with the community can be challenging.

In this talk we'll discuss what is involved in maintaining a project in cooperation with PostgreSQL, what that means for each, and how we can make both better in the process.

Bio:

David Steele is Principal Architect at Crunchy Data, the Trusted Open Source Enterprise PostgreSQL Leader. He has been actively developing with PostgreSQL since 1999.

David loves taking on big data challenges. Before taking a position with Crunchy Data he was Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. Before that, he helped drive global mobile text messaging at Sybase365.

David's current project is pgBackRest, which provides the inspiration for this talk.

High Performance pgBackRest (Montreal PostgreSQL Meetup 2019)

pgBackRest is open source software developed to perform efficient backup on PostgreSQL databases that measure in tens or hundreds of terabytes and/or generate high WAL volume. pgBackRest supports a robust set of performance features, including: parallel backup/restore, delta restore, parallel asynchronous archiving, partial/failed backup resume, backup from standby, and more.

This talk by the primary maintainer will focus on:

• Performance features of pgBackRest.
• Practical configuration examples.
• Parallel backup/restore and archiving implementations.

The attendee should gain a good understanding of which performance features are useful in a variety of circumstances.

Bio:

David Steele is Principal Architect at Crunchy Data, the Trusted Open Source Enterprise PostgreSQL Leader. He has been actively developing with PostgreSQL since 1999.

David loves taking on big data challenges. Until recently he was Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. Before that, he helped drive global mobile text messaging at Sybase365.

David's current project is pgBackRest, which will be the subject of this talk.

High Performance pgBackRest (PGCon 2019)

pgBackRest is open source software developed to perform efficient backup on PostgreSQL databases that measure in tens or hundreds of terabytes and/or generate high WAL volume. pgBackRest supports a robust set of performance features, including: parallel backup/restore, delta restore, parallel asynchronous archiving, partial/failed backup resume, backup from standby, and more.

This talk by the primary maintainer will focus on:

• Performance features of pgBackRest.
• Practical configuration examples.
• Parallel backup/restore and archiving implementations.

The attendee should gain a good understanding of which performance features are useful in a variety of circumstances.

Bio:

David Steele is Principal Architect at Crunchy Data, the Trusted Open Source Enterprise PostgreSQL Leader. He has been actively developing with PostgreSQL since 1999.

David loves taking on big data challenges. Until recently he was Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. Before that, he helped drive global mobile text messaging at Sybase365.

David's current project is pgBackRest, which will be the subject of this talk.

High Performance pgBackRest (PGConf.EU 2018)

pgBackRest is open source software developed to perform efficient backup on PostgreSQL databases that measure in tens of terabytes and greater. pgBackRest supports a robust set of features for managing your backup and recovery infrastructure, including: parallel backup/restore, full/differential/incremental backups, delta restore, parallel asynchronous archiving, per-file checksums, page checksums (when enabled) validated during backup, compression, encryption, partial/failed backup resume, backup from standby, tablespace and link support, S3 support, backup expiration, local/remote operation via SSH, flexible configuration, and more.

This talk will focus on the performance features of pgBackRest with configuration examples and a discussion of the parallel backup/restore and archiving implementations.

Bio:

David Steele is Principal Architect at Crunchy Data, the Trusted Open Source Enterprise PostgreSQL Leader. He has been actively developing with PostgreSQL since 1999.

David loves taking on big data challenges. Until recently he was Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. Before that, he helped drive global mobile text messaging at Sybase365.

David's current project is pgBackRest, which will be the subject of this talk.

Reviewing PostgreSQL Patches for Fun and Profit (PGCon 2018)

The PostgreSQL community actively encourages patch contribution, but one area where we frequently fall short is finding enough patch reviewers. Patch review is extremely important and also a great way to become familiar with the community and the code base. This talk will walk through how to review a patch even if you are not comfortable coding in C or have never even looked at the PostgreSQL source.

Bio:

David Steele is Principal Architect at Crunchy Data Solutions, the PostgreSQL company for secure enterprises. He has been actively developing with PostgreSQL since 1999.

David loves taking on big data challenges. Previously he was Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. Before that, he helped drive global mobile text messaging at Sybase365.

Efficiently Backing up Terabytes of Data with pgBackRest (PGCon 2017)

Abstract:

pgBackRest is open source software developed to perform efficient backup on PostgreSQL databases that measure in tens of terabytes and greater. It supports per file checksums, compression, partial/failed backup resume, high-performance parallel transfer, asynchronous archiving, tablespaces, expiration, full/differential/incremental, local/remote operation via SSH, hard-linking, restore, and more. pgBackRest is written in Perl and does not depend on rsync or tar but instead performs its own deltas which gives it maximum flexibility. This talk by the author will introduce the features, give sample configurations, and discuss design philosophy.

Bio:

David Steele is Principal Architect at Crunchy Data Solutions, the PostgreSQL company for secure enterprises. He has been actively developing with PostgreSQL since 1999.

David loves taking on big data challenges. Until recently he was Data Architect at Resonate, an online media company using PostgreSQL to drive its transactional and data warehousing databases. Before that, he helped drive global mobile text messaging at Sybase365.

David's current project is pgBackRest, which will be the subject of this talk.