2ndQuadrant is now part of EDB

Bringing together some of the world's top PostgreSQL experts.

2ndQuadrant | PostgreSQL
Mission Critical Databases
  • Contact us
  • EN
    • FR
    • IT
    • ES
    • DE
    • PT
  • Support & Services
  • Products
  • Downloads
    • Installers
      • Postgres Installer
      • 2UDA – Unified Data Analytics
    • Whitepapers
      • Business Case for PostgreSQL Support
      • Security Best Practices for PostgreSQL
    • Case Studies
      • Performance Tuning
        • BenchPrep
        • tastyworks
      • Distributed Clusters
        • ClickUp
        • European Space Agency (ESA)
        • Telefónica del Sur
        • Animal Logic
      • Database Administration
        • Agilis Systems
      • Professional Training
        • Met Office
        • London & Partners
      • Database Upgrades
        • Alfred Wegener Institute (AWI)
      • Database Migration
        • International Game Technology (IGT)
        • Healthcare Software Solutions (HSS)
        • Navionics
  • Postgres Learning Center
    • Webinars
      • Upcoming Webinars
      • Webinar Library
    • Whitepapers
      • Business Case for PostgreSQL Support
      • Security Best Practices for PostgreSQL
    • Blog
    • Training
      • Course Catalogue
    • Case Studies
      • Performance Tuning
        • BenchPrep
        • tastyworks
      • Distributed Clusters
        • ClickUp
        • European Space Agency (ESA)
        • Telefónica del Sur
        • Animal Logic
      • Database Administration
        • Agilis Systems
      • Professional Training
        • Met Office
        • London & Partners
      • Database Upgrades
        • Alfred Wegener Institute (AWI)
      • Database Migration
        • International Game Technology (IGT)
        • Healthcare Software Solutions (HSS)
        • Navionics
    • Books
      • PostgreSQL 11 Administration Cookbook
      • PostgreSQL 10 Administration Cookbook
      • PostgreSQL High Availability Cookbook – 2nd Edition
      • PostgreSQL 9 Administration Cookbook – 3rd Edition
      • PostgreSQL Server Programming Cookbook – 2nd Edition
      • PostgreSQL 9 Cookbook – Chinese Edition
    • Videos
    • Events
    • PostgreSQL
      • PostgreSQL – History
      • Who uses PostgreSQL?
      • PostgreSQL FAQ
      • PostgreSQL vs MySQL
      • The Business Case for PostgreSQL
      • Security Information
      • Documentation
  • About Us
    • About 2ndQuadrant
    • 2ndQuadrant’s Passion for PostgreSQL
    • News
    • Careers
    • Team Profile
  • Blog
  • Menu Menu
You are here: Home1 / Blog2 / Pavan's PlanetPostgreSQL3 / How will Postgres-XL exploit the Parallel Query Capabilities of PostgreSQL...
Pavan Deolasee

How will Postgres-XL exploit the Parallel Query Capabilities of PostgreSQL 9.6?

October 6, 2016/0 Comments/in Pavan's PlanetPostgreSQL /by Pavan Deolasee

With PostgreSQL 9.6 now out, many of our users and customers are asking us about the plans for Postgres-XL 9.6. The new release of PostgreSQL implements some new features, especially around parallel query processing and many are interested to know when those capabilities will be available in Postgres-XL.

Postgres-XL itself is a massively parallel processing system. It has an efficient distributed planner and executor which can distribute work to tens of datanodes, process the result and send it back to the client. It allows the user to either shard or replicate a table for efficient query execution. On top of that, Postgres-XL also provides global consistency of the data, all the time, so that users don’t need to worry about consistency while designing their applications.

One major difference between PostgreSQL 9.6’s parallel query capability and Postgres-XL’s parallel query capability is that PostgreSQL’s parallel engine will try to utilise multiple cores or CPUs within a single physical or virtual machine. While that does not much help the workloads where a single, large server itself is just not enough or where the resources on a single server are fully utilised; the new parallel query capabilities will still help certain workloads, especially workloads that can be served by a single large server. Before, these workloads could not utilise the full power of a large server, but with PostgreSQL 9.6, they will be able to do so.

postgresql-9-6-parallel-query

So why would parallel query capabilities of PostgreSQL help Postgres-XL at all? A short and simple answer to the question is that if these capabilities exist, then each Postgres-XL datanode can parallelise part of the workload assigned to it. That can significantly improve query execution performance for workloads where datanode resources are not fully utilised. It will also allow users to provision larger servers for datanodes and get the full benefit of two levels of parallelism. So if you’re computing an aggregate for a multi-terabyte table, sharded on 64 nodes, Postgres-XL will first divide the work in 64 chunks and execute that in parallel. In turn, each datanode can further divide that work in 2 or 8 smaller chunks, resulting in extremely fast aggregations.

postgres-xl-9-6-mpp-1

Other than parallelism, PostgreSQL 9.6 also has some major improvements for handling large tables. For example, VACUUM can now skip already frozen pages, thus reducing the time and cost of vacuuming a large table, with mostly old data. The improvements in the areas around locking in multi-core CPU are not very interesting and useful for Postgres-XL. Finally, BDR will now work as an extension with PostgreSQL 9.6 and hence there is a possibility of Postgres-XL utilising those capabilities.

Now the question is: when do I get to see Postgres-XL 9.6? Well, at 2ndQuadrant we have already started preparing grounds for that and soon you’ll see some action, even in the Postgres-XL community. Make no mistake, it’s not an easy task and some of the planner changes in PostgreSQL 9.6 are going to make the merge even more daunting. But the journey has begun. During the process, we need to figure out ways to restructure the code so that future merges become easier and also find the parts that can be submitted and merged in the PostgreSQL core. The ultimate goal is to have all of XL’s capability in core, but we realise that this won’t happen anytime soon and there are many users who can’t wait that long. So Postgres-XL will see continuous development and support until PostgreSQL has all the capability that Postgres-XL has.

 

Share this entry
  • Share on Facebook
  • Share on Twitter
  • Share on WhatsApp
  • Share on LinkedIn
0 replies

Leave a Reply

Want to join the discussion?
Feel free to contribute!

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Search

Get in touch with us!

Recent Posts

  • Random Data December 3, 2020
  • Webinar: COMMIT Without Fear – The Beauty of CAMO [Follow Up] November 13, 2020
  • Full-text search since PostgreSQL 8.3 November 5, 2020
  • Random numbers November 3, 2020
  • Webinar: Best Practices for Bulk Data Loading in PostgreSQL [Follow Up] November 2, 2020

Featured External Blogs

Tomas Vondra's Blog

Our Bloggers

  • Simon Riggs
  • Alvaro Herrera
  • Andrew Dunstan
  • Craig Ringer
  • Francesco Canovai
  • Gabriele Bartolini
  • Giulio Calacoci
  • Ian Barwick
  • Marco Nenciarini
  • Mark Wong
  • Pavan Deolasee
  • Petr Jelinek
  • Shaun Thomas
  • Tomas Vondra
  • Umair Shahid

PostgreSQL Cloud

2QLovesPG 2UDA 9.6 backup Barman BDR Business Continuity community conference database DBA development devops disaster recovery greenplum Hot Standby JSON JSONB logical replication monitoring OmniDB open source Orange performance PG12 pgbarman pglogical PG Phriday postgres Postgres-BDR postgres-xl PostgreSQL PostgreSQL 9.6 PostgreSQL10 PostgreSQL11 PostgreSQL 11 PostgreSQL 11 New Features postgresql repmgr Recovery replication security sql wal webinar webinars

Support & Services

24/7 Production Support

Developer Support

Remote DBA for PostgreSQL

PostgreSQL Database Monitoring

PostgreSQL Health Check

PostgreSQL Performance Tuning

Database Security Audit

Upgrade PostgreSQL

PostgreSQL Migration Assessment

Migrate from Oracle to PostgreSQL

Products

HA Postgres Clusters

Postgres-BDR®

2ndQPostgres

pglogical

repmgr

Barman

Postgres Cloud Manager

SQL Firewall

Postgres-XL

OmniDB

Postgres Installer

2UDA

Postgres Learning Center

Introducing Postgres

Blog

Webinars

Books

Videos

Training

Case Studies

Events

About Us

About 2ndQuadrant

What does 2ndQuadrant Mean?

News

Careers 

Team Profile

© 2ndQuadrant Ltd. All rights reserved. | Privacy Policy
  • Twitter
  • LinkedIn
  • Facebook
  • Youtube
  • Mail
“mock”, Fedora 24, perl, and locales Can’t connect to OpenVPN on Linux, VERIFY_ERROR, TLS_ERROR?
Scroll to top
×