etl Archives - 2ndQuadrant

Posts

pglogical 1.2 with PostgreSQL 9.6 support

October 20, 2016/0 Comments/in Petr's PlanetPostgreSQL /by Petr Jelinek

PostgreSQL 9.6 is now out and so is an updated version of pglogical that works with it. For quick guide on how to upgrade the database with pglogical you can check my post which announced 9.6beta support. The main change besides the support for 9.6.x release of PostgreSQL is in the way we handle the […]

PostgreSQL 9.5: IMPORT FOREIGN SCHEMA

May 19, 2015/6 Comments/in Giulio's PlanetPostgreSQL /by Giulio Calacoci

The release of PostgreSQL 9.5 is imminent so the time has come to analyse what’s new in this latest version. A very interesting feature of version 9.5 is the ability to import a schema from a remote database, using Foreign Data Wrapper and the IMPORT FOREIGN SCHEMA command.

Performing ETL using Kettle with GPFDIST and GPLOAD

November 7, 2011/1 Comment/in Greenplum /by Giulio Calacoci

Scenario: We have a remote datasource, served by a gpfdist server. We need to import the data in a Greenplum database, while performing some ETL manipulation during the import. It is possible to accomplish this goal with a simple transformation in a few steps using Kettle.

ETL with Kettle and Greenplum – Part Two: importing data

October 24, 2011/0 Comments/in Greenplum /by Giulio Calacoci

In the first part of this article we have created a job, a database connection and defined the flow in Kettle. In the second part we’ll see how Kettle manages the data import from the CSV files.

ETL with Kettle and Greenplum – Part one: setting up your job.

October 10, 2011/0 Comments/in Greenplum /by Giulio Calacoci

Recently I have shown you how to perform a data import from a CSV file into a Greenplum database, using Talend Community Edition. In this article I’m going to perform the same task using another ETL tool, Kettle.

ETL with Talend and Greenplum – Part two: data import

September 19, 2011/0 Comments/in Greenplum /by Giulio Calacoci

In the first part of this tutorial, we have set up all the connections required for creating the job, now we can proceed with data import. Let’s drag and drop inside the visual editor an object named tMap. You can find it on the left, in the instruments palette, inside the “elaboration” folder.

ETL with Talend and Greenplum – Part one: connections

September 16, 2011/2 Comments/in Greenplum /by Giulio Calacoci

hen working with databases, one of the most common task is to load data from one or more CSV files. Several tools are available to achieve this task. Some are executed via command line, like COPY (using psql), some are more complex, like ETL systems. We will start today with Talend but, in the next weeks, […]

2ndQuadrant is now part of EDB

Posts

pglogical 1.2 with PostgreSQL 9.6 support

PostgreSQL 9.5: IMPORT FOREIGN SCHEMA

Performing ETL using Kettle with GPFDIST and GPLOAD

ETL with Kettle and Greenplum – Part Two: importing data

ETL with Kettle and Greenplum – Part one: setting up your job.

ETL with Talend and Greenplum – Part two: data import

ETL with Talend and Greenplum – Part one: connections

Support & Services

Products

Postgres Learning Center

About Us