Data warehouse creation PostgreSQL

[fn_guennoun]

Hello,

I'm using Talend Data Integration as an ETL for my business intelligence project.

I have a clear vision of what the final schema of the data warehouse would be (I defined the dimensions and the fact tables).

Is it possible to use Talend to create the fact tables, the dimensions and the relationship between these ? If that's possible, how do I do that?

PS : the data warehouse should be implemented in PostgreSQL.

[Anonymous]

Hi,

As a coincidence, I'm also creating a dimensional data warehouse at the moment in Postgres and I'm also relatively new to Talend. I'm not sure if I understand the question correctly, but you can definitely as part of a job have Talend create tables in the tPostgresQLOutput component if they don't exist yet and indicate primary keys. I personally prefer to have the modeling tool create the DDL in advance and have Talend just populate the tables. In terms of populating the tables, especially when you're working with large dimensions (>150K records) and slowly changing dimensions, you want to make sure you use the ELT components for SCD and not the standard ones as they don't scale out well.

Roland

[Anonymous]

Hi,

As a coincidence, I'm also creating a dimensional data warehouse at the moment in Postgres and I'm also relatively new to Talend. I'm not sure if I understand the question correctly, but you can definitely as part of a job have Talend create tables in the tPostgresQLOutput component if they don't exist yet and indicate primary keys. I personally prefer to have the modeling tool create the DDL in advance and have Talend just populate the tables. In terms of populating the tables, especially when you're working with large dimensions (>150K records) and slowly changing dimensions, you want to make sure you use the ELT components for SCD and not the standard ones as they don't scale out well.

Roland