Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Join us in NYC Sept 4th for Qlik's AI Reality Tour! Register Now
cancel
Showing results for 
Search instead for 
Did you mean: 
fn_guennoun
Contributor
Contributor

Data warehouse creation PostgreSQL

Hello,

I'm using Talend Data Integration as an ETL for my business intelligence project.

I have a clear vision of what the final schema of the data warehouse would be (I defined the dimensions and the fact tables).

Is it possible to use Talend to create the fact tables, the dimensions and the relationship between these ? If that's possible, how do I do that?

PS : the data warehouse should be implemented in PostgreSQL.

 

Labels (2)
2 Replies
Anonymous
Not applicable

Hi,

As a coincidence, I'm also creating a dimensional data warehouse at the moment in Postgres and I'm also relatively new to Talend. I'm not sure if I understand the question correctly, but you can definitely as part of a job have Talend create tables in the tPostgresQLOutput component if they don't exist yet and indicate primary keys. I personally prefer to have the modeling tool create the DDL in advance and have Talend just populate the tables. In terms of populating the tables, especially when you're working with large dimensions (>150K records) and slowly changing dimensions, you want to make sure you use the ELT components for SCD and not the standard ones as they don't scale out well.

 

Roland

Anonymous
Not applicable

Hi,

As a coincidence, I'm also creating a dimensional data warehouse at the moment in Postgres and I'm also relatively new to Talend. I'm not sure if I understand the question correctly, but you can definitely as part of a job have Talend create tables in the tPostgresQLOutput component if they don't exist yet and indicate primary keys. I personally prefer to have the modeling tool create the DDL in advance and have Talend just populate the tables. In terms of populating the tables, especially when you're working with large dimensions (>150K records) and slowly changing dimensions, you want to make sure you use the ELT components for SCD and not the standard ones as they don't scale out well.

 

Roland