Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
ekamal
Contributor
Contributor
‎2021-03-10 10:48 AM

ignore new columns while loading into postgressql

I am trying load data from a csv file to postgres table using dynamic load.

I am trying to see is there an option to ignore new columns added in the source file while loading into postgressql

Labels (3)
Labels
274 Views
0 Likes
1 Reply
evansdar
Contributor II
Contributor II
‎2021-03-10 12:45 PM

I've done this before using dynamic schema. Basically you query the target metadata to get a set of columns, and the incoming file to get a set of columns and do a set difference to get the new columns from the source, from there you can use the common columns to load to tgt.

 

You may also be able to use POSTGRES' ON CONFLICT IGNORE functionality, but I've never tested this use case

274 Views
0 Likes