topic Re: [resolved] Dynamic schema in Netezza components in Talend Studio

[resolved] Dynamic schema in Netezza components

Anonymous — Thu, 26 Jun 2014 14:51:53 GMT

Hello,
I would really appreciate for my jobs, if I could use dynamic schema for Netezza components. However, currently, this is unsupported. I have found a similar topic here: http://www.talendforge.org/forum/viewtopic.php?pid=57674
Is it planned to implement this feature or would it make sense to put a feature request at jira?
Thanks
Jan

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Thu, 26 Jun 2014 19:56:19 GMT

You can use dynamic schemas to read from other DB's and write to a file(which supports dynamic schemas) then use nzload. If you need to source files dynamically from NZ use CREATE EXTERNAL TABLE to create the files.

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Fri, 27 Jun 2014 08:57:43 GMT

Hi,
It is welcome to open a feature jira issue of DI project for your requirement on Talend Bug Tracker.
For tNetezzaInput, the dynamic type support is there, not tNetezzaNzLoad, tNetezzaOutput.
Best regards
Sabrina

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Fri, 27 Jun 2014 17:16:08 GMT

Thanks both. I posted a feature request on the bug tracker.

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Mon, 30 Jun 2014 11:30:16 GMT

Hi jan.fabian,
Could you please paste the feature jira url on forum so that other community can check it. Thanks for your contribution.
Bets regards
Sabrina

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Tue, 01 Jul 2014 22:32:17 GMT

Hello Sabrina,
It's this feature: https://jira.talendforge.org/browse/TDI-29916
Best
Jan

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Wed, 02 Jul 2014 08:50:10 GMT

Hi,
Thanks for your contribution. We will inform you as long as this feature issue is resolved.
Best regards
Sabrina

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Wed, 02 Jul 2014 14:38:36 GMT

Hi,
thank you. The workaround proposed by jholman works with two significant drawbacks: it is slower and I cannot create table if not exists while loading data into Netezza.
Best
Jan

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Wed, 02 Jul 2014 16:24:06 GMT

I have found create external table to be quite fast and even faster than any other method if using COMPRESS TRUE when moving between Netezza NPS. Also, Netezza does not support IF (NOT) EXISTS statements, so you cannot use that anyway. I usually query the catalog table _V_TABLE to see if the table exists and drop it if required (or write an SP).

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Wed, 02 Jul 2014 17:25:47 GMT

My problem is related to the tNetezzaOutput, so I need to load data with dynamic schema into Netezza. Writing to a file and SCPing it to a DB server is slower than just using tNetezzaOutput. And anyway, it is a solution that is not suitable for us, compared to using talend components for inserting data into DB.
With the create table if not exist, I was talking again about the tNetezzaOutput component and the "action on table" - that works, actually. Sorry for not being clear.

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Wed, 02 Jul 2014 21:26:52 GMT

I feel your pain on no dynamic schema support, I would love to have it for tNetezzaNzload especially, but why SCP the file?
You can just create the external table and load it from where it was created with nzload which outperforms JDBC easily, especially if they are compressed. eg:
tNetezzaRow (CREATE EXTERNAL TABLE) --> tNetezzaNzload
I know this doesn't help with table creation but will be much faster than tNetezzaOutput.

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Thu, 03 Jul 2014 18:34:57 GMT

Well, that might work, thanks for the suggestion. Unfortunately, we are trying to get rid of any dumps into files, so I am not sure if this will be suitable.
Anyway, closely related question: In the Talend Components Reference Guide on p. 1834, it is written for tJDBCOutput that it supports dynamic schema. This might be a solution for us, even when the JDBC component version is a little bit slower. However, when I check my supportDynamic.txt, tJDBCOutput isn't listed and it also really doesn't work for me.
So is there a mistake in the reference guide?

Re: [resolved] Dynamic schema in Netezza components

Anonymous — Thu, 10 Jul 2014 08:15:13 GMT

Hi,

Anyway, closely related question: In the Talend Components Reference Guide on p. 1834, it is written for tJDBCOutput that it supports dynamic schema. This might be a solution for us, even when the JDBC component version is a little bit slower. However, when I check my supportDynamic.txt, tJDBCOutput isn't listed and it also really doesn't work for me.
So is there a mistake in the reference guide?

For this closely related question, please navigate to forum https://community.talend.com/t5/Design-and-Development/resolved-tJDBCOutput-dynamic-schema-support/td-p/108231 for more details.
Best regards
Sabrina