How to load the empty value in file as null in tPostgreSqlOuput incase of Dynamic Schema

BSelvaraj1647239494 — Wed, 30 Mar 2022 12:32:23 GMT

Hi,

I am trying to load the input file to table in postgress using tpostgresqloutput, but it is causing issue because of empty values in file. I am using dynamic schema hence unable to use tconverttype and tmap components because the fields are getting fetched during runtime, hence mapping cannot be done in job. I tried to convert the empty values as null in tjavarow component using the Dynamic code and it worked. But the performance for inserting the records is very less, which means job is taking around 3hours for load 45K records. Please let me know is there any option present to convert the empty values as null before loading the data into table in Dynamic Schema.

Re: How to load the empty value in file as null in tPostgreSqlOuput incase of Dynamic Schema

gjeremy1617088143 — Thu, 31 Mar 2022 07:50:22 GMT

Have you try to separate the job in two process ?

you read the input you replace empty by null then you send it to a tHashOutput

then

you made second subjob with a read of a tHashInput and you write to the database, if this don't resolve your performance issue so you have issue on writing data in the DB.

Send me love and kudos

topic Re: How to load the empty value in file as null in tPostgreSqlOuput incase of Dynamic Schema in Talend Studio

How to load the empty value in file as null in tPostgreSqlOuput incase of Dynamic Schema

Re: How to load the empty value in file as null in tPostgreSqlOuput incase of Dynamic Schema