Extract Data from file and iterate over DB

[mshafeeq]

hi folks, 

i'm designing a job read +10K columns from file and take some columns and define them as context variable to run oracle DB function and then insert it to parquet file 

the design is below is working fine when testing insert the data to postgres table but now i need to create a parquet file , my issue with parquet file gives only action (create/overwrite) i cannot append on the created file before so by the end , only 1 record will be inserted in the file (because of iteration)

[Shicong_Hong]

Hi 

You can use a tUnite component before tFileOutputParquet to merge all data before they are written into parquet file. 

Regards

Shicong