tRedshiftUnload - Creates Empty Name S3 Object and Multiple Empty Files

Anonymous — Sat, 16 Nov 2024 09:24:24 GMT

Hi All,

Trying to figure out how to configure this tool further or if it is possible to do so.

I would like to prevent the tool from creating an empty name S3 Object regardless of what I put into the S3 Settings of the tool. My example shows that I am successfully creating content out on S3. But see the screenshots of my S3 Settings and the S3 buckets. I would like the tool to not create empty files or the empty directory name. My query in this sample returns 1 record of two fields.

Any ideas?

Re: tRedshiftUnload - Creates Empty Name S3 Object and Multiple Empty Files

vapukov — Thu, 17 Aug 2017 08:02:24 GMT

You can check number of rows (0 or more) before unload data

tRedshiftInput (schema - single column cnt (INTEGER) )

SELECT 
      CASE WHEN EXIT (SELECT .....) THEN
     1
ELSE
     0
END as cnt

than use runIf trigger

if row1.cnt == 1 -> Unload data

EXISTS work very fast - it stop work after first funded rows

topic Re: tRedshiftUnload - Creates Empty Name S3 Object and Multiple Empty Files in Talend Studio

tRedshiftUnload - Creates Empty Name S3 Object and Multiple Empty Files

Re: tRedshiftUnload - Creates Empty Name S3 Object and Multiple Empty Files