How to load data from a file in s3 to redshift without headers

[Anonymous]

Hi,

I placed a csv file from my local to s3 using tS3Put component. Now, I want to load the data from that file to a redshift table. I want to load from second row. How can I do this?

Thanks in advance.

Thank You,

Alekhya.

[vapukov · Accepted solution]

Hi,

you could use tRedshiftBulkExec component

in advanced setting you can add Redshift COPY parameters, like IGNOREHEADER (number of rows)

[Anonymous]

Hi,

When I run the job, I am facing below error for the column 'effective_from_dt'.

Invalid Date Format - length must be 10 or more

This is the date value in csv -- 12-31-4712 00:00:00

In the schema also, I had defined correctly.

Any idea why is it showing like that?

issue.png

[vapukov]

This is the date value in csv -- 12-31-4712 00:00:00

at least because it is the wrong date 🙂 

because you are load (and possibly prepare) csv file self - need to investigate why you have wrong dates in csv

and finally - you can manage date format - redshift copy date format 

[Anonymous]

Thanks.

It worked when I declared date format.