Inserting data to redshift using tredshiftoutputbulkexec -->'stl_load_errors'

Anonymous — Sat, 16 Nov 2024 03:40:11 GMT

Initially I tried tmongodbinput ==> tredshiftoutput the data loaded succesfully, but it took me about 460 rows/second it takes too long time. To improve the performance tried tredshiftoutputbulkexec component.

Now trying to load my mongodb data into the redshift. Going from (tmongodbinput) directly to (tredshiftoutputbulkexec) got me about same time approx 450 rows/second.BUT DATA NOT LOADED INTO TABLE.

Error Message : Invalid operation: Load into table 'fact_table' failed. Check 'stl_load_errors' system table for details.

Reading the data is faster in tredshiftoutputbulkexec but commits takes same as tredshiftoutput.

I attached the screen shot below.

-----------------------------------------------

Can anyone please help me with the solution.

Please do let me know if you need any more details.

Re: Inserting data to redshift using tredshiftoutputbulkexec -->'stl_load_errors'

vapukov — Wed, 29 Jan 2020 01:19:40 GMT

Hi,

errors with BulkExec components could be as an example by collisions with used delimiter character and escaping (check Advanced Settings tab in component)

And in any case, first what you need to do it is check the real error

https://docs.aws.amazon.com/redshift/latest/dg/r_STL_LOAD_ERRORS.html

https://aws.amazon.com/premiumsupport/knowledge-center/redshift-stl-load-errors/

regards, Vlad

topic Re: Inserting data to redshift using tredshiftoutputbulkexec -->'stl_load_errors' in Talend Studio

Inserting data to redshift using tredshiftoutputbulkexec -->'stl_load_errors'

Re: Inserting data to redshift using tredshiftoutputbulkexec -->'stl_load_errors'